-- Logs begin at Thu 2022-05-05 14:33:57 UTC, end at Thu 2022-05-05 15:52:15 UTC. -- May 05 15:11:34.168035 dv-cinder-840678-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 05 15:11:34.176046 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 05 15:11:34.178047 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 5 15:11:34 2022] *** May 05 15:11:34.178047 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 05 15:11:34.178047 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 05 15:11:34.178047 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: nodename: dv-cinder-840678-1-iscsi May 05 15:11:34.178047 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: machine: x86_64 May 05 15:11:34.178419 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: clock source: unix May 05 15:11:34.178419 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: pcre jit disabled May 05 15:11:34.178419 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: detected number of CPU cores: 4 May 05 15:11:34.178419 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: current working directory: / May 05 15:11:34.178419 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: detected binary path: /usr/bin/uwsgi-core May 05 15:11:34.178419 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: your processes number limit is 47680 May 05 15:11:34.178419 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: your memory page size is 4096 bytes May 05 15:11:34.178419 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: detected max file descriptor number: 2048 May 05 15:11:34.178419 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: lock engine: pthread robust mutexes May 05 15:11:34.178419 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: thunder lock: enabled May 05 15:11:34.180702 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 05 15:11:34.180702 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 05 15:11:34.225747 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: Python main interpreter initialized at 0x55f92b8379c0 May 05 15:11:34.225747 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: python threads support enabled May 05 15:11:34.225747 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: your server socket listen backlog is limited to 100 connections May 05 15:11:34.225747 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: your mercy for graceful operations on workers is 90 seconds May 05 15:11:34.226123 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: mapped 403077 bytes (393 KB) for 2 cores May 05 15:11:34.226199 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: *** Operational MODE: preforking *** May 05 15:11:34.226476 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: *** uWSGI is running in multiple interpreter mode *** May 05 15:11:34.226476 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: spawned uWSGI master process (pid: 80045) May 05 15:11:34.226683 dv-cinder-840678-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 05 15:11:34.227792 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: spawned uWSGI worker 1 (pid: 80059, cores: 1) May 05 15:11:34.227792 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: spawned uWSGI worker 2 (pid: 80060, cores: 1) May 05 15:11:34.227792 dv-cinder-840678-1-iscsi devstack@keystone.service[80045]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 05 15:11:40.051453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 15:11:40.051453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: from cryptography.utils import int_from_bytes May 05 15:11:40.052196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 15:11:40.052196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: from cryptography.utils import int_from_bytes May 05 15:11:40.053809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 15:11:40.053809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: from cryptography.utils import int_from_bytes May 05 15:11:40.054316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 15:11:40.054316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: from cryptography.utils import int_from_bytes May 05 15:11:40.101755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 15:11:40.101947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 15:11:40.102137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] command line args: [] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 15:11:40.102433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 15:11:40.102612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ================================================================================ {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 15:11:40.102863 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] admin_token = **** {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.103112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] config_dir = [] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.103249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 15:11:40.103334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.103448 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 15:11:40.103535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] config_source = [] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.103614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] debug = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.103690 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] command line args: [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 15:11:40.103808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.104073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 15:11:40.104073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ================================================================================ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 15:11:40.104188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.104319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] admin_token = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.104409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.104547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] config_dir = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.104625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.104737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.104821 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.104931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] config_source = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.105033 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] list_limit = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.105129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] debug = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.105235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] log_config_append = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.105331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.105462 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.105566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] log_dir = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.105667 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.105772 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] log_file = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.105879 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.105981 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.106096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.106220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.106328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.106412 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.106485 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.106609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_config_append = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.106684 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.106805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.106881 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.107007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_dir = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.107084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.107207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_file = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.107289 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.107367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.107489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.107573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.107652 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.107768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.107850 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.107996 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.108132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.108207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.108286 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.108403 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.108524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.108638 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.108760 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.108880 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.108995 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.109116 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.109236 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.109454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.109586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.109696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] publish_errors = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.109891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.110275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.110275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.110545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.110667 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.110782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.110901 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.111017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.111140 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.111262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] standard_threads = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.111447 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.111565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.111679 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.111879 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] publish_errors = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.111997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.112119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.112243 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] use_journal = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.112243 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] use_json = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.112458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.112572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] use_stderr = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.112692 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.112813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] use_syslog = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.112936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.113051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.113167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.113280 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.113394 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] standard_threads = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.113514 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.113647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.113763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.113877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.113997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.114112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.114112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] use_journal = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.114358 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.114476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] use_json = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.114596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.114712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] use_stderr = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.114712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] use_syslog = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.114938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.115065 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:11:40.115198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.115371 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.115490 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.115611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.115727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.115851 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.115967 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.116080 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.116200 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.116322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.116442 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.116601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.116723 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.116723 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.116937 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.116937 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.117150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.117150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.117444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.117559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.117677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.117791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.117905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.118027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.118142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.118255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.118406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.118521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.118635 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.118763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.118878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.118992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.119105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.119105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.119319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.119319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.119543 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.119665 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.119785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.119906 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.120030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.120150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.120265 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.120385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.120501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.120614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.120737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.120852 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.120971 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.121086 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.121200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.121314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.121440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.121563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.121678 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.121791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.121905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.122018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.122124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.122221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.122363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.122477 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.122576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.122671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.122778 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.122905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.123018 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.123116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.123231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.123344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.123470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.123588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.123702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.123816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.123931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.124045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.124172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.124287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.124287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.124503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.124617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.124734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.124861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.124967 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.125094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.125216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.125332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.125492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.125674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.125850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.125972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.126077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.126206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.126349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.126467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.126595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.126722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.126722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.126958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.127079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.127207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.127333 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.127450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.127571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.127696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.127813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.127813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.128042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.128042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.128274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.128274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.128491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.128612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.128736 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.128736 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.128953 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.129067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.129182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.129297 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.129484 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.129603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.129718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.129833 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.129955 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.130071 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.130199 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.130356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.130474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.130589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.130720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.130844 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.130969 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.131086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.131207 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.131323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.131437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.131558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.131682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.131798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.131913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.132029 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.132144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.132258 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.132384 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.132512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.132639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.132756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.132871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.132986 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.133108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.133224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.133348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.133464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.133579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.133700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.133815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.133930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.134054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.134176 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.134306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.134433 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.134551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.134667 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.134791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.134907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.135026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.135143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.135265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.135389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.135505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.135621 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.135736 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.135851 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.135966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.136089 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.136206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.136327 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.136444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.136559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.136675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.136798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.136914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.137030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.137145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.137261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.137375 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.137502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.137620 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.137736 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.137850 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.137965 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.138080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] auth.external = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.138207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.138340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.138458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.138574 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.138689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.138804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.138932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.139054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] auth.password = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.139171 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.139287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] auth.token = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.139402 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.139523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.139647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.139769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.139911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.140036 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.140154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.140270 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.140392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.140509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.140634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.external = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.140751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.140866 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.140982 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.141688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.141814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] credential.caching = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.141945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.142064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.142180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.password = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.142339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.142461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.token = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.142577 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.142707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.142825 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.142941 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.143068 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.143068 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.143068 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.143463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.143584 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.143701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.143817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.143933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.144050 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.144176 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.144293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.144410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.144525 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.144642 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.144758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.144886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.145003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.145120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.145236 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.145352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.145468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] federation.caching = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.145601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.145719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.145835 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.145960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.146089 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.146207 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.146350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.146469 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.146585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.146702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.146818 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.146941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.147067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.147184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.147300 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.147416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.147539 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.147655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.147782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.147899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.148015 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.148131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.148248 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.148372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.caching = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.148495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.148612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.148728 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.148845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.148961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.149085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.149202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.149318 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.149434 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.149557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.149674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.149799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.149916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.150032 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.150165 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.150295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.150415 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.150544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.150672 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.150792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.150909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.151036 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.151036 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.151266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.151266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.151492 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.151609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.151724 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.151840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.151965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.152090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.152213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.152401 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.152522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.152639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.152764 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.152881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.152999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.153115 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.153232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.153348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.153473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.153595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.153711 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.153711 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.154007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.154133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.154258 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.154404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.154522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.154638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.154753 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.154870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.155070 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.155198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.155316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.155436 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.155559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.155676 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.155801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.155919 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.156035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.156152 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.156267 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.156384 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.156508 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.156647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.157303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.157428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.157545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.157660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.157785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.157908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.158025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.158141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.158264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.158399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.158529 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.158647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.158763 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.158893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.158893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.159132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.159263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.159263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.159490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.159606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.159722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.159846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.159964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.160080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.160195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.160313 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.160676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.160802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.160918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.161035 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.161150 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.161266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.161382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.161506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.161623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.161738 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.161854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.161970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.162093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.162219 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.162383 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.162503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.162619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.162735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.162850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.162979 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.163097 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.163214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.163330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.163447 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.163563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.163688 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.163804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.163921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.164037 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.164153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.164268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.164393 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.164511 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.164627 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.164743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.164859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.164975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.165098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.165215 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.165331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.165451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.165569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.165685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.165809 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.165927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.166043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.166159 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.166275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.166411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.166539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.166658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.166774 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.166889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.167005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.167121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.167309 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.167428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.167544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.167661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.167777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.167883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.168006 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.168122 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.168238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.168354 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.168470 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.168585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.168711 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.168827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.168943 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.169058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.169210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.169329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.169454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.169571 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.169686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.169802 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.169918 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.170034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.170157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] resource.caching = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.170274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.170454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.170570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.170686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.170802 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.170931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.171048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.171164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.171280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.171396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.171512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.171636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.171753 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.171869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.171869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.172086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.172202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.172421 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.172563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] role.caching = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.172681 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.172797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] role.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.172915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.173032 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.173157 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.173275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.173390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.173507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.173624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.173740 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.173866 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.173984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.174101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.174217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.174347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.174477 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.174595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.174712 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.174712 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.174928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.175045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.175169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.175286 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.175402 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.175522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.175638 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.175754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.175877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.175994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.176111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.176111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.176327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.176442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] role.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.176566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.176683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] role.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.176799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.176915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.177031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.177148 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.177272 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.177389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.177506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.177622 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.177738 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.177855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.177979 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.178096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.178213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.178353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.178471 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.178587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.178715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.178834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.178950 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.179073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.179191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.179306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.179431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.179548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.179670 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.179788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.179904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.180020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.180144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.180144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.180363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.180479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.180594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.180719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] token.caching = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.180836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.180953 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.181069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.181185 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.181302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.181425 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.181542 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.181658 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.181775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.181891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.182007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.182134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.182134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.182373 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.182491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.182607 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.182607 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.182833 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.182950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.183066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.183182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.183298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.183298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.183525 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.183641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.183757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.183873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.183989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.184105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.184229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.184347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.184464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.184464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.184681 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.184796 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.184920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.connection = **** {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.185046 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.185175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.185294 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.185414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.185532 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.185649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.185649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.185876 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.185992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.186107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.186222 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.186386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.186517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.186636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.186752 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.186868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.186983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.187099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.187223 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.187340 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.187455 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.187572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.187687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.187803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.188038 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.188160 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.188277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.188393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.188508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.188625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.188749 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.188867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.188983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.189098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.189214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.189214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 15:11:40.189440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.189440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.189440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.189440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.189440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.189440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.189440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.189440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.190350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.190350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.190350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.190350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.190768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.190768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.190991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.191237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.191472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.191717 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.191956 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:11:40.192129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 15:11:40.218381 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.218611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.218836 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.221520 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.221752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.221979 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.228830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.230742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.257868 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.258100 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.260229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.260467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.311186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.311893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.364882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.365090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.365178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.365256 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.431766 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.431998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.432112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.432220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.432303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.432440 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.432523 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.432654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.432751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.432867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.432950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.433081 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.457307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.457543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.457771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.457856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.457996 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.458081 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.458214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.458323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.458457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.458542 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.458673 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.458755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.458907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.459123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.470220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.470813 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.484851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.485174 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.485400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.485621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.485702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.485838 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.485929 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.486053 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.486135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.486266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.486375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.486574 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.486793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.487013 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:11:40.504478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.504686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 15:11:40.505021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.505119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.505223 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 15:11:40.505307 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 15:11:40.505489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.505571 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.505745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 15:11:40.505827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.505995 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.506077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.506241 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.506341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.506539 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.506794 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.518099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.518397 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.518662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.518853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.518938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.519133 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.519405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.519685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.526928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.527738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.530158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.530466 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.530744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.531019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.531113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.531298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.531380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.531577 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.531797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.532302 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.532459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.532592 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.532749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.532863 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.533014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.533136 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.533288 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.533404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.533566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.533839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.534113 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.534414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.560286 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.561811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.561902 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.562157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.564344 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.564622 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.567951 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.568234 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.568517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.569847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.570126 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.570442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.575792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.576069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.577652 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.577933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.580722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.581004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.581282 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.581560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.581831 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.582099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.582396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.582663 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.583047 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.583334 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.583620 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.583905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.584180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.584454 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.584725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.584993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.601128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.601401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.603802 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.604085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.605872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.608575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.609458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.610271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.612736 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.613023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.615290 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.617937 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.618835 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.621473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.622528 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.622827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.623108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.623385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.623655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.623926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.625168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.626041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.626344 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.626628 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.626902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.627177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.644287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.644661 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.644928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.645193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.646156 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.646555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.646828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.647091 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.652987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.654705 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.654873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.654958 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.656554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.657121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.658317 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.658599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.658883 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.659160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.659436 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.660163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.660695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.660979 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.661257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.661527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.673452 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.673723 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.674001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.674275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.674574 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.674846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.675131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.675587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.675864 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.676139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.676445 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.676801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.677073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.677353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.694206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.696055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.697491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.699329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.700776 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.702406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.702629 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.704193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.704468 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.704551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.704750 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.706094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.706395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.706675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.712086 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.713678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.713981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.715605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.716871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.717157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.717445 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.717720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.718806 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.719095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.719611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.720029 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.727137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.727440 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.727726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.729341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.729634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.729916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.736294 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.736567 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.736843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.737130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.737398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.737666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.737936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.738215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.738507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.738690 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:11:40.738773 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.738970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.739054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.739256 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.739338 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.739530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.739619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.739792 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.739873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.740058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.740324 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.740602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.740867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.741142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.741406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.741659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.741915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.742181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:11:40.778776 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f92b8379c0 pid: 80060 (default app) May 05 15:11:40.780767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f92b8379c0 pid: 80059 (default app) May 05 15:11:40.783522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab4040-d2a3-428d-8f3e-eb48f7621c3e None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:40.783823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab4040-d2a3-428d-8f3e-eb48f7621c3e None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:40.784105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab4040-d2a3-428d-8f3e-eb48f7621c3e None None] PATH_INFO: `/v3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:40.788522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Thu May 5 15:11:40 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:49.751595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc95cc-f1ed-4cf0-9e02-75702d138736 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:49.752168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc95cc-f1ed-4cf0-9e02-75702d138736 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:49.752168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc95cc-f1ed-4cf0-9e02-75702d138736 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:49.756462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:11:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:49.767427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69f5c5-1989-499a-83cd-5332c80367f4 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:49.767427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69f5c5-1989-499a-83cd-5332c80367f4 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:49.767427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69f5c5-1989-499a-83cd-5332c80367f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:49.793727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG oslo_db.sqlalchemy.engines [None req-6b69f5c5-1989-499a-83cd-5332c80367f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 15:11:49.976882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG passlib.handlers.bcrypt [None req-6b69f5c5-1989-499a-83cd-5332c80367f4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80060) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 05 15:11:49.977316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG passlib.handlers.bcrypt [None req-6b69f5c5-1989-499a-83cd-5332c80367f4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80060) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 05 15:11:50.032876 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6b69f5c5-1989-499a-83cd-5332c80367f4 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:50.034452 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6b69f5c5-1989-499a-83cd-5332c80367f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:50.158545 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:11:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 05 15:11:50.351427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc95cc-f1ed-4cf0-9e02-75702d138736 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:50.386179 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG oslo_db.sqlalchemy.engines [None req-10bc95cc-f1ed-4cf0-9e02-75702d138736 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 15:11:50.514957 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc95cc-f1ed-4cf0-9e02-75702d138736 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:50.520263 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f09d97-4274-485d-8d39-ddf397bbc2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:50.520924 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f09d97-4274-485d-8d39-ddf397bbc2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:50.521210 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f09d97-4274-485d-8d39-ddf397bbc2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:50.521489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f09d97-4274-485d-8d39-ddf397bbc2e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:50.529394 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f09d97-4274-485d-8d39-ddf397bbc2e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:50.582919 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: WARNING keystone.common.rbac_enforcer.enforcer [None req-07f09d97-4274-485d-8d39-ddf397bbc2e1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 05 15:11:50.583267 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f09d97-4274-485d-8d39-ddf397bbc2e1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:50.592600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1324 bytes} [Thu May 5 15:11:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:11:50.599035 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69f5c5-1989-499a-83cd-5332c80367f4 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:50.613950 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69f5c5-1989-499a-83cd-5332c80367f4 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:50.618370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a332a5-2b61-421e-ba75-4b83bd5eafff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:50.620253 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a332a5-2b61-421e-ba75-4b83bd5eafff admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:50.620253 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a332a5-2b61-421e-ba75-4b83bd5eafff admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:50.620253 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a332a5-2b61-421e-ba75-4b83bd5eafff admin admin] PATH_INFO: `/v3/projects/02855100ad2c4964b2978e96832f8664` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:50.621551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a332a5-2b61-421e-ba75-4b83bd5eafff admin admin] RBAC: Authorizing `identity:get_project(project_id=02855100ad2c4964b2978e96832f8664)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:50.671921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e1a332a5-2b61-421e-ba75-4b83bd5eafff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 05 15:11:50.672795 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a332a5-2b61-421e-ba75-4b83bd5eafff admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:50.677323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 3/5] 10.222.0.44 () {56 vars in 1207 bytes} [Thu May 5 15:11:50 2022] GET /identity/v3/projects/02855100ad2c4964b2978e96832f8664 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:52.940106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503e28-9971-4177-8558-f95a60ca8f6c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:52.940634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503e28-9971-4177-8558-f95a60ca8f6c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:52.940717 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503e28-9971-4177-8558-f95a60ca8f6c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:52.944706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 3/6] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:11:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:52.950129 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0debe-803e-4790-8a47-394c57800ab1 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:52.950582 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0debe-803e-4790-8a47-394c57800ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:52.950725 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0debe-803e-4790-8a47-394c57800ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:52.971719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-fda0debe-803e-4790-8a47-394c57800ab1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:52.973250 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-fda0debe-803e-4790-8a47-394c57800ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:52.981124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:11:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 05 15:11:53.005063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3503e28-9971-4177-8558-f95a60ca8f6c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:53.017395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3503e28-9971-4177-8558-f95a60ca8f6c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:53.021506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89903efd-e600-416e-8666-c87239996fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:53.022138 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89903efd-e600-416e-8666-c87239996fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:53.022468 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89903efd-e600-416e-8666-c87239996fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:53.022748 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89903efd-e600-416e-8666-c87239996fdc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:53.030208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89903efd-e600-416e-8666-c87239996fdc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:53.033009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89903efd-e600-416e-8666-c87239996fdc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:53.041786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1324 bytes} [Thu May 5 15:11:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:11:53.047883 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0debe-803e-4790-8a47-394c57800ab1 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:53.056872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0debe-803e-4790-8a47-394c57800ab1 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:53.061285 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d1465-3470-467c-bdb9-6577910000c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:53.062149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d1465-3470-467c-bdb9-6577910000c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:53.062475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d1465-3470-467c-bdb9-6577910000c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:53.062903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d1465-3470-467c-bdb9-6577910000c2 admin admin] PATH_INFO: `/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:53.064384 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d1465-3470-467c-bdb9-6577910000c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=faf5764aa68b4dd0a7861a70d6db3d3d)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:53.066206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d1465-3470-467c-bdb9-6577910000c2 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:53.067804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 5/9] 10.222.0.44 () {56 vars in 1198 bytes} [Thu May 5 15:11:53 2022] GET /identity/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:55.355133 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f4e87-6091-482f-94b3-17211faab1d9 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:55.355639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f4e87-6091-482f-94b3-17211faab1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:55.355718 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f4e87-6091-482f-94b3-17211faab1d9 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:55.357032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:55.362861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c7b3-d737-4e5a-b849-2a9c912e0b7b None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:55.363296 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c7b3-d737-4e5a-b849-2a9c912e0b7b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:55.363394 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c7b3-d737-4e5a-b849-2a9c912e0b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:55.419034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea82fe-47e8-49fe-a61d-1bb25523ed94 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:55.419323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea82fe-47e8-49fe-a61d-1bb25523ed94 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:55.419606 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea82fe-47e8-49fe-a61d-1bb25523ed94 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:55.420979 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 6/11] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:55.427111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397f097-b5df-48ed-bd8a-a5b3ae3f9daf None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:55.427398 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397f097-b5df-48ed-bd8a-a5b3ae3f9daf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:55.427679 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397f097-b5df-48ed-bd8a-a5b3ae3f9daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:55.470897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG passlib.handlers.bcrypt [None req-6397f097-b5df-48ed-bd8a-a5b3ae3f9daf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80059) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 05 15:11:55.471323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG passlib.handlers.bcrypt [None req-6397f097-b5df-48ed-bd8a-a5b3ae3f9daf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80059) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 05 15:11:55.492060 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-7df7c7b3-d737-4e5a-b849-2a9c912e0b7b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:55.493254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7df7c7b3-d737-4e5a-b849-2a9c912e0b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:55.518565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-6397f097-b5df-48ed-bd8a-a5b3ae3f9daf None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:55.520157 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6397f097-b5df-48ed-bd8a-a5b3ae3f9daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:55.574376 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:11:55.597665 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c7b3-d737-4e5a-b849-2a9c912e0b7b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:55.619703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:11:55.641816 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397f097-b5df-48ed-bd8a-a5b3ae3f9daf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:55.692932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c7b3-d737-4e5a-b849-2a9c912e0b7b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:55.724741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d696-5805-4f2f-87b4-57f6252fb00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:55.725537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d696-5805-4f2f-87b4-57f6252fb00c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:55.725820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d696-5805-4f2f-87b4-57f6252fb00c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:55.726092 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d696-5805-4f2f-87b4-57f6252fb00c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:55.736640 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397f097-b5df-48ed-bd8a-a5b3ae3f9daf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:55.737334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140d696-5805-4f2f-87b4-57f6252fb00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-7140d696-5805-4f2f-87b4-57f6252fb00c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:11:55.748399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:55.749404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:55.751089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:55.751089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:55.751089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:55.751089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:55.751089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:11:55.751089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:11:55.751089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:11:55.751089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:11:55.751089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:11:55.751089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:11:55.751089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:55.751089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:11:55.751089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 7/14] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:11:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:55.756118 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d696-5805-4f2f-87b4-57f6252fb00c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:55.772797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db78dcb-2d52-4640-9f6f-41c3e405666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:55.773705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db78dcb-2d52-4640-9f6f-41c3e405666c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:55.773993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db78dcb-2d52-4640-9f6f-41c3e405666c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:55.774270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db78dcb-2d52-4640-9f6f-41c3e405666c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:55.846003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db78dcb-2d52-4640-9f6f-41c3e405666c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:55.847562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db78dcb-2d52-4640-9f6f-41c3e405666c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:55.851780 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d696-5805-4f2f-87b4-57f6252fb00c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:55.886669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36510584-28fd-482f-8494-3e2000e18d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:55.887345 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36510584-28fd-482f-8494-3e2000e18d4e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:55.887633 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36510584-28fd-482f-8494-3e2000e18d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:55.887912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36510584-28fd-482f-8494-3e2000e18d4e None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:55.888661 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36510584-28fd-482f-8494-3e2000e18d4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:55.888969 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36510584-28fd-482f-8494-3e2000e18d4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:55.890374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36510584-28fd-482f-8494-3e2000e18d4e None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:55.901735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 8/15] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:11:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:55.907303 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36510584-28fd-482f-8494-3e2000e18d4e None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:55.941993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:11:55.947458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db78dcb-2d52-4640-9f6f-41c3e405666c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:56.004336 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36510584-28fd-482f-8494-3e2000e18d4e None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:56.036991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcca24-08fd-4c54-aad1-493b909e0ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:56.037865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcca24-08fd-4c54-aad1-493b909e0ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:56.038145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcca24-08fd-4c54-aad1-493b909e0ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:56.038500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcca24-08fd-4c54-aad1-493b909e0ba3 None admin] PATH_INFO: `/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:56.039648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcca24-08fd-4c54-aad1-493b909e0ba3 None admin] RBAC: Authorizing `identity:get_user(user_id=faf5764aa68b4dd0a7861a70d6db3d3d)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:56.041108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcca24-08fd-4c54-aad1-493b909e0ba3 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:56.042042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db78dcb-2d52-4640-9f6f-41c3e405666c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:56.042761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 9/17] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:11:55 2022] GET /identity/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:56.048437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcca24-08fd-4c54-aad1-493b909e0ba3 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:56.074155 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af141f56-814c-40af-8564-feaf60a61821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:56.074984 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af141f56-814c-40af-8564-feaf60a61821 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:56.075275 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af141f56-814c-40af-8564-feaf60a61821 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:56.075556 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af141f56-814c-40af-8564-feaf60a61821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:56.150744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcca24-08fd-4c54-aad1-493b909e0ba3 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:56.186080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddb31b-4120-43c1-9aae-5fe0581ffbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:56.187024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddb31b-4120-43c1-9aae-5fe0581ffbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:56.187316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddb31b-4120-43c1-9aae-5fe0581ffbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:56.188121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddb31b-4120-43c1-9aae-5fe0581ffbf6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:56.189426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddb31b-4120-43c1-9aae-5fe0581ffbf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:56.190920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddb31b-4120-43c1-9aae-5fe0581ffbf6 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:56.192521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 10/18] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:11:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:56.198078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddb31b-4120-43c1-9aae-5fe0581ffbf6 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:56.201952 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af141f56-814c-40af-8564-feaf60a61821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:56.204084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af141f56-814c-40af-8564-feaf60a61821 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-af141f56-814c-40af-8564-feaf60a61821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:56.225735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:56.226772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:56.227754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:56.227754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:56.227754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:56.227754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:11:56.227754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 9/19] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:11:56.232699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af141f56-814c-40af-8564-feaf60a61821 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:56.298368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddb31b-4120-43c1-9aae-5fe0581ffbf6 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:56.328933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af141f56-814c-40af-8564-feaf60a61821 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:56.330880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ce846-ceb5-42fe-b5a6-307311b73eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:56.331543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ce846-ceb5-42fe-b5a6-307311b73eec None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:56.331827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ce846-ceb5-42fe-b5a6-307311b73eec None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:56.332104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ce846-ceb5-42fe-b5a6-307311b73eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:56.332929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ce846-ceb5-42fe-b5a6-307311b73eec None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.domain.id=default, user.id=faf5764aa68b4dd0a7861a70d6db3d3d) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:56.333240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ce846-ceb5-42fe-b5a6-307311b73eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:56.334797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ce846-ceb5-42fe-b5a6-307311b73eec None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:56.341330 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 11/20] 10.222.0.44 () {56 vars in 1322 bytes} [Thu May 5 15:11:56 2022] GET /identity/v3/role_assignments?user.id=faf5764aa68b4dd0a7861a70d6db3d3d&scope.domain.id=default&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:56.366220 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d3d16-40cc-4848-8606-6dde589aa681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:56.366943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d3d16-40cc-4848-8606-6dde589aa681 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:56.367231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d3d16-40cc-4848-8606-6dde589aa681 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:56.367513 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d3d16-40cc-4848-8606-6dde589aa681 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:56.368262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d3d16-40cc-4848-8606-6dde589aa681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:56.368575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d3d16-40cc-4848-8606-6dde589aa681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:56.370019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d3d16-40cc-4848-8606-6dde589aa681 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:56.389156 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 10/21] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:11:58.817665 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381b3b3-3377-48fd-a27c-dbaaba2d3e9b None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:58.818645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381b3b3-3377-48fd-a27c-dbaaba2d3e9b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:58.819152 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381b3b3-3377-48fd-a27c-dbaaba2d3e9b None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:58.820987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 12/22] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:58.832738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63df092-03c8-466d-b25f-cee71efe311b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:58.833204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63df092-03c8-466d-b25f-cee71efe311b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:58.833417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63df092-03c8-466d-b25f-cee71efe311b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:58.861917 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a63df092-03c8-466d-b25f-cee71efe311b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:58.863141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a63df092-03c8-466d-b25f-cee71efe311b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:58.948598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 11/23] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:11:58.983295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381b3b3-3377-48fd-a27c-dbaaba2d3e9b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:59.126361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381b3b3-3377-48fd-a27c-dbaaba2d3e9b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:59.170922 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41bd89-b7cd-4827-ac78-b395565a2359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:59.171739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41bd89-b7cd-4827-ac78-b395565a2359 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:59.172806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41bd89-b7cd-4827-ac78-b395565a2359 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:59.173405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41bd89-b7cd-4827-ac78-b395565a2359 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:59.195277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41bd89-b7cd-4827-ac78-b395565a2359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-ab41bd89-b7cd-4827-ac78-b395565a2359 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:11:59.203316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:59.204769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:59.206970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:59.206970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:59.206970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:59.206970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:59.206970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:11:59.206970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:11:59.206970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:11:59.206970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:11:59.206970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:11:59.206970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:11:59.206970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:11:59.206970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:11:59.206970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 13/24] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:11:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:59.212623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63df092-03c8-466d-b25f-cee71efe311b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:59.260598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f1c52-b52b-4886-a647-e31b001cf462 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:59.261166 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f1c52-b52b-4886-a647-e31b001cf462 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:59.261626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f1c52-b52b-4886-a647-e31b001cf462 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:59.263281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 14/25] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:11:59.268390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febb9d8-47cf-4194-a451-8edbf9f56cdb None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:59.268888 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febb9d8-47cf-4194-a451-8edbf9f56cdb None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:59.269370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febb9d8-47cf-4194-a451-8edbf9f56cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:59.303378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-2febb9d8-47cf-4194-a451-8edbf9f56cdb None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:59.304912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2febb9d8-47cf-4194-a451-8edbf9f56cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:59.325306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63df092-03c8-466d-b25f-cee71efe311b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:59.363461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c1060-5782-4a24-b52d-20bef8456b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:59.364411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c1060-5782-4a24-b52d-20bef8456b14 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:59.364956 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c1060-5782-4a24-b52d-20bef8456b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:59.365368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c1060-5782-4a24-b52d-20bef8456b14 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:59.366603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c1060-5782-4a24-b52d-20bef8456b14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:11:59.367066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c1060-5782-4a24-b52d-20bef8456b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:59.369025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c1060-5782-4a24-b52d-20bef8456b14 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:59.382149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 12/26] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:59.387195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c1060-5782-4a24-b52d-20bef8456b14 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:59.425128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 15/27] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:11:59.426667 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8c3fe-ee40-44d5-bfa9-16419998570f None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:59.427031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8c3fe-ee40-44d5-bfa9-16419998570f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:59.427362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8c3fe-ee40-44d5-bfa9-16419998570f None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:59.429044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 16/28] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:59.434268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c12820-23a7-45fc-9917-bdaa9e141c7f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:59.434660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c12820-23a7-45fc-9917-bdaa9e141c7f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:59.435021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c12820-23a7-45fc-9917-bdaa9e141c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:59.464929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e6c12820-23a7-45fc-9917-bdaa9e141c7f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:11:59.466553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e6c12820-23a7-45fc-9917-bdaa9e141c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:11:59.506131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c1060-5782-4a24-b52d-20bef8456b14 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:59.541676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9b545-9d68-400e-93d5-d87ca43b4ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:59.542908 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b545-9d68-400e-93d5-d87ca43b4ecc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:59.543363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b545-9d68-400e-93d5-d87ca43b4ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:59.543807 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b545-9d68-400e-93d5-d87ca43b4ecc None admin] PATH_INFO: `/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:59.545539 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9b545-9d68-400e-93d5-d87ca43b4ecc None admin] RBAC: Authorizing `identity:get_user(user_id=faf5764aa68b4dd0a7861a70d6db3d3d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:59.547234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9b545-9d68-400e-93d5-d87ca43b4ecc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:59.549462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 13/29] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:11:59 2022] GET /identity/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:59.550424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9b545-9d68-400e-93d5-d87ca43b4ecc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:59.641616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 17/30] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:11:59.642995 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c12820-23a7-45fc-9917-bdaa9e141c7f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:59.652297 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9b545-9d68-400e-93d5-d87ca43b4ecc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:59.687723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ff997-c71f-43ca-a22f-1825641cad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:59.688799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ff997-c71f-43ca-a22f-1825641cad1a None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:59.689299 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ff997-c71f-43ca-a22f-1825641cad1a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:59.689712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ff997-c71f-43ca-a22f-1825641cad1a None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:59.690624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ff997-c71f-43ca-a22f-1825641cad1a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:59.692207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ff997-c71f-43ca-a22f-1825641cad1a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:59.750228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c12820-23a7-45fc-9917-bdaa9e141c7f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:59.790073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c793e-8158-4c1f-b530-c5acfb8989fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:59.791252 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c793e-8158-4c1f-b530-c5acfb8989fe None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:59.791630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c793e-8158-4c1f-b530-c5acfb8989fe None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:59.791986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c793e-8158-4c1f-b530-c5acfb8989fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:59.793251 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c793e-8158-4c1f-b530-c5acfb8989fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:59.794814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c793e-8158-4c1f-b530-c5acfb8989fe None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:59.797026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 18/31] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:11:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:11:59.797973 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c793e-8158-4c1f-b530-c5acfb8989fe None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:59.881929 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 14/32] 10.222.0.44 () {60 vars in 1131 bytes} [Thu May 5 15:11:59 2022] POST /identity/v3/roles => generated 219 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:11:59.884109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62456-2d12-4810-b834-e80ffd2c136e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:59.884590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62456-2d12-4810-b834-e80ffd2c136e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:59.885043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62456-2d12-4810-b834-e80ffd2c136e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:59.887027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 15/33] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:11:59.888098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a62456-2d12-4810-b834-e80ffd2c136e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:11:59.900197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c793e-8158-4c1f-b530-c5acfb8989fe None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:11:59.936775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0da1d0-7d4e-45e5-9570-eaaee169f151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:11:59.938400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0da1d0-7d4e-45e5-9570-eaaee169f151 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:59.938953 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0da1d0-7d4e-45e5-9570-eaaee169f151 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:59.939434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0da1d0-7d4e-45e5-9570-eaaee169f151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:11:59.951415 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0da1d0-7d4e-45e5-9570-eaaee169f151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:11:59.954220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0da1d0-7d4e-45e5-9570-eaaee169f151 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-6c0da1d0-7d4e-45e5-9570-eaaee169f151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:11:59.974987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:11:59.975862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:11:59.976660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:11:59.976660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:11:59.976660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:11:59.976660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:11:59.978999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 19/34] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:11:59.980474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a3bf3-bca3-4b62-b010-aeab5697fff5 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:11:59.980958 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a3bf3-bca3-4b62-b010-aeab5697fff5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:11:59.981463 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a3bf3-bca3-4b62-b010-aeab5697fff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:00.001051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-3f3a3bf3-bca3-4b62-b010-aeab5697fff5 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:00.002783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-3f3a3bf3-bca3-4b62-b010-aeab5697fff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:00.003130 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a62456-2d12-4810-b834-e80ffd2c136e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:00.041783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35c224-9ffb-4e52-80bf-f20ddfa30615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:00.042979 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35c224-9ffb-4e52-80bf-f20ddfa30615 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:00.043403 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35c224-9ffb-4e52-80bf-f20ddfa30615 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:00.043826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35c224-9ffb-4e52-80bf-f20ddfa30615 None admin] PATH_INFO: `/v3/domains/default/users/faf5764aa68b4dd0a7861a70d6db3d3d/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:00.046477 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35c224-9ffb-4e52-80bf-f20ddfa30615 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=faf5764aa68b4dd0a7861a70d6db3d3d, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:00.049193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35c224-9ffb-4e52-80bf-f20ddfa30615 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:00.084289 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 20/35] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:00.085337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a3bf3-bca3-4b62-b010-aeab5697fff5 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:00.148598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 16/36] 10.222.0.44 () {58 vars in 1361 bytes} [Thu May 5 15:11:59 2022] PUT /identity/v3/domains/default/users/faf5764aa68b4dd0a7861a70d6db3d3d/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:00.149786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35c224-9ffb-4e52-80bf-f20ddfa30615 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:00.204382 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a3bf3-bca3-4b62-b010-aeab5697fff5 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:00.266827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bba87d-f44a-47a6-a794-96c6b9d0aae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:00.268614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bba87d-f44a-47a6-a794-96c6b9d0aae0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:00.269097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bba87d-f44a-47a6-a794-96c6b9d0aae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:00.269773 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bba87d-f44a-47a6-a794-96c6b9d0aae0 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:00.272328 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bba87d-f44a-47a6-a794-96c6b9d0aae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:00.272866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bba87d-f44a-47a6-a794-96c6b9d0aae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:00.274965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bba87d-f44a-47a6-a794-96c6b9d0aae0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:00.312576 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 21/37] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:00.318666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35c224-9ffb-4e52-80bf-f20ddfa30615 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:00.319947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bba87d-f44a-47a6-a794-96c6b9d0aae0 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:00.392226 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9360a20-7a28-4cfc-b30d-cbd8442425ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:00.392931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9360a20-7a28-4cfc-b30d-cbd8442425ea None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:00.393221 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9360a20-7a28-4cfc-b30d-cbd8442425ea None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:00.393505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9360a20-7a28-4cfc-b30d-cbd8442425ea None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:00.394298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9360a20-7a28-4cfc-b30d-cbd8442425ea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:00.395739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9360a20-7a28-4cfc-b30d-cbd8442425ea None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:00.437474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bba87d-f44a-47a6-a794-96c6b9d0aae0 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:00.478484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 17/38] 10.222.0.44 () {60 vars in 1131 bytes} [Thu May 5 15:12:00 2022] POST /identity/v3/roles => generated 225 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:00.486601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc399c-06a2-4f32-8319-bde0f444ae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:00.487823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc399c-06a2-4f32-8319-bde0f444ae60 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:00.488307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc399c-06a2-4f32-8319-bde0f444ae60 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:00.488777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc399c-06a2-4f32-8319-bde0f444ae60 None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:00.489752 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc399c-06a2-4f32-8319-bde0f444ae60 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:00.491712 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc399c-06a2-4f32-8319-bde0f444ae60 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:00.707809 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 22/39] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:12:00 2022] POST /identity/v3/projects => generated 301 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:00.971143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fa979-2cfa-4732-b3ec-91ef976a3126 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:00.972082 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fa979-2cfa-4732-b3ec-91ef976a3126 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:00.972577 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fa979-2cfa-4732-b3ec-91ef976a3126 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:00.974467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 18/40] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:00.979729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bb333-866d-452b-a2a6-31bca4634b50 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:00.980535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bb333-866d-452b-a2a6-31bca4634b50 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:00.981012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bb333-866d-452b-a2a6-31bca4634b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:00.999817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-340bb333-866d-452b-a2a6-31bca4634b50 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:01.002224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-340bb333-866d-452b-a2a6-31bca4634b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:01.055185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd48e3-ff95-42fa-8e80-bef6ca1b1759 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:01.055696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd48e3-ff95-42fa-8e80-bef6ca1b1759 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:01.055984 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd48e3-ff95-42fa-8e80-bef6ca1b1759 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:01.057340 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 19/41] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:01.063193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9782707-bb42-4752-a681-3eb199f3155f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:01.063382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9782707-bb42-4752-a681-3eb199f3155f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:01.063682 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9782707-bb42-4752-a681-3eb199f3155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:01.070837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 23/42] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:01.080323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f9782707-bb42-4752-a681-3eb199f3155f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:01.081930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f9782707-bb42-4752-a681-3eb199f3155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:01.094796 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bb333-866d-452b-a2a6-31bca4634b50 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:01.149439 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 20/43] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:01.173204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9782707-bb42-4752-a681-3eb199f3155f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:01.198514 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bb333-866d-452b-a2a6-31bca4634b50 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:01.234014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceeb8c-8f89-4e91-9ce7-977419d31726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:01.235413 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceeb8c-8f89-4e91-9ce7-977419d31726 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:01.235706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceeb8c-8f89-4e91-9ce7-977419d31726 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:01.235989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceeb8c-8f89-4e91-9ce7-977419d31726 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:01.236752 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceeb8c-8f89-4e91-9ce7-977419d31726 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:01.238274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceeb8c-8f89-4e91-9ce7-977419d31726 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:01.273751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9782707-bb42-4752-a681-3eb199f3155f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:01.305679 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 24/44] 10.222.0.44 () {60 vars in 1131 bytes} [Thu May 5 15:12:01 2022] POST /identity/v3/roles => generated 223 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:01.311056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7412b-4239-4cd7-8acf-33a582b160fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:01.311888 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7412b-4239-4cd7-8acf-33a582b160fc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:01.312173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7412b-4239-4cd7-8acf-33a582b160fc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:01.312515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7412b-4239-4cd7-8acf-33a582b160fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:01.314002 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7412b-4239-4cd7-8acf-33a582b160fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:01.315550 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7412b-4239-4cd7-8acf-33a582b160fc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:01.317460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 21/45] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:12:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:01.323119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceeb8c-8f89-4e91-9ce7-977419d31726 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:01.430355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceeb8c-8f89-4e91-9ce7-977419d31726 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:01.465444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbe787-326f-4d14-9a3e-4a1e8ffb4c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:01.466396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbe787-326f-4d14-9a3e-4a1e8ffb4c44 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:01.466845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbe787-326f-4d14-9a3e-4a1e8ffb4c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:01.467275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbe787-326f-4d14-9a3e-4a1e8ffb4c44 None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:01.468157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbe787-326f-4d14-9a3e-4a1e8ffb4c44 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:01.470342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbe787-326f-4d14-9a3e-4a1e8ffb4c44 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:01.563467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 25/46] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:12:01 2022] POST /identity/v3/projects => generated 312 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:02.681465 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89cbd0-b6d6-44ba-b76c-d1bc9667d7a1 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:02.682109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89cbd0-b6d6-44ba-b76c-d1bc9667d7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:02.682109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89cbd0-b6d6-44ba-b76c-d1bc9667d7a1 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:02.683663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 22/47] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:02.689397 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73ad11-2dcf-4d14-825f-72f7f997964f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:02.689912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73ad11-2dcf-4d14-825f-72f7f997964f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:02.690028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73ad11-2dcf-4d14-825f-72f7f997964f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:02.706947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6e73ad11-2dcf-4d14-825f-72f7f997964f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:02.708157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6e73ad11-2dcf-4d14-825f-72f7f997964f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:02.772675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 26/48] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:02.795232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89cbd0-b6d6-44ba-b76c-d1bc9667d7a1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:02.890352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89cbd0-b6d6-44ba-b76c-d1bc9667d7a1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:02.922781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379896ba-61be-4928-8832-22940130ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:02.923580 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379896ba-61be-4928-8832-22940130ad43 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:02.923862 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379896ba-61be-4928-8832-22940130ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:02.924134 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379896ba-61be-4928-8832-22940130ad43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:02.935166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379896ba-61be-4928-8832-22940130ad43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-379896ba-61be-4928-8832-22940130ad43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:02.944316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:02.945192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:02.945935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:02.945935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:02.945935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:02.945935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:02.945935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:02.945935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:02.945935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:02.945935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:02.945935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:02.945935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:02.945935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:02.945935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:02.945935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 23/49] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:12:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:02.951217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73ad11-2dcf-4d14-825f-72f7f997964f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:03.046558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73ad11-2dcf-4d14-825f-72f7f997964f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:03.079792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3a28a-b15b-412b-b6aa-b7a4df8c5e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:03.080488 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3a28a-b15b-412b-b6aa-b7a4df8c5e7b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:03.080775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3a28a-b15b-412b-b6aa-b7a4df8c5e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:03.081055 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3a28a-b15b-412b-b6aa-b7a4df8c5e7b None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:03.081820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3a28a-b15b-412b-b6aa-b7a4df8c5e7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:03.082130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3a28a-b15b-412b-b6aa-b7a4df8c5e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:03.083555 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3a28a-b15b-412b-b6aa-b7a4df8c5e7b None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:03.091580 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 27/50] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:03.097070 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379896ba-61be-4928-8832-22940130ad43 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:03.193391 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379896ba-61be-4928-8832-22940130ad43 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:03.227370 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c53eef-77b0-4f34-80e4-989ec36b05f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:03.228249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c53eef-77b0-4f34-80e4-989ec36b05f4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:03.228538 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c53eef-77b0-4f34-80e4-989ec36b05f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:03.228820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c53eef-77b0-4f34-80e4-989ec36b05f4 None admin] PATH_INFO: `/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:03.229997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c53eef-77b0-4f34-80e4-989ec36b05f4 None admin] RBAC: Authorizing `identity:get_user(user_id=faf5764aa68b4dd0a7861a70d6db3d3d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:03.231495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c53eef-77b0-4f34-80e4-989ec36b05f4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:03.233127 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 24/51] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:03 2022] GET /identity/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:03.239331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3a28a-b15b-412b-b6aa-b7a4df8c5e7b None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:03.335791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3a28a-b15b-412b-b6aa-b7a4df8c5e7b None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:03.368311 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bf9fd-fdd9-4bf9-8467-60cdbbf65f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:03.369144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bf9fd-fdd9-4bf9-8467-60cdbbf65f74 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:03.369433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bf9fd-fdd9-4bf9-8467-60cdbbf65f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:03.369716 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bf9fd-fdd9-4bf9-8467-60cdbbf65f74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:03.370948 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bf9fd-fdd9-4bf9-8467-60cdbbf65f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:03.372398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bf9fd-fdd9-4bf9-8467-60cdbbf65f74 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:03.374017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 28/52] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:12:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:03.380525 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c53eef-77b0-4f34-80e4-989ec36b05f4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:03.477026 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c53eef-77b0-4f34-80e4-989ec36b05f4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:03.508839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d513e03-75c4-4c9e-9a17-ef8e35d9c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:03.509496 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d513e03-75c4-4c9e-9a17-ef8e35d9c6db None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:03.509786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d513e03-75c4-4c9e-9a17-ef8e35d9c6db None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:03.510070 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d513e03-75c4-4c9e-9a17-ef8e35d9c6db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:03.510942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d513e03-75c4-4c9e-9a17-ef8e35d9c6db None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.domain.id=default, user.id=faf5764aa68b4dd0a7861a70d6db3d3d) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:03.511262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d513e03-75c4-4c9e-9a17-ef8e35d9c6db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:03.512717 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d513e03-75c4-4c9e-9a17-ef8e35d9c6db None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:03.521049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 25/53] 10.222.0.44 () {56 vars in 1322 bytes} [Thu May 5 15:12:03 2022] GET /identity/v3/role_assignments?user.id=faf5764aa68b4dd0a7861a70d6db3d3d&scope.domain.id=default&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:03.834304 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bf397-6b2b-4530-91e5-86c91423c0b3 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:03.834832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bf397-6b2b-4530-91e5-86c91423c0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:03.834921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bf397-6b2b-4530-91e5-86c91423c0b3 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:03.836228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 29/54] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:03.841438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78ef10-94ae-4a42-9dd5-6f6973016118 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:03.841803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78ef10-94ae-4a42-9dd5-6f6973016118 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:03.842019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78ef10-94ae-4a42-9dd5-6f6973016118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:03.859309 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8a78ef10-94ae-4a42-9dd5-6f6973016118 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:03.860982 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8a78ef10-94ae-4a42-9dd5-6f6973016118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:03.945883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 26/55] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:03.969706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bf397-6b2b-4530-91e5-86c91423c0b3 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:04.065011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bf397-6b2b-4530-91e5-86c91423c0b3 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:04.096992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a0334-3feb-49fb-b650-095aba51391f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:04.097784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a0334-3feb-49fb-b650-095aba51391f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:04.098072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a0334-3feb-49fb-b650-095aba51391f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:04.098379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a0334-3feb-49fb-b650-095aba51391f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:04.099540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a0334-3feb-49fb-b650-095aba51391f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:04.100994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a0334-3feb-49fb-b650-095aba51391f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:04.102608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 30/56] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:12:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:04.108221 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78ef10-94ae-4a42-9dd5-6f6973016118 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:04.200701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78ef10-94ae-4a42-9dd5-6f6973016118 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:04.232652 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a43f89-0783-4c97-bd4d-57e3c653eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:04.233303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a43f89-0783-4c97-bd4d-57e3c653eece None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:04.233586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a43f89-0783-4c97-bd4d-57e3c653eece None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:04.233865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a43f89-0783-4c97-bd4d-57e3c653eece None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:04.235333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a43f89-0783-4c97-bd4d-57e3c653eece None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:04.236787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a43f89-0783-4c97-bd4d-57e3c653eece None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:04.321326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 27/57] 10.222.0.44 () {60 vars in 1140 bytes} [Thu May 5 15:12:04 2022] POST /identity/v3/projects => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:06.562945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f099af-1cca-4785-8102-50bfe5c187c8 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:06.563461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f099af-1cca-4785-8102-50bfe5c187c8 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:06.563576 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f099af-1cca-4785-8102-50bfe5c187c8 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:06.564860 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 31/58] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:06.570048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5e60f-225f-45ee-af9e-b253134a960d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:06.570474 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5e60f-225f-45ee-af9e-b253134a960d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:06.570664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5e60f-225f-45ee-af9e-b253134a960d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:06.587533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-01b5e60f-225f-45ee-af9e-b253134a960d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:06.588720 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-01b5e60f-225f-45ee-af9e-b253134a960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:06.652036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 28/59] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:06.676894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f099af-1cca-4785-8102-50bfe5c187c8 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:06.773119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f099af-1cca-4785-8102-50bfe5c187c8 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:06.806652 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b8b84-0cd6-42bf-9d6b-adcadd3dd05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:06.807435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b8b84-0cd6-42bf-9d6b-adcadd3dd05a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:06.807715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b8b84-0cd6-42bf-9d6b-adcadd3dd05a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:06.807987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b8b84-0cd6-42bf-9d6b-adcadd3dd05a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:06.809139 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b8b84-0cd6-42bf-9d6b-adcadd3dd05a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:06.810612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b8b84-0cd6-42bf-9d6b-adcadd3dd05a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:06.812204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 32/60] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:12:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:06.818720 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5e60f-225f-45ee-af9e-b253134a960d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:06.913173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5e60f-225f-45ee-af9e-b253134a960d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:06.945589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2288709-2e51-4a2e-8ed4-1d18bb6ad545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:06.946251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2288709-2e51-4a2e-8ed4-1d18bb6ad545 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:06.946569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2288709-2e51-4a2e-8ed4-1d18bb6ad545 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:06.946849 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2288709-2e51-4a2e-8ed4-1d18bb6ad545 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:06.947551 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2288709-2e51-4a2e-8ed4-1d18bb6ad545 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:06.949006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2288709-2e51-4a2e-8ed4-1d18bb6ad545 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:07.046034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 29/61] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:12:06 2022] POST /identity/v3/users => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:10.704154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578496d-95ae-417c-b640-35c6851b218a None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:10.704695 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578496d-95ae-417c-b640-35c6851b218a None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:10.704959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578496d-95ae-417c-b640-35c6851b218a None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:10.706797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 33/62] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:10.712236 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de509-feba-41a0-bccd-bb34c725b924 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:10.712630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de509-feba-41a0-bccd-bb34c725b924 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:10.718326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de509-feba-41a0-bccd-bb34c725b924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:10.735624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d43de509-feba-41a0-bccd-bb34c725b924 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:10.736848 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d43de509-feba-41a0-bccd-bb34c725b924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:10.790618 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75131a-0d94-48f3-bb29-9cd79188aae5 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:10.791280 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75131a-0d94-48f3-bb29-9cd79188aae5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:10.791763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75131a-0d94-48f3-bb29-9cd79188aae5 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:10.793395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 34/63] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:10.800350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880496f8-edb2-407e-8245-542d98bf09f2 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:10.800350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880496f8-edb2-407e-8245-542d98bf09f2 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:10.801133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880496f8-edb2-407e-8245-542d98bf09f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:10.831938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 30/64] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:10.832120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-880496f8-edb2-407e-8245-542d98bf09f2 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:10.833415 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-880496f8-edb2-407e-8245-542d98bf09f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:10.855178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43de509-feba-41a0-bccd-bb34c725b924 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:10.969763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 35/65] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:10.986437 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43de509-feba-41a0-bccd-bb34c725b924 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:10.997410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42c4c9-2b6b-4d98-a985-b679b7064134 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:10.998028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42c4c9-2b6b-4d98-a985-b679b7064134 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:10.998568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42c4c9-2b6b-4d98-a985-b679b7064134 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.000967 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 36/66] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:11.006715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6472d-cb75-4cd0-b1c9-6712dfcca7ae None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.007264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6472d-cb75-4cd0-b1c9-6712dfcca7ae None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.007741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6472d-cb75-4cd0-b1c9-6712dfcca7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.028427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-67d6472d-cb75-4cd0-b1c9-6712dfcca7ae None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:11.030019 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-67d6472d-cb75-4cd0-b1c9-6712dfcca7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:11.038385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5718112-dcc2-420c-b87a-fe7caed080a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:11.038385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5718112-dcc2-420c-b87a-fe7caed080a8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.038385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5718112-dcc2-420c-b87a-fe7caed080a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.038385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5718112-dcc2-420c-b87a-fe7caed080a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.049884 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5718112-dcc2-420c-b87a-fe7caed080a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f5718112-dcc2-420c-b87a-fe7caed080a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:11.059800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:11.060863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:11.061782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:11.061782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:11.061782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:11.061782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:11.061782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:11.061782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:11.061782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:11.061782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:11.061782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:11.061782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:11.061782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:11.061782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:11.061782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 31/67] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:12:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:12:11.063081 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5718112-dcc2-420c-b87a-fe7caed080a8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:11.110032 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 37/68] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:11.118403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773ede4-3cf8-4ddc-9631-a9323f587fb1 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.118403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773ede4-3cf8-4ddc-9631-a9323f587fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.118403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773ede4-3cf8-4ddc-9631-a9323f587fb1 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.118403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 38/69] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:11.118403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773ede4-3cf8-4ddc-9631-a9323f587fb1 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:11.166489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5718112-dcc2-420c-b87a-fe7caed080a8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:11.198340 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc20d29-23fb-4363-85bb-be9f8d922296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:11.199133 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc20d29-23fb-4363-85bb-be9f8d922296 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.199418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc20d29-23fb-4363-85bb-be9f8d922296 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.199695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc20d29-23fb-4363-85bb-be9f8d922296 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.209390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc20d29-23fb-4363-85bb-be9f8d922296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-7cc20d29-23fb-4363-85bb-be9f8d922296 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:11.217017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:11.218058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:11.219416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:11.219416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:11.219416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:11.219416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:11.219416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:11.219416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:11.219416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:11.219416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:11.219416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:11.219416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:11.219416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:11.219416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:11.219416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 32/70] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:11.220232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e0fa6-c444-4930-88a0-e1319ac6c168 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.220516 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e0fa6-c444-4930-88a0-e1319ac6c168 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.220738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e0fa6-c444-4930-88a0-e1319ac6c168 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.221624 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773ede4-3cf8-4ddc-9631-a9323f587fb1 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:11.225776 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 33/71] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:11.225776 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf8c85-937e-46b1-b36a-5bd4d9ef16bd None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.225776 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf8c85-937e-46b1-b36a-5bd4d9ef16bd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.225776 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf8c85-937e-46b1-b36a-5bd4d9ef16bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.240673 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-43cf8c85-937e-46b1-b36a-5bd4d9ef16bd None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:11.241845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-43cf8c85-937e-46b1-b36a-5bd4d9ef16bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:11.258921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb08e03-ad12-45ca-870f-f33e4ae21537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:11.259600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb08e03-ad12-45ca-870f-f33e4ae21537 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.259886 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb08e03-ad12-45ca-870f-f33e4ae21537 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.260169 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb08e03-ad12-45ca-870f-f33e4ae21537 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.260922 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb08e03-ad12-45ca-870f-f33e4ae21537 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:11.261233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb08e03-ad12-45ca-870f-f33e4ae21537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:11.262638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb08e03-ad12-45ca-870f-f33e4ae21537 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:11.270693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 39/72] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:11.271480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb08e03-ad12-45ca-870f-f33e4ae21537 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:11.311424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 34/73] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:11.326461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf8c85-937e-46b1-b36a-5bd4d9ef16bd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:11.383236 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb08e03-ad12-45ca-870f-f33e4ae21537 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:11.407741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf8c85-937e-46b1-b36a-5bd4d9ef16bd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:11.415191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07cbc6-7eee-418d-b85e-d629a7aa9f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:11.415991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07cbc6-7eee-418d-b85e-d629a7aa9f5e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.416279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07cbc6-7eee-418d-b85e-d629a7aa9f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.416563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07cbc6-7eee-418d-b85e-d629a7aa9f5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.417750 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07cbc6-7eee-418d-b85e-d629a7aa9f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:11.419251 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07cbc6-7eee-418d-b85e-d629a7aa9f5e None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:11.421038 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 40/74] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:12:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:11.422651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d227a-bf06-4da7-b232-4820d682356f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.422945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d227a-bf06-4da7-b232-4820d682356f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.423231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d227a-bf06-4da7-b232-4820d682356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.439088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e92d227a-bf06-4da7-b232-4820d682356f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:11.440284 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e92d227a-bf06-4da7-b232-4820d682356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:11.441634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a7c56-7ee8-4eba-8b96-2ec08cd86b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:11.442333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a7c56-7ee8-4eba-8b96-2ec08cd86b02 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.442623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a7c56-7ee8-4eba-8b96-2ec08cd86b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.442910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a7c56-7ee8-4eba-8b96-2ec08cd86b02 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.443651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a7c56-7ee8-4eba-8b96-2ec08cd86b02 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:11.443960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a7c56-7ee8-4eba-8b96-2ec08cd86b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:11.445352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a7c56-7ee8-4eba-8b96-2ec08cd86b02 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:11.458554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 35/75] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:11.458554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a7c56-7ee8-4eba-8b96-2ec08cd86b02 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:11.505017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 41/76] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:11.506866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d227a-bf06-4da7-b232-4820d682356f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:11.553430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a7c56-7ee8-4eba-8b96-2ec08cd86b02 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:11.586216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d1a2-7a91-4ea4-b406-0acb614b67ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:11.587121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d1a2-7a91-4ea4-b406-0acb614b67ab None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.587410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d1a2-7a91-4ea4-b406-0acb614b67ab None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.587684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d1a2-7a91-4ea4-b406-0acb614b67ab None admin] PATH_INFO: `/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.588883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56d1a2-7a91-4ea4-b406-0acb614b67ab None admin] RBAC: Authorizing `identity:get_user(user_id=faf5764aa68b4dd0a7861a70d6db3d3d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:11.590371 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56d1a2-7a91-4ea4-b406-0acb614b67ab None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:11.592007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 36/77] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:11 2022] GET /identity/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:11.592751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d1a2-7a91-4ea4-b406-0acb614b67ab None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:11.602393 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d227a-bf06-4da7-b232-4820d682356f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:11.635921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3928f-08a8-4b2c-bce6-a19040381869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:11.636714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3928f-08a8-4b2c-bce6-a19040381869 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.637002 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3928f-08a8-4b2c-bce6-a19040381869 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.637306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3928f-08a8-4b2c-bce6-a19040381869 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.647177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3928f-08a8-4b2c-bce6-a19040381869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-b3a3928f-08a8-4b2c-bce6-a19040381869 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:11.654878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:11.655707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:11.656571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:11.656571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:11.656571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:11.656571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:11.656571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:11.656571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:11.656571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:11.656571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:11.656571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:11.656571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:11.656571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:11.656571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:11.656571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 42/78] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:11.657262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3928f-08a8-4b2c-bce6-a19040381869 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:11.694559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d1a2-7a91-4ea4-b406-0acb614b67ab None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:11.726408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50ee07-4b7d-4e91-bd81-99fa49ac1295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:11.727066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50ee07-4b7d-4e91-bd81-99fa49ac1295 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.727351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50ee07-4b7d-4e91-bd81-99fa49ac1295 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.727631 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50ee07-4b7d-4e91-bd81-99fa49ac1295 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.728336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50ee07-4b7d-4e91-bd81-99fa49ac1295 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:11.729791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50ee07-4b7d-4e91-bd81-99fa49ac1295 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:11.754665 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3928f-08a8-4b2c-bce6-a19040381869 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:11.788030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abc442-e759-4b61-8730-83c330f73a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:11.788904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abc442-e759-4b61-8730-83c330f73a78 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.789189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abc442-e759-4b61-8730-83c330f73a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.789495 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abc442-e759-4b61-8730-83c330f73a78 None admin] PATH_INFO: `/v3/users/1e88330c8d8b49a79c15d2a198869b44` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.802656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abc442-e759-4b61-8730-83c330f73a78 None admin] RBAC: Authorizing `identity:get_user(user_id=1e88330c8d8b49a79c15d2a198869b44)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:11.804112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abc442-e759-4b61-8730-83c330f73a78 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:11.805727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 43/79] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:11 2022] GET /identity/v3/users/1e88330c8d8b49a79c15d2a198869b44 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:11.806515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abc442-e759-4b61-8730-83c330f73a78 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:11.818024 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 37/80] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:12:11 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:11.819104 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50ee07-4b7d-4e91-bd81-99fa49ac1295 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:11.919603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abc442-e759-4b61-8730-83c330f73a78 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:11.931566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50ee07-4b7d-4e91-bd81-99fa49ac1295 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:11.956286 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d904-84f0-413e-b934-64b87bc702b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:11.957568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d904-84f0-413e-b934-64b87bc702b2 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.958099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d904-84f0-413e-b934-64b87bc702b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.958611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d904-84f0-413e-b934-64b87bc702b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.966881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666cbc-4565-4464-af6a-25ea518e513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:11.967555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666cbc-4565-4464-af6a-25ea518e513f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:11.967842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666cbc-4565-4464-af6a-25ea518e513f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:11.968122 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666cbc-4565-4464-af6a-25ea518e513f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:11.972189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d904-84f0-413e-b934-64b87bc702b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-5547d904-84f0-413e-b934-64b87bc702b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:11.980813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:11.981731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:11.982799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:11.982799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:11.982799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:11.982799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:11.982799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:11.982799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:11.982799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:11.982799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:11.982799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:11.982799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:11.982799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:11.982799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:11.985451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 44/81] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:12:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:11.986486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d904-84f0-413e-b934-64b87bc702b2 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.039847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666cbc-4565-4464-af6a-25ea518e513f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:12.041257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666cbc-4565-4464-af6a-25ea518e513f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:12.108610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d904-84f0-413e-b934-64b87bc702b2 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.153679 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f83943-5c98-4e64-9f44-0de98cb950df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.157879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f83943-5c98-4e64-9f44-0de98cb950df None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.157879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f83943-5c98-4e64-9f44-0de98cb950df None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.157879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f83943-5c98-4e64-9f44-0de98cb950df None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:12.157879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f83943-5c98-4e64-9f44-0de98cb950df None admin] RBAC: Adding query filter params (name=member) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:12.158251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 38/82] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:12.158356 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f83943-5c98-4e64-9f44-0de98cb950df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:12.158424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666cbc-4565-4464-af6a-25ea518e513f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.158487 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f83943-5c98-4e64-9f44-0de98cb950df None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:12.167392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 45/83] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:12.168069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f83943-5c98-4e64-9f44-0de98cb950df None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.264666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666cbc-4565-4464-af6a-25ea518e513f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.282170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f83943-5c98-4e64-9f44-0de98cb950df None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.311183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2be85-c92c-4e51-9de9-3d8f51514c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.311900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2be85-c92c-4e51-9de9-3d8f51514c15 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.312279 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2be85-c92c-4e51-9de9-3d8f51514c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.313462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2be85-c92c-4e51-9de9-3d8f51514c15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:12.320302 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069c0c6-01c3-4b6a-8582-40b4beb83c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.321122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c0c6-01c3-4b6a-8582-40b4beb83c4b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.321478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c0c6-01c3-4b6a-8582-40b4beb83c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.321874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c0c6-01c3-4b6a-8582-40b4beb83c4b None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:12.322805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069c0c6-01c3-4b6a-8582-40b4beb83c4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:12.323184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069c0c6-01c3-4b6a-8582-40b4beb83c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:12.324651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069c0c6-01c3-4b6a-8582-40b4beb83c4b None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:12.333741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 46/84] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:12.334543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069c0c6-01c3-4b6a-8582-40b4beb83c4b None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.396559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2be85-c92c-4e51-9de9-3d8f51514c15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:12.398045 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2be85-c92c-4e51-9de9-3d8f51514c15 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:12.442486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069c0c6-01c3-4b6a-8582-40b4beb83c4b None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.475942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2eb6bc-d19f-4df9-af2b-d5ec3090f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.477104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb6bc-d19f-4df9-af2b-d5ec3090f8ea None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.477761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb6bc-d19f-4df9-af2b-d5ec3090f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.478102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb6bc-d19f-4df9-af2b-d5ec3090f8ea None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:12.479609 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2eb6bc-d19f-4df9-af2b-d5ec3090f8ea None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:12.481503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2eb6bc-d19f-4df9-af2b-d5ec3090f8ea None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:12.483841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 47/85] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:12.485401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2eb6bc-d19f-4df9-af2b-d5ec3090f8ea None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.503362 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 39/86] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:12.504444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2be85-c92c-4e51-9de9-3d8f51514c15 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.585118 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2eb6bc-d19f-4df9-af2b-d5ec3090f8ea None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.622182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2be85-c92c-4e51-9de9-3d8f51514c15 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.628338 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921718c6-2647-4269-88ab-b0f736d63d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.631811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921718c6-2647-4269-88ab-b0f736d63d1c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.631811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921718c6-2647-4269-88ab-b0f736d63d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.631811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921718c6-2647-4269-88ab-b0f736d63d1c None admin] PATH_INFO: `/v3/users/1e88330c8d8b49a79c15d2a198869b44` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:12.631811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921718c6-2647-4269-88ab-b0f736d63d1c None admin] RBAC: Authorizing `identity:get_user(user_id=1e88330c8d8b49a79c15d2a198869b44)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:12.633373 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921718c6-2647-4269-88ab-b0f736d63d1c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:12.636027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 48/87] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/users/1e88330c8d8b49a79c15d2a198869b44 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:12.636983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921718c6-2647-4269-88ab-b0f736d63d1c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.661698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825458e-434f-4191-9439-14a5cd04400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.662802 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825458e-434f-4191-9439-14a5cd04400f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.663202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825458e-434f-4191-9439-14a5cd04400f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.670048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825458e-434f-4191-9439-14a5cd04400f None admin] PATH_INFO: `/v3/users/1e88330c8d8b49a79c15d2a198869b44` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:12.670048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825458e-434f-4191-9439-14a5cd04400f None admin] RBAC: Authorizing `identity:get_user(user_id=1e88330c8d8b49a79c15d2a198869b44)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:12.670048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825458e-434f-4191-9439-14a5cd04400f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:12.670048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 40/88] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/users/1e88330c8d8b49a79c15d2a198869b44 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:12.670048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825458e-434f-4191-9439-14a5cd04400f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.771040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921718c6-2647-4269-88ab-b0f736d63d1c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.806970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da5115-1e5b-4eb4-982f-96ef18dd6e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.807898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5115-1e5b-4eb4-982f-96ef18dd6e27 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.808331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5115-1e5b-4eb4-982f-96ef18dd6e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.808767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5115-1e5b-4eb4-982f-96ef18dd6e27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:12.809728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da5115-1e5b-4eb4-982f-96ef18dd6e27 None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=7192d8f0799049abb47bcece952f59e6, user.id=faf5764aa68b4dd0a7861a70d6db3d3d) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:12.809840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825458e-434f-4191-9439-14a5cd04400f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.810658 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da5115-1e5b-4eb4-982f-96ef18dd6e27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:12.812548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da5115-1e5b-4eb4-982f-96ef18dd6e27 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:12.818435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 49/89] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/role_assignments?user.id=faf5764aa68b4dd0a7861a70d6db3d3d&scope.project.id=7192d8f0799049abb47bcece952f59e6&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:12.819438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da5115-1e5b-4eb4-982f-96ef18dd6e27 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.851743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14df2c-01e1-4c4f-ad42-9cdcac2f7a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.852996 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14df2c-01e1-4c4f-ad42-9cdcac2f7a40 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.853513 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14df2c-01e1-4c4f-ad42-9cdcac2f7a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.853997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14df2c-01e1-4c4f-ad42-9cdcac2f7a40 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:12.855597 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14df2c-01e1-4c4f-ad42-9cdcac2f7a40 None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:12.862328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14df2c-01e1-4c4f-ad42-9cdcac2f7a40 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:12.864752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 41/90] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:12.865891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14df2c-01e1-4c4f-ad42-9cdcac2f7a40 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:12.930215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da5115-1e5b-4eb4-982f-96ef18dd6e27 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:12.981084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dab4f5-eb6d-4401-a88a-33213eee93f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:12.981786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dab4f5-eb6d-4401-a88a-33213eee93f8 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:12.982078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dab4f5-eb6d-4401-a88a-33213eee93f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:12.982387 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dab4f5-eb6d-4401-a88a-33213eee93f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:13.037067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14df2c-01e1-4c4f-ad42-9cdcac2f7a40 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:13.100469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaae199-cc02-4d9a-ba0f-4d77793d2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:13.101128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaae199-cc02-4d9a-ba0f-4d77793d2023 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:13.101416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaae199-cc02-4d9a-ba0f-4d77793d2023 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:13.101698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaae199-cc02-4d9a-ba0f-4d77793d2023 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:13.123104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dab4f5-eb6d-4401-a88a-33213eee93f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:13.124515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dab4f5-eb6d-4401-a88a-33213eee93f8 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:13.231189 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaae199-cc02-4d9a-ba0f-4d77793d2023 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:13.232666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaae199-cc02-4d9a-ba0f-4d77793d2023 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:13.337346 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 42/91] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:13.338213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaae199-cc02-4d9a-ba0f-4d77793d2023 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:13.359368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 50/92] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:13.361637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dab4f5-eb6d-4401-a88a-33213eee93f8 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:13.441519 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaae199-cc02-4d9a-ba0f-4d77793d2023 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:13.476561 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf4fc9-2a41-410d-a27c-b35ab2190edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:13.477225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf4fc9-2a41-410d-a27c-b35ab2190edb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:13.477517 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf4fc9-2a41-410d-a27c-b35ab2190edb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:13.477801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf4fc9-2a41-410d-a27c-b35ab2190edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:13.478658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf4fc9-2a41-410d-a27c-b35ab2190edb None admin] RBAC: Adding query filter params (role.id=e2401a0c8c204431b0eff57c19186866, scope.project.id=7192d8f0799049abb47bcece952f59e6, user.id=1e88330c8d8b49a79c15d2a198869b44) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:13.478972 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf4fc9-2a41-410d-a27c-b35ab2190edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:13.480405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf4fc9-2a41-410d-a27c-b35ab2190edb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:13.486418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 43/93] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:13 2022] GET /identity/v3/role_assignments?user.id=1e88330c8d8b49a79c15d2a198869b44&scope.project.id=7192d8f0799049abb47bcece952f59e6&role.id=e2401a0c8c204431b0eff57c19186866 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:13.487213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf4fc9-2a41-410d-a27c-b35ab2190edb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:13.597932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf4fc9-2a41-410d-a27c-b35ab2190edb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:13.611987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dab4f5-eb6d-4401-a88a-33213eee93f8 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:13.639095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771d47-bf9b-46d0-9907-58d015260235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:13.653662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771d47-bf9b-46d0-9907-58d015260235 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:13.653662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771d47-bf9b-46d0-9907-58d015260235 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:13.653662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771d47-bf9b-46d0-9907-58d015260235 None admin] PATH_INFO: `/v3/projects/543d5ab4ea6240c2b0e59e8e91d6e3c1` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:13.653662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50771d47-bf9b-46d0-9907-58d015260235 None admin] RBAC: Authorizing `identity:get_project(project_id=543d5ab4ea6240c2b0e59e8e91d6e3c1)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:13.653662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50771d47-bf9b-46d0-9907-58d015260235 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:13.653662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 44/94] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:13 2022] GET /identity/v3/projects/543d5ab4ea6240c2b0e59e8e91d6e3c1 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:13.654135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771d47-bf9b-46d0-9907-58d015260235 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:13.698468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e71a0-6f27-4eb4-9138-c7a56ddf466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:13.699437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e71a0-6f27-4eb4-9138-c7a56ddf466b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:13.699761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e71a0-6f27-4eb4-9138-c7a56ddf466b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:13.700085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e71a0-6f27-4eb4-9138-c7a56ddf466b None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:13.705203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e71a0-6f27-4eb4-9138-c7a56ddf466b None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:13.706739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e71a0-6f27-4eb4-9138-c7a56ddf466b None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:13.708871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 51/95] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:13 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:13.715008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e71a0-6f27-4eb4-9138-c7a56ddf466b None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:13.794079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771d47-bf9b-46d0-9907-58d015260235 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:13.801884 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a70a36-6a37-44cf-9a22-a80e974d0d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:13.802581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a70a36-6a37-44cf-9a22-a80e974d0d5b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:13.802868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a70a36-6a37-44cf-9a22-a80e974d0d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:13.803150 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a70a36-6a37-44cf-9a22-a80e974d0d5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:13.803987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a70a36-6a37-44cf-9a22-a80e974d0d5b None admin] RBAC: Adding query filter params (role.id=e2401a0c8c204431b0eff57c19186866, scope.project.id=543d5ab4ea6240c2b0e59e8e91d6e3c1, user.id=1e88330c8d8b49a79c15d2a198869b44) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:13.804303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a70a36-6a37-44cf-9a22-a80e974d0d5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:13.805770 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a70a36-6a37-44cf-9a22-a80e974d0d5b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:13.811732 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 45/96] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:13 2022] GET /identity/v3/role_assignments?user.id=1e88330c8d8b49a79c15d2a198869b44&scope.project.id=543d5ab4ea6240c2b0e59e8e91d6e3c1&role.id=e2401a0c8c204431b0eff57c19186866 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:13.893822 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e71a0-6f27-4eb4-9138-c7a56ddf466b None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:13.937894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3f0b0-b26f-463b-977d-c3006a3dc7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:13.938671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3f0b0-b26f-463b-977d-c3006a3dc7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:13.938963 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3f0b0-b26f-463b-977d-c3006a3dc7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:13.939249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3f0b0-b26f-463b-977d-c3006a3dc7c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:13.940167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3f0b0-b26f-463b-977d-c3006a3dc7c5 None admin] RBAC: Adding query filter params (role.id=44468cf4511643498cf7830993b8c9e5, scope.project.id=7192d8f0799049abb47bcece952f59e6, user.id=1e88330c8d8b49a79c15d2a198869b44) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:13.940492 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3f0b0-b26f-463b-977d-c3006a3dc7c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:13.942052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3f0b0-b26f-463b-977d-c3006a3dc7c5 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:13.951618 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 52/97] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:13 2022] GET /identity/v3/role_assignments?user.id=1e88330c8d8b49a79c15d2a198869b44&scope.project.id=7192d8f0799049abb47bcece952f59e6&role.id=44468cf4511643498cf7830993b8c9e5 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:14.567348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864c5b3-9e7b-4952-a573-2e4f57b2f44d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:14.567727 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864c5b3-9e7b-4952-a573-2e4f57b2f44d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:14.567930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864c5b3-9e7b-4952-a573-2e4f57b2f44d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:14.569306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 46/98] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:14.588261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cd562-b734-443b-859d-951cb4230437 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:14.588550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cd562-b734-443b-859d-951cb4230437 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:14.588840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cd562-b734-443b-859d-951cb4230437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:14.605701 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-855cd562-b734-443b-859d-951cb4230437 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:14.606929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-855cd562-b734-443b-859d-951cb4230437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:14.639897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3835b-66ec-4ac8-9165-4207d74ef7a9 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:14.640833 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3835b-66ec-4ac8-9165-4207d74ef7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:14.641207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3835b-66ec-4ac8-9165-4207d74ef7a9 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:14.642937 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 47/99] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:14.659866 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c96ce1-d280-4017-8b8a-cc8139722668 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:14.660177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c96ce1-d280-4017-8b8a-cc8139722668 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:14.660454 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c96ce1-d280-4017-8b8a-cc8139722668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:14.686903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-74c96ce1-d280-4017-8b8a-cc8139722668 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:14.688369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-74c96ce1-d280-4017-8b8a-cc8139722668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:14.711901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 53/100] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:14.753266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cd562-b734-443b-859d-951cb4230437 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:14.796345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 48/101] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:14.831100 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c96ce1-d280-4017-8b8a-cc8139722668 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:14.860669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cd562-b734-443b-859d-951cb4230437 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:14.895504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667823f-9483-4e15-a622-0693199137c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:14.896371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667823f-9483-4e15-a622-0693199137c5 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:14.896666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667823f-9483-4e15-a622-0693199137c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:14.896949 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667823f-9483-4e15-a622-0693199137c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:14.911617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667823f-9483-4e15-a622-0693199137c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-a667823f-9483-4e15-a622-0693199137c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:14.916175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:14.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:14.917799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:14.917799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:14.917799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:14.917799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:14.917799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:14.917799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:14.917799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:14.917799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:14.917799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:14.917799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:14.917799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:14.917799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:14.917799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 54/102] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:12:14.923365 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667823f-9483-4e15-a622-0693199137c5 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:15.017083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c96ce1-d280-4017-8b8a-cc8139722668 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:15.079268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ce409-bd0f-4b7e-9bd7-8225578b0864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:15.080102 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ce409-bd0f-4b7e-9bd7-8225578b0864 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:15.080393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ce409-bd0f-4b7e-9bd7-8225578b0864 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:15.080676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ce409-bd0f-4b7e-9bd7-8225578b0864 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:15.081966 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ce409-bd0f-4b7e-9bd7-8225578b0864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:15.083392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ce409-bd0f-4b7e-9bd7-8225578b0864 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:15.085332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 49/103] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:12:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:15.091149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ce409-bd0f-4b7e-9bd7-8225578b0864 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:15.112415 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667823f-9483-4e15-a622-0693199137c5 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:15.215008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321951a1-9860-4e41-88b5-9d01b5f241cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:15.215706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321951a1-9860-4e41-88b5-9d01b5f241cf None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:15.215996 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321951a1-9860-4e41-88b5-9d01b5f241cf None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:15.216281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321951a1-9860-4e41-88b5-9d01b5f241cf None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:15.217046 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321951a1-9860-4e41-88b5-9d01b5f241cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:15.217360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321951a1-9860-4e41-88b5-9d01b5f241cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:15.218843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321951a1-9860-4e41-88b5-9d01b5f241cf None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:15.233073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 55/104] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:15.239746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ce409-bd0f-4b7e-9bd7-8225578b0864 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:15.247755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321951a1-9860-4e41-88b5-9d01b5f241cf None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:15.277541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69535d7-9f0d-47db-a721-5dde2123c03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:15.278219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69535d7-9f0d-47db-a721-5dde2123c03e None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:15.278549 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69535d7-9f0d-47db-a721-5dde2123c03e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:15.278893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69535d7-9f0d-47db-a721-5dde2123c03e None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:15.279555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69535d7-9f0d-47db-a721-5dde2123c03e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:15.281433 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69535d7-9f0d-47db-a721-5dde2123c03e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:15.400465 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 50/105] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:12:15 2022] POST /identity/v3/projects => generated 302 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:12:15.438272 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321951a1-9860-4e41-88b5-9d01b5f241cf None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:15.477286 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6f57-31c1-40f8-beb6-0a569357305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:15.478193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6f57-31c1-40f8-beb6-0a569357305c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:15.478505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6f57-31c1-40f8-beb6-0a569357305c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:15.478786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6f57-31c1-40f8-beb6-0a569357305c None admin] PATH_INFO: `/v3/users/36dc27a599a94fd49430f058307bf7e4` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:15.503102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a6f57-31c1-40f8-beb6-0a569357305c None admin] RBAC: Authorizing `identity:get_user(user_id=36dc27a599a94fd49430f058307bf7e4)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:15.504665 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a6f57-31c1-40f8-beb6-0a569357305c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:15.506669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 56/106] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:15 2022] GET /identity/v3/users/36dc27a599a94fd49430f058307bf7e4 => generated 289 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:15.512047 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69535d7-9f0d-47db-a721-5dde2123c03e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:15.713475 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69535d7-9f0d-47db-a721-5dde2123c03e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:15.764515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4d209-6ff5-40c6-a3ac-515c4a481e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:15.765523 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4d209-6ff5-40c6-a3ac-515c4a481e83 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:15.766168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4d209-6ff5-40c6-a3ac-515c4a481e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:15.766679 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4d209-6ff5-40c6-a3ac-515c4a481e83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:15.848435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4d209-6ff5-40c6-a3ac-515c4a481e83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:15.850847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4d209-6ff5-40c6-a3ac-515c4a481e83 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:15.950460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 51/107] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:15.956400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6f57-31c1-40f8-beb6-0a569357305c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:16.061833 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6f57-31c1-40f8-beb6-0a569357305c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:16.101781 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624a52b-42fa-4419-9163-daa3404448e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:16.102682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624a52b-42fa-4419-9163-daa3404448e3 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:16.102970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624a52b-42fa-4419-9163-daa3404448e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:16.103250 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624a52b-42fa-4419-9163-daa3404448e3 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:16.104463 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624a52b-42fa-4419-9163-daa3404448e3 None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:16.105931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624a52b-42fa-4419-9163-daa3404448e3 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:16.107967 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 57/108] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:15 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:16.114515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4d209-6ff5-40c6-a3ac-515c4a481e83 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:16.263192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4d209-6ff5-40c6-a3ac-515c4a481e83 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:16.307004 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361858e-c5bc-47d8-91c9-635ecf72570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:16.308007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361858e-c5bc-47d8-91c9-635ecf72570b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:16.308513 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361858e-c5bc-47d8-91c9-635ecf72570b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:16.308981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361858e-c5bc-47d8-91c9-635ecf72570b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:16.310001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361858e-c5bc-47d8-91c9-635ecf72570b None admin] RBAC: Adding query filter params (role.id=a4ca52325cbd4f7192e085966d529a71, scope.project.id=7192d8f0799049abb47bcece952f59e6, user.id=36dc27a599a94fd49430f058307bf7e4) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:16.310529 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361858e-c5bc-47d8-91c9-635ecf72570b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:16.312918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361858e-c5bc-47d8-91c9-635ecf72570b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:16.322773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 52/109] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:16 2022] GET /identity/v3/role_assignments?user.id=36dc27a599a94fd49430f058307bf7e4&scope.project.id=7192d8f0799049abb47bcece952f59e6&role.id=a4ca52325cbd4f7192e085966d529a71 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:16.618530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d155b77-8198-46c3-b3c0-51cbabdbd39c None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:16.618876 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d155b77-8198-46c3-b3c0-51cbabdbd39c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:16.619057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d155b77-8198-46c3-b3c0-51cbabdbd39c None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:16.620400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 58/110] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:16.626746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019a034-ea33-496d-8fa6-0272388c90c7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:16.632351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019a034-ea33-496d-8fa6-0272388c90c7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:16.632351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019a034-ea33-496d-8fa6-0272388c90c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:16.647509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7019a034-ea33-496d-8fa6-0272388c90c7 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:16.649087 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7019a034-ea33-496d-8fa6-0272388c90c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:16.729833 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 53/111] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:16.776697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d155b77-8198-46c3-b3c0-51cbabdbd39c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:16.899918 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d155b77-8198-46c3-b3c0-51cbabdbd39c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:16.951005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec9a39-7a84-4681-8c94-3c5a6fecbc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:16.951820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec9a39-7a84-4681-8c94-3c5a6fecbc52 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:16.952108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec9a39-7a84-4681-8c94-3c5a6fecbc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:16.952391 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec9a39-7a84-4681-8c94-3c5a6fecbc52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:16.971013 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec9a39-7a84-4681-8c94-3c5a6fecbc52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-a1ec9a39-7a84-4681-8c94-3c5a6fecbc52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:16.978882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:16.979702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:16.980450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:16.980450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:16.980450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:16.980450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:16.980450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:16.980450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:16.980450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:16.980450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:16.980450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:16.980450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:16.980450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:16.980450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:16.980450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 59/112] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:12:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:16.988512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019a034-ea33-496d-8fa6-0272388c90c7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:17.142234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019a034-ea33-496d-8fa6-0272388c90c7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:17.167120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc1c9-6e0d-460b-80e9-02ef2058a678 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:17.167868 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc1c9-6e0d-460b-80e9-02ef2058a678 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:17.168370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc1c9-6e0d-460b-80e9-02ef2058a678 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:17.170122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 60/113] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:17.175493 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2597-e24a-474d-b1cc-fed40132d6b7 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:17.176021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2597-e24a-474d-b1cc-fed40132d6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:17.181225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2597-e24a-474d-b1cc-fed40132d6b7 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:17.181225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 61/114] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:17.181225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598491b-bdb3-4607-ac9f-2a5d82804a1d None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:17.181965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598491b-bdb3-4607-ac9f-2a5d82804a1d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:17.182768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598491b-bdb3-4607-ac9f-2a5d82804a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:17.191776 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaf5b1-9236-4e11-a31e-9e2df7ab02c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:17.192472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaf5b1-9236-4e11-a31e-9e2df7ab02c2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:17.192820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaf5b1-9236-4e11-a31e-9e2df7ab02c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:17.193103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaf5b1-9236-4e11-a31e-9e2df7ab02c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:17.193968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaf5b1-9236-4e11-a31e-9e2df7ab02c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:17.194318 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaf5b1-9236-4e11-a31e-9e2df7ab02c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:17.198334 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaf5b1-9236-4e11-a31e-9e2df7ab02c2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:17.218770 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 54/115] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:17.221093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab012539-4393-473e-a171-07b9a5ad03de None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:17.221570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab012539-4393-473e-a171-07b9a5ad03de None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:17.222004 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab012539-4393-473e-a171-07b9a5ad03de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:17.228182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6598491b-bdb3-4607-ac9f-2a5d82804a1d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:17.231589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6598491b-bdb3-4607-ac9f-2a5d82804a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:17.258123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ab012539-4393-473e-a171-07b9a5ad03de None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:17.260938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ab012539-4393-473e-a171-07b9a5ad03de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:17.352006 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 62/116] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:17.354024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598491b-bdb3-4607-ac9f-2a5d82804a1d None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:17.388984 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 55/117] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:17.403222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab012539-4393-473e-a171-07b9a5ad03de None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:17.509546 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598491b-bdb3-4607-ac9f-2a5d82804a1d None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:17.537035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab012539-4393-473e-a171-07b9a5ad03de None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:17.544437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650ec96-5c6a-484e-971c-1a115bb639ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:17.545351 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650ec96-5c6a-484e-971c-1a115bb639ae None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:17.545659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650ec96-5c6a-484e-971c-1a115bb639ae None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:17.545909 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650ec96-5c6a-484e-971c-1a115bb639ae None admin] PATH_INFO: `/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:17.548516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650ec96-5c6a-484e-971c-1a115bb639ae None admin] RBAC: Authorizing `identity:get_user(user_id=faf5764aa68b4dd0a7861a70d6db3d3d)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:17.550011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650ec96-5c6a-484e-971c-1a115bb639ae None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:17.551950 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 63/118] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:17 2022] GET /identity/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:17.552758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650ec96-5c6a-484e-971c-1a115bb639ae None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:17.587106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daaa0a-a4fa-45e6-adaf-228605fad108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:17.588896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daaa0a-a4fa-45e6-adaf-228605fad108 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:17.589202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daaa0a-a4fa-45e6-adaf-228605fad108 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:17.589489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daaa0a-a4fa-45e6-adaf-228605fad108 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:17.603163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daaa0a-a4fa-45e6-adaf-228605fad108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-93daaa0a-a4fa-45e6-adaf-228605fad108 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:17.614464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:17.615332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:17.616665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:17.616665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:17.616665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:17.616665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:17.616665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:17.616665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:17.616665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:17.616665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:17.616665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:17.616665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:17.616665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:17.616665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:17.616665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 56/119] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:17.617800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a7202-2dce-4135-b3d1-361ab01af9a6 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:17.617800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a7202-2dce-4135-b3d1-361ab01af9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:17.617993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a7202-2dce-4135-b3d1-361ab01af9a6 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:17.620450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 57/120] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:17.620450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a7202-2dce-4135-b3d1-361ab01af9a6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:17.674478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650ec96-5c6a-484e-971c-1a115bb639ae None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:17.742309 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88590999-9030-4500-8d9a-6fe6d25eac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:17.743363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88590999-9030-4500-8d9a-6fe6d25eac81 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:17.743661 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88590999-9030-4500-8d9a-6fe6d25eac81 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:17.744306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88590999-9030-4500-8d9a-6fe6d25eac81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:17.758017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88590999-9030-4500-8d9a-6fe6d25eac81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-88590999-9030-4500-8d9a-6fe6d25eac81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:17.768859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:17.769703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:17.770475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:17.770475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:17.770475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:17.770475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:17.770475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:17.770475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:17.770475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:17.770475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:17.770475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:17.770475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:17.770475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:17.770475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:17.770475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 64/121] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:12:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:17.771598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88590999-9030-4500-8d9a-6fe6d25eac81 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:17.782700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a7202-2dce-4135-b3d1-361ab01af9a6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:17.817060 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8cf7d-8967-4b58-b96e-438a044df0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:17.818348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8cf7d-8967-4b58-b96e-438a044df0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:17.818865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8cf7d-8967-4b58-b96e-438a044df0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:17.819346 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8cf7d-8967-4b58-b96e-438a044df0d6 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:17.820756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8cf7d-8967-4b58-b96e-438a044df0d6 None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:17.822593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8cf7d-8967-4b58-b96e-438a044df0d6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:17.824574 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 58/122] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:17 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:17.826090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a073f-5110-43a2-808f-f15ce4d7a850 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:17.826605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a073f-5110-43a2-808f-f15ce4d7a850 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:17.827102 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a073f-5110-43a2-808f-f15ce4d7a850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:17.845606 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-012a073f-5110-43a2-808f-f15ce4d7a850 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:17.847244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-012a073f-5110-43a2-808f-f15ce4d7a850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:17.881611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88590999-9030-4500-8d9a-6fe6d25eac81 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:17.928008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 59/123] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:17.934464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5e6b2-1936-400f-b7e6-a2f7525ab2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:17.934464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5e6b2-1936-400f-b7e6-a2f7525ab2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:17.934464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5e6b2-1936-400f-b7e6-a2f7525ab2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:17.934464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5e6b2-1936-400f-b7e6-a2f7525ab2b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:17.934968 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5e6b2-1936-400f-b7e6-a2f7525ab2b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:17.934968 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5e6b2-1936-400f-b7e6-a2f7525ab2b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:17.935472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5e6b2-1936-400f-b7e6-a2f7525ab2b6 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:17.937627 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a073f-5110-43a2-808f-f15ce4d7a850 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:17.951284 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 65/124] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:17.952925 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5e6b2-1936-400f-b7e6-a2f7525ab2b6 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:18.122553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5e6b2-1936-400f-b7e6-a2f7525ab2b6 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:18.130798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a073f-5110-43a2-808f-f15ce4d7a850 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:18.175996 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e43f2-96bf-4e55-9ddb-562db57a37d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:18.177475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e43f2-96bf-4e55-9ddb-562db57a37d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:18.177961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e43f2-96bf-4e55-9ddb-562db57a37d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:18.178474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e43f2-96bf-4e55-9ddb-562db57a37d0 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6/users/faf5764aa68b4dd0a7861a70d6db3d3d/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:18.181711 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e43f2-96bf-4e55-9ddb-562db57a37d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7192d8f0799049abb47bcece952f59e6, user_id=faf5764aa68b4dd0a7861a70d6db3d3d, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:18.184477 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e43f2-96bf-4e55-9ddb-562db57a37d0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:18.187088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b76a22-c04c-4493-989a-7d2c1ba43116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:18.188459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b76a22-c04c-4493-989a-7d2c1ba43116 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:18.189190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b76a22-c04c-4493-989a-7d2c1ba43116 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:18.189912 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b76a22-c04c-4493-989a-7d2c1ba43116 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:18.191477 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b76a22-c04c-4493-989a-7d2c1ba43116 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:18.192271 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b76a22-c04c-4493-989a-7d2c1ba43116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:18.194440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b76a22-c04c-4493-989a-7d2c1ba43116 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:18.206317 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 60/125] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:12:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:18.206317 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b76a22-c04c-4493-989a-7d2c1ba43116 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:18.287747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 66/126] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:12:17 2022] PUT /identity/v3/projects/7192d8f0799049abb47bcece952f59e6/users/faf5764aa68b4dd0a7861a70d6db3d3d/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:18.289281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e43f2-96bf-4e55-9ddb-562db57a37d0 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:18.310141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b76a22-c04c-4493-989a-7d2c1ba43116 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:18.359136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793201a2-3a1e-4459-9d15-4733e451c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:18.360046 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793201a2-3a1e-4459-9d15-4733e451c859 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:18.360330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793201a2-3a1e-4459-9d15-4733e451c859 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:18.360609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793201a2-3a1e-4459-9d15-4733e451c859 None admin] PATH_INFO: `/v3/users/1e88330c8d8b49a79c15d2a198869b44` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:18.362721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793201a2-3a1e-4459-9d15-4733e451c859 None admin] RBAC: Authorizing `identity:get_user(user_id=1e88330c8d8b49a79c15d2a198869b44)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:18.364394 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793201a2-3a1e-4459-9d15-4733e451c859 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:18.367128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 61/127] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:18 2022] GET /identity/v3/users/1e88330c8d8b49a79c15d2a198869b44 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:18.367975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793201a2-3a1e-4459-9d15-4733e451c859 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:18.419163 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e43f2-96bf-4e55-9ddb-562db57a37d0 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:18.496733 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793201a2-3a1e-4459-9d15-4733e451c859 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:18.508781 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699896dd-82bd-42c4-b412-269490b04c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:18.509610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699896dd-82bd-42c4-b412-269490b04c7e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:18.509899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699896dd-82bd-42c4-b412-269490b04c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:18.510178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699896dd-82bd-42c4-b412-269490b04c7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:18.535914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec340b-e71e-4ff9-8d05-2db67b3a5adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:18.538085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec340b-e71e-4ff9-8d05-2db67b3a5adc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:18.538382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec340b-e71e-4ff9-8d05-2db67b3a5adc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:18.538663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec340b-e71e-4ff9-8d05-2db67b3a5adc None admin] PATH_INFO: `/v3/users/1e88330c8d8b49a79c15d2a198869b44` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:18.542211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec340b-e71e-4ff9-8d05-2db67b3a5adc None admin] RBAC: Authorizing `identity:get_user(user_id=1e88330c8d8b49a79c15d2a198869b44)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:18.543707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec340b-e71e-4ff9-8d05-2db67b3a5adc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:18.545236 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699896dd-82bd-42c4-b412-269490b04c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:18.547824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 62/128] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:18 2022] GET /identity/v3/users/1e88330c8d8b49a79c15d2a198869b44 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:18.548651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec340b-e71e-4ff9-8d05-2db67b3a5adc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-699896dd-82bd-42c4-b412-269490b04c7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:18.553131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:18.553989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:18.554872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:18.554872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:18.554872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:18.554872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:18.554872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:18.554872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:18.554872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:18.554872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:18.554872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:18.554872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:18.554872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:18.554872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:18.556106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 67/129] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:18.557293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699896dd-82bd-42c4-b412-269490b04c7e None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:18.664164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec340b-e71e-4ff9-8d05-2db67b3a5adc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:18.667888 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699896dd-82bd-42c4-b412-269490b04c7e None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:18.703646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ff7d3-6ef7-4cde-b9dd-cf1ab5d108f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:18.703949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ff7d3-6ef7-4cde-b9dd-cf1ab5d108f2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:18.704140 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ff7d3-6ef7-4cde-b9dd-cf1ab5d108f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:18.704416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ff7d3-6ef7-4cde-b9dd-cf1ab5d108f2 None admin] PATH_INFO: `/v3/projects/543d5ab4ea6240c2b0e59e8e91d6e3c1` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:18.705973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ff7d3-6ef7-4cde-b9dd-cf1ab5d108f2 None admin] RBAC: Authorizing `identity:get_project(project_id=543d5ab4ea6240c2b0e59e8e91d6e3c1)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:18.707477 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ff7d3-6ef7-4cde-b9dd-cf1ab5d108f2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:18.708170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b02d1-857a-4ce6-ba39-ff5c0f724595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:18.709330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 63/130] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:18 2022] GET /identity/v3/projects/543d5ab4ea6240c2b0e59e8e91d6e3c1 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:18.709728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b02d1-857a-4ce6-ba39-ff5c0f724595 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:18.709927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ff7d3-6ef7-4cde-b9dd-cf1ab5d108f2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:18.710535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b02d1-857a-4ce6-ba39-ff5c0f724595 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:18.711012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b02d1-857a-4ce6-ba39-ff5c0f724595 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:18.712449 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b02d1-857a-4ce6-ba39-ff5c0f724595 None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:18.714188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b02d1-857a-4ce6-ba39-ff5c0f724595 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:18.716771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 68/131] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:18 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:18.722472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b02d1-857a-4ce6-ba39-ff5c0f724595 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:18.881212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b02d1-857a-4ce6-ba39-ff5c0f724595 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:18.881433 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ff7d3-6ef7-4cde-b9dd-cf1ab5d108f2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:18.918579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cf838-7bdf-484b-a66b-e247d9d4d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:18.919479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cf838-7bdf-484b-a66b-e247d9d4d3f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:18.919594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb8513-8d75-45ca-b62f-431c5766f4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:18.919763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cf838-7bdf-484b-a66b-e247d9d4d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:18.920045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cf838-7bdf-484b-a66b-e247d9d4d3f5 None admin] PATH_INFO: `/v3/projects/543d5ab4ea6240c2b0e59e8e91d6e3c1/users/1e88330c8d8b49a79c15d2a198869b44/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:18.920564 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb8513-8d75-45ca-b62f-431c5766f4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:18.921054 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb8513-8d75-45ca-b62f-431c5766f4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:18.921982 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb8513-8d75-45ca-b62f-431c5766f4f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:18.922236 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cf838-7bdf-484b-a66b-e247d9d4d3f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=543d5ab4ea6240c2b0e59e8e91d6e3c1, user_id=1e88330c8d8b49a79c15d2a198869b44, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:18.922658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb8513-8d75-45ca-b62f-431c5766f4f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:18.923072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb8513-8d75-45ca-b62f-431c5766f4f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:18.923782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cf838-7bdf-484b-a66b-e247d9d4d3f5 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:18.924670 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb8513-8d75-45ca-b62f-431c5766f4f7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:18.933397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 64/132] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:18.934560 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb8513-8d75-45ca-b62f-431c5766f4f7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:19.035194 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb8513-8d75-45ca-b62f-431c5766f4f7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:19.048723 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 69/133] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:12:18 2022] PUT /identity/v3/projects/543d5ab4ea6240c2b0e59e8e91d6e3c1/users/1e88330c8d8b49a79c15d2a198869b44/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:19.050465 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db92276-c226-4483-ac0d-d7923b24056b None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.051142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db92276-c226-4483-ac0d-d7923b24056b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.051627 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db92276-c226-4483-ac0d-d7923b24056b None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.057721 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 70/134] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:19.059181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db92276-c226-4483-ac0d-d7923b24056b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:19.071196 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfae6c9-f82c-4b45-aaf6-d7f1ddcb9a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:19.073687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfae6c9-f82c-4b45-aaf6-d7f1ddcb9a85 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.073687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfae6c9-f82c-4b45-aaf6-d7f1ddcb9a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.073687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfae6c9-f82c-4b45-aaf6-d7f1ddcb9a85 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6/users/1e88330c8d8b49a79c15d2a198869b44/roles/44468cf4511643498cf7830993b8c9e5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.075514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfae6c9-f82c-4b45-aaf6-d7f1ddcb9a85 None admin] RBAC: Authorizing `identity:create_grant(project_id=7192d8f0799049abb47bcece952f59e6, user_id=1e88330c8d8b49a79c15d2a198869b44, role_id=44468cf4511643498cf7830993b8c9e5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:19.077184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfae6c9-f82c-4b45-aaf6-d7f1ddcb9a85 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:19.162418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 65/135] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:12:18 2022] PUT /identity/v3/projects/7192d8f0799049abb47bcece952f59e6/users/1e88330c8d8b49a79c15d2a198869b44/roles/44468cf4511643498cf7830993b8c9e5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:19.163746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f19163-e600-40c6-b78e-d8c058a41279 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.164044 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f19163-e600-40c6-b78e-d8c058a41279 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.164391 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f19163-e600-40c6-b78e-d8c058a41279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.188355 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-21f19163-e600-40c6-b78e-d8c058a41279 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:19.189644 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-21f19163-e600-40c6-b78e-d8c058a41279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:19.218648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db92276-c226-4483-ac0d-d7923b24056b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:19.284269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59fa83-a2ae-43d9-8576-cb956229f776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:19.286114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59fa83-a2ae-43d9-8576-cb956229f776 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.286404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59fa83-a2ae-43d9-8576-cb956229f776 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.286692 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59fa83-a2ae-43d9-8576-cb956229f776 None admin] PATH_INFO: `/v3/users/1e88330c8d8b49a79c15d2a198869b44` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.288485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59fa83-a2ae-43d9-8576-cb956229f776 None admin] RBAC: Authorizing `identity:get_user(user_id=1e88330c8d8b49a79c15d2a198869b44)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:19.288635 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 66/136] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:19.298181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59fa83-a2ae-43d9-8576-cb956229f776 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:19.298181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 71/137] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:19 2022] GET /identity/v3/users/1e88330c8d8b49a79c15d2a198869b44 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:19.299610 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f19163-e600-40c6-b78e-d8c058a41279 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:19.320572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59fa83-a2ae-43d9-8576-cb956229f776 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:19.432572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59fa83-a2ae-43d9-8576-cb956229f776 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:19.487756 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07d418-f74d-40b1-ac55-b2acabf83712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:19.488566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d418-f74d-40b1-ac55-b2acabf83712 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.488850 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d418-f74d-40b1-ac55-b2acabf83712 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.489125 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d418-f74d-40b1-ac55-b2acabf83712 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.491115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07d418-f74d-40b1-ac55-b2acabf83712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:19.491470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f19163-e600-40c6-b78e-d8c058a41279 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:19.493065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07d418-f74d-40b1-ac55-b2acabf83712 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:19.495016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 72/138] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:12:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:19.496475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362a93-d883-4924-a160-01ed409c5c65 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.496973 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362a93-d883-4924-a160-01ed409c5c65 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.497456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362a93-d883-4924-a160-01ed409c5c65 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.504120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 73/139] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:19.505717 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde976a-90fe-4482-aa5f-2bcd96f61f83 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.506202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde976a-90fe-4482-aa5f-2bcd96f61f83 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.506696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde976a-90fe-4482-aa5f-2bcd96f61f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.526968 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-7cde976a-90fe-4482-aa5f-2bcd96f61f83 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:19.532010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7cde976a-90fe-4482-aa5f-2bcd96f61f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:19.539257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05902ffe-80c5-43f3-a50e-b4e4b9327dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:19.539602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902ffe-80c5-43f3-a50e-b4e4b9327dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.539882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902ffe-80c5-43f3-a50e-b4e4b9327dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.540213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902ffe-80c5-43f3-a50e-b4e4b9327dc5 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.541413 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05902ffe-80c5-43f3-a50e-b4e4b9327dc5 None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:19.542911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05902ffe-80c5-43f3-a50e-b4e4b9327dc5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:19.544605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 67/140] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:19 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:19.545637 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05902ffe-80c5-43f3-a50e-b4e4b9327dc5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:19.643504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 74/141] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:19.644673 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde976a-90fe-4482-aa5f-2bcd96f61f83 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:19.712396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05902ffe-80c5-43f3-a50e-b4e4b9327dc5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:19.751949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67e282-f9cf-42d2-8056-81cec7c6a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:19.753903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67e282-f9cf-42d2-8056-81cec7c6a3f9 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.754712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67e282-f9cf-42d2-8056-81cec7c6a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.755858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67e282-f9cf-42d2-8056-81cec7c6a3f9 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.757488 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67e282-f9cf-42d2-8056-81cec7c6a3f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:19.759380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67e282-f9cf-42d2-8056-81cec7c6a3f9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:19.814778 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde976a-90fe-4482-aa5f-2bcd96f61f83 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:19.850181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ee1d8-e5a0-43cf-b576-cabb1f50203d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:19.851328 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ee1d8-e5a0-43cf-b576-cabb1f50203d None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:19.851613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ee1d8-e5a0-43cf-b576-cabb1f50203d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:19.851892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ee1d8-e5a0-43cf-b576-cabb1f50203d None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6/users/1e88330c8d8b49a79c15d2a198869b44/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:19.854070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ee1d8-e5a0-43cf-b576-cabb1f50203d None admin] RBAC: Authorizing `identity:create_grant(project_id=7192d8f0799049abb47bcece952f59e6, user_id=1e88330c8d8b49a79c15d2a198869b44, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:19.855603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ee1d8-e5a0-43cf-b576-cabb1f50203d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:19.880152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 68/142] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:12:19 2022] POST /identity/v3/users => generated 283 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:19.880910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67e282-f9cf-42d2-8056-81cec7c6a3f9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:19.936803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 75/143] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:12:19 2022] PUT /identity/v3/projects/7192d8f0799049abb47bcece952f59e6/users/1e88330c8d8b49a79c15d2a198869b44/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:20.018976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67e282-f9cf-42d2-8056-81cec7c6a3f9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:20.058252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394c8b6-c752-485e-b19f-bb820295e338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:20.059109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394c8b6-c752-485e-b19f-bb820295e338 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:20.059400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394c8b6-c752-485e-b19f-bb820295e338 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:20.059744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394c8b6-c752-485e-b19f-bb820295e338 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:20.075603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394c8b6-c752-485e-b19f-bb820295e338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-3394c8b6-c752-485e-b19f-bb820295e338 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:20.083930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:20.084863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:20.085608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:20.085608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:20.085608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:20.085608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:20.085608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:20.085608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:20.085608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:20.085608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:20.085608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:20.085608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:20.085608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:20.085608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:20.089927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 69/144] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:20.092260 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ee1d8-e5a0-43cf-b576-cabb1f50203d None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:20.258398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ee1d8-e5a0-43cf-b576-cabb1f50203d None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:20.296037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c585d7-1800-496a-b376-a4c355456047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:20.297238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c585d7-1800-496a-b376-a4c355456047 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:20.297841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c585d7-1800-496a-b376-a4c355456047 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:20.298378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c585d7-1800-496a-b376-a4c355456047 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:20.299354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c585d7-1800-496a-b376-a4c355456047 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:20.299870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c585d7-1800-496a-b376-a4c355456047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:20.301484 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c585d7-1800-496a-b376-a4c355456047 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:20.310743 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 76/145] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:20.317778 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394c8b6-c752-485e-b19f-bb820295e338 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:20.434073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394c8b6-c752-485e-b19f-bb820295e338 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:20.473678 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed2da2-9d72-4251-a0b5-179a8b920dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:20.474618 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed2da2-9d72-4251-a0b5-179a8b920dac None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:20.474907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed2da2-9d72-4251-a0b5-179a8b920dac None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:20.475185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed2da2-9d72-4251-a0b5-179a8b920dac None admin] PATH_INFO: `/v3/users/36dc27a599a94fd49430f058307bf7e4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:20.476414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed2da2-9d72-4251-a0b5-179a8b920dac None admin] RBAC: Authorizing `identity:get_user(user_id=36dc27a599a94fd49430f058307bf7e4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:20.477898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed2da2-9d72-4251-a0b5-179a8b920dac None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:20.479921 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 70/146] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:20 2022] GET /identity/v3/users/36dc27a599a94fd49430f058307bf7e4 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:20.485573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c585d7-1800-496a-b376-a4c355456047 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:20.624978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c585d7-1800-496a-b376-a4c355456047 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:20.668012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1ee60-c469-4932-aa87-2090101bb7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:20.669193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1ee60-c469-4932-aa87-2090101bb7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:20.669654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1ee60-c469-4932-aa87-2090101bb7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:20.670107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1ee60-c469-4932-aa87-2090101bb7e6 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:20.672147 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1ee60-c469-4932-aa87-2090101bb7e6 None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:20.673812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1ee60-c469-4932-aa87-2090101bb7e6 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:20.675763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 77/147] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:20 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:20.681894 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed2da2-9d72-4251-a0b5-179a8b920dac None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:20.819237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed2da2-9d72-4251-a0b5-179a8b920dac None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:20.857379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c7820-8590-4896-abf5-aa3e9f55813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:20.858308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c7820-8590-4896-abf5-aa3e9f55813d None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:20.858598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c7820-8590-4896-abf5-aa3e9f55813d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:20.859033 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c7820-8590-4896-abf5-aa3e9f55813d None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6/users/36dc27a599a94fd49430f058307bf7e4/roles/a4ca52325cbd4f7192e085966d529a71` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:20.861057 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c7820-8590-4896-abf5-aa3e9f55813d None admin] RBAC: Authorizing `identity:create_grant(project_id=7192d8f0799049abb47bcece952f59e6, user_id=36dc27a599a94fd49430f058307bf7e4, role_id=a4ca52325cbd4f7192e085966d529a71)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:20.862731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c7820-8590-4896-abf5-aa3e9f55813d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:20.944755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 71/148] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:12:20 2022] PUT /identity/v3/projects/7192d8f0799049abb47bcece952f59e6/users/36dc27a599a94fd49430f058307bf7e4/roles/a4ca52325cbd4f7192e085966d529a71 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:21.371090 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c79d7b-79d3-4b00-8e1c-d348536c6f2a None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:21.372047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c79d7b-79d3-4b00-8e1c-d348536c6f2a None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:21.372587 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c79d7b-79d3-4b00-8e1c-d348536c6f2a None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:21.374195 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 78/149] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:21.379932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04579-9892-4c06-acaf-fa8cf6627459 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:21.380377 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04579-9892-4c06-acaf-fa8cf6627459 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:21.380612 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04579-9892-4c06-acaf-fa8cf6627459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:21.398161 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bae04579-9892-4c06-acaf-fa8cf6627459 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:21.400084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bae04579-9892-4c06-acaf-fa8cf6627459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:21.487708 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 72/150] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:21.529590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c79d7b-79d3-4b00-8e1c-d348536c6f2a None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:21.639882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c79d7b-79d3-4b00-8e1c-d348536c6f2a None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:21.681386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ba48b-6126-4571-b096-0f33ecb5af47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:21.682193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ba48b-6126-4571-b096-0f33ecb5af47 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:21.682498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ba48b-6126-4571-b096-0f33ecb5af47 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:21.682784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ba48b-6126-4571-b096-0f33ecb5af47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:21.696632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ba48b-6126-4571-b096-0f33ecb5af47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-e86ba48b-6126-4571-b096-0f33ecb5af47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:21.704600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:21.705437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:21.706206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:21.706206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:21.706206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:21.706206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:21.706206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:21.706206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:21.706206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:21.706206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:21.706206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:21.706206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:21.706206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:21.706206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:21.706206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 79/151] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:12:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:21.714131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae04579-9892-4c06-acaf-fa8cf6627459 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:21.823225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae04579-9892-4c06-acaf-fa8cf6627459 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:21.864082 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2fb22-ae17-465e-af3c-0121ea831ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:21.864767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2fb22-ae17-465e-af3c-0121ea831ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:21.865053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2fb22-ae17-465e-af3c-0121ea831ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:21.865389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2fb22-ae17-465e-af3c-0121ea831ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:21.866198 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2fb22-ae17-465e-af3c-0121ea831ce4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:21.866530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2fb22-ae17-465e-af3c-0121ea831ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:21.867907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2fb22-ae17-465e-af3c-0121ea831ce4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:21.877184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 73/152] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:21.882913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ba48b-6126-4571-b096-0f33ecb5af47 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:21.983386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ba48b-6126-4571-b096-0f33ecb5af47 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:22.018540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7258776-696a-4cd8-8552-e0260c11f172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:22.019427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258776-696a-4cd8-8552-e0260c11f172 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:22.019708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258776-696a-4cd8-8552-e0260c11f172 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:22.019977 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258776-696a-4cd8-8552-e0260c11f172 None admin] PATH_INFO: `/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:22.027068 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7258776-696a-4cd8-8552-e0260c11f172 None admin] RBAC: Authorizing `identity:get_user(user_id=faf5764aa68b4dd0a7861a70d6db3d3d)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:22.028546 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7258776-696a-4cd8-8552-e0260c11f172 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:22.030232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 80/153] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:21 2022] GET /identity/v3/users/faf5764aa68b4dd0a7861a70d6db3d3d => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:22.036305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2fb22-ae17-465e-af3c-0121ea831ce4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:22.146970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2fb22-ae17-465e-af3c-0121ea831ce4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:22.185062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a62a-c473-4733-85c1-4e057246c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:22.185800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a62a-c473-4733-85c1-4e057246c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:22.186088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a62a-c473-4733-85c1-4e057246c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:22.186389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a62a-c473-4733-85c1-4e057246c3c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:22.259367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6a62a-c473-4733-85c1-4e057246c3c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:22.260773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6a62a-c473-4733-85c1-4e057246c3c6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:22.360559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 74/154] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:22.366237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7258776-696a-4cd8-8552-e0260c11f172 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:22.466835 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7258776-696a-4cd8-8552-e0260c11f172 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:22.509720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a854bf-50b4-4c40-bda4-74a4d9315586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:22.510542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a854bf-50b4-4c40-bda4-74a4d9315586 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:22.510824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a854bf-50b4-4c40-bda4-74a4d9315586 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:22.511098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a854bf-50b4-4c40-bda4-74a4d9315586 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:22.512279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a854bf-50b4-4c40-bda4-74a4d9315586 None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:22.513733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a854bf-50b4-4c40-bda4-74a4d9315586 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:22.515984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 81/155] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:22 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:22.521942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a62a-c473-4733-85c1-4e057246c3c6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:22.640904 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a62a-c473-4733-85c1-4e057246c3c6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:22.680618 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761bfbb-55de-48b4-916d-2e4b0ba9c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:22.681680 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761bfbb-55de-48b4-916d-2e4b0ba9c99e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:22.682196 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761bfbb-55de-48b4-916d-2e4b0ba9c99e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:22.682789 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761bfbb-55de-48b4-916d-2e4b0ba9c99e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:22.683852 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761bfbb-55de-48b4-916d-2e4b0ba9c99e None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=7192d8f0799049abb47bcece952f59e6, user.id=faf5764aa68b4dd0a7861a70d6db3d3d) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:22.684382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761bfbb-55de-48b4-916d-2e4b0ba9c99e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:22.686082 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761bfbb-55de-48b4-916d-2e4b0ba9c99e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:22.693459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 75/156] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:22 2022] GET /identity/v3/role_assignments?user.id=faf5764aa68b4dd0a7861a70d6db3d3d&scope.project.id=7192d8f0799049abb47bcece952f59e6&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:23.078102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4901-dd35-44c9-9e2a-0fd19790280f None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:23.078472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4901-dd35-44c9-9e2a-0fd19790280f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:23.078643 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4901-dd35-44c9-9e2a-0fd19790280f None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:23.080303 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 82/157] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:23.086240 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410354bc-3b53-455d-ae82-2d570f0c583f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:23.086562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410354bc-3b53-455d-ae82-2d570f0c583f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:23.086847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410354bc-3b53-455d-ae82-2d570f0c583f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:23.111346 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-410354bc-3b53-455d-ae82-2d570f0c583f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:23.113836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-410354bc-3b53-455d-ae82-2d570f0c583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:23.187369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d21d01-e12d-4062-bc75-eddb4120cd41 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:23.187719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d21d01-e12d-4062-bc75-eddb4120cd41 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:23.188081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d21d01-e12d-4062-bc75-eddb4120cd41 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:23.189683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 83/158] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:23.195918 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe5907-d545-4d38-ac2a-e93b00198b29 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:23.196199 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe5907-d545-4d38-ac2a-e93b00198b29 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:23.196479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe5907-d545-4d38-ac2a-e93b00198b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:23.204140 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 76/159] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:23.221985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-3fbe5907-d545-4d38-ac2a-e93b00198b29 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:23.223378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-3fbe5907-d545-4d38-ac2a-e93b00198b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:23.314431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410354bc-3b53-455d-ae82-2d570f0c583f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:23.315437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 84/160] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:23.351678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe5907-d545-4d38-ac2a-e93b00198b29 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:23.502896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410354bc-3b53-455d-ae82-2d570f0c583f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:23.536956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe5907-d545-4d38-ac2a-e93b00198b29 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:23.567741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee45b9-60cf-4cfe-b9e8-f1b7f549b6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:23.569339 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee45b9-60cf-4cfe-b9e8-f1b7f549b6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:23.569835 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee45b9-60cf-4cfe-b9e8-f1b7f549b6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:23.570352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee45b9-60cf-4cfe-b9e8-f1b7f549b6e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:23.599329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee45b9-60cf-4cfe-b9e8-f1b7f549b6e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-48ee45b9-60cf-4cfe-b9e8-f1b7f549b6e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:23.608335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:23.609855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:23.610808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:23.610808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:23.610808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:23.610808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:23.610808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:23.610808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:23.610808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:23.610808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:23.610808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:23.610808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:23.610808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:23.610808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:23.613807 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 77/161] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:12:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:23.622619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee45b9-60cf-4cfe-b9e8-f1b7f549b6e5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:23.627041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b60e2a-5f62-4a0a-8041-758cc3ec2dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:23.637290 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60e2a-5f62-4a0a-8041-758cc3ec2dcd None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:23.637290 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60e2a-5f62-4a0a-8041-758cc3ec2dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:23.637290 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60e2a-5f62-4a0a-8041-758cc3ec2dcd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:23.644366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b60e2a-5f62-4a0a-8041-758cc3ec2dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-03b60e2a-5f62-4a0a-8041-758cc3ec2dcd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:23.657433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:23.658550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:23.659516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:23.659516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:23.659516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:23.659516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:23.659516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:23.659516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:23.659516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:23.659516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:23.659516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:23.659516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:23.659516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:23.659516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:23.659516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 85/162] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:12:23.670536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b60e2a-5f62-4a0a-8041-758cc3ec2dcd None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:23.841161 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee45b9-60cf-4cfe-b9e8-f1b7f549b6e5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:23.864876 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b60e2a-5f62-4a0a-8041-758cc3ec2dcd None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:23.885872 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c79814-16af-4bc0-9e9f-106f4a108f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:23.886950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c79814-16af-4bc0-9e9f-106f4a108f23 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:23.887435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c79814-16af-4bc0-9e9f-106f4a108f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:23.887912 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c79814-16af-4bc0-9e9f-106f4a108f23 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:23.888842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c79814-16af-4bc0-9e9f-106f4a108f23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:23.889322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c79814-16af-4bc0-9e9f-106f4a108f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:23.891119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c79814-16af-4bc0-9e9f-106f4a108f23 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:23.904936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 78/163] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:12:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:23.908134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517b138-55ef-4ead-bb19-f3ba9b96fef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:23.908920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517b138-55ef-4ead-bb19-f3ba9b96fef2 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:23.909274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517b138-55ef-4ead-bb19-f3ba9b96fef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:23.909620 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517b138-55ef-4ead-bb19-f3ba9b96fef2 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:23.910513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517b138-55ef-4ead-bb19-f3ba9b96fef2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:23.911154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517b138-55ef-4ead-bb19-f3ba9b96fef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:23.911748 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c79814-16af-4bc0-9e9f-106f4a108f23 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:23.912799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517b138-55ef-4ead-bb19-f3ba9b96fef2 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:23.930308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 86/164] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:23.930587 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517b138-55ef-4ead-bb19-f3ba9b96fef2 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:24.111988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517b138-55ef-4ead-bb19-f3ba9b96fef2 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:24.112439 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c79814-16af-4bc0-9e9f-106f4a108f23 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:24.172831 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e4dae-b91c-4113-8016-ebe9e41f5213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:24.173928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e4dae-b91c-4113-8016-ebe9e41f5213 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:24.174206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e4dae-b91c-4113-8016-ebe9e41f5213 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:24.175098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e4dae-b91c-4113-8016-ebe9e41f5213 None admin] PATH_INFO: `/v3/users/1e88330c8d8b49a79c15d2a198869b44` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:24.176928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e4dae-b91c-4113-8016-ebe9e41f5213 None admin] RBAC: Authorizing `identity:get_user(user_id=1e88330c8d8b49a79c15d2a198869b44)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:24.178761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e4dae-b91c-4113-8016-ebe9e41f5213 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:24.187339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 87/165] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:23 2022] GET /identity/v3/users/1e88330c8d8b49a79c15d2a198869b44 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:24.188951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1551a4c-59d3-415b-b798-ba92b3fb0d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:24.190058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1551a4c-59d3-415b-b798-ba92b3fb0d5b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:24.190603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1551a4c-59d3-415b-b798-ba92b3fb0d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:24.191048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1551a4c-59d3-415b-b798-ba92b3fb0d5b None admin] PATH_INFO: `/v3/users/1e88330c8d8b49a79c15d2a198869b44` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:24.193186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e4dae-b91c-4113-8016-ebe9e41f5213 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:24.194083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1551a4c-59d3-415b-b798-ba92b3fb0d5b None admin] RBAC: Authorizing `identity:get_user(user_id=1e88330c8d8b49a79c15d2a198869b44)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:24.195800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1551a4c-59d3-415b-b798-ba92b3fb0d5b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:24.197725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 79/166] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:23 2022] GET /identity/v3/users/1e88330c8d8b49a79c15d2a198869b44 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:24.204942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1551a4c-59d3-415b-b798-ba92b3fb0d5b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:24.362661 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e4dae-b91c-4113-8016-ebe9e41f5213 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:24.432822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1551a4c-59d3-415b-b798-ba92b3fb0d5b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:24.444231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb70546-9acb-4d4b-adbb-787c310f19b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:24.445159 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb70546-9acb-4d4b-adbb-787c310f19b4 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:24.445617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb70546-9acb-4d4b-adbb-787c310f19b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:24.446064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb70546-9acb-4d4b-adbb-787c310f19b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:24.543009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf79f3-44c4-411e-8e8e-7336f8ea75f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:24.544271 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf79f3-44c4-411e-8e8e-7336f8ea75f5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:24.544758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf79f3-44c4-411e-8e8e-7336f8ea75f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:24.545243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf79f3-44c4-411e-8e8e-7336f8ea75f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:24.545518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb70546-9acb-4d4b-adbb-787c310f19b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:24.547423 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb70546-9acb-4d4b-adbb-787c310f19b4 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:24.658569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 88/167] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:12:24.660070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f7af0-1d1a-49c7-b837-27d2d56b2099 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:24.660357 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f7af0-1d1a-49c7-b837-27d2d56b2099 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:24.660635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f7af0-1d1a-49c7-b837-27d2d56b2099 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:24.666799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 89/168] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:24.668098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc20aa-41f6-461a-a4d4-8c3bbc978782 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:24.668388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc20aa-41f6-461a-a4d4-8c3bbc978782 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:24.668670 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc20aa-41f6-461a-a4d4-8c3bbc978782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:24.696856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf79f3-44c4-411e-8e8e-7336f8ea75f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:24.699005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf79f3-44c4-411e-8e8e-7336f8ea75f5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:24.727882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-1edc20aa-41f6-461a-a4d4-8c3bbc978782 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:24.729091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1edc20aa-41f6-461a-a4d4-8c3bbc978782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:24.813782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 80/169] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:12:24.815023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf79f3-44c4-411e-8e8e-7336f8ea75f5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:24.847565 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 90/170] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:24.848485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc20aa-41f6-461a-a4d4-8c3bbc978782 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:24.923767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf79f3-44c4-411e-8e8e-7336f8ea75f5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:24.968254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57e250-15b9-4bbc-b567-50c781977d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:24.970086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57e250-15b9-4bbc-b567-50c781977d1a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:24.970605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57e250-15b9-4bbc-b567-50c781977d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:24.971094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57e250-15b9-4bbc-b567-50c781977d1a None admin] PATH_INFO: `/v3/projects/543d5ab4ea6240c2b0e59e8e91d6e3c1` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:24.972573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57e250-15b9-4bbc-b567-50c781977d1a None admin] RBAC: Authorizing `identity:get_project(project_id=543d5ab4ea6240c2b0e59e8e91d6e3c1)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:24.974254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57e250-15b9-4bbc-b567-50c781977d1a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:24.976203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 81/171] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:24 2022] GET /identity/v3/projects/543d5ab4ea6240c2b0e59e8e91d6e3c1 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:24.977182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57e250-15b9-4bbc-b567-50c781977d1a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:24.982323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc20aa-41f6-461a-a4d4-8c3bbc978782 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:25.018274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db5788-8e70-47b7-a535-d89635127cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:25.019172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db5788-8e70-47b7-a535-d89635127cbb None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.019453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db5788-8e70-47b7-a535-d89635127cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.019743 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db5788-8e70-47b7-a535-d89635127cbb None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.020901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db5788-8e70-47b7-a535-d89635127cbb None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:25.022487 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db5788-8e70-47b7-a535-d89635127cbb None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:25.024194 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 91/172] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:24 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:25.024980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db5788-8e70-47b7-a535-d89635127cbb None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:25.122511 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57e250-15b9-4bbc-b567-50c781977d1a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:25.126789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db5788-8e70-47b7-a535-d89635127cbb None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:25.169019 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245aa54-953d-429d-bf1c-63f757730d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:25.169219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648aedff-9d26-4d82-891c-16930f7d6e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:25.169791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245aa54-953d-429d-bf1c-63f757730d76 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.169969 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aedff-9d26-4d82-891c-16930f7d6e96 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.170066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245aa54-953d-429d-bf1c-63f757730d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.170209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aedff-9d26-4d82-891c-16930f7d6e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.170382 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245aa54-953d-429d-bf1c-63f757730d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.170554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aedff-9d26-4d82-891c-16930f7d6e96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.171931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245aa54-953d-429d-bf1c-63f757730d76 None admin] RBAC: Adding query filter params (role.id=e2401a0c8c204431b0eff57c19186866, scope.project.id=543d5ab4ea6240c2b0e59e8e91d6e3c1, user.id=1e88330c8d8b49a79c15d2a198869b44) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:25.172364 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245aa54-953d-429d-bf1c-63f757730d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:25.173810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245aa54-953d-429d-bf1c-63f757730d76 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:25.180501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 92/173] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:25 2022] GET /identity/v3/role_assignments?user.id=1e88330c8d8b49a79c15d2a198869b44&scope.project.id=543d5ab4ea6240c2b0e59e8e91d6e3c1&role.id=e2401a0c8c204431b0eff57c19186866 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:25.181194 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245aa54-953d-429d-bf1c-63f757730d76 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:25.193193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648aedff-9d26-4d82-891c-16930f7d6e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-648aedff-9d26-4d82-891c-16930f7d6e96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:25.209489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:25.210634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 82/174] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:25.212526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3245-cceb-488c-9d01-7207d45ca637 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.214245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3245-cceb-488c-9d01-7207d45ca637 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.214245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3245-cceb-488c-9d01-7207d45ca637 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.214245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 83/175] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:25.220301 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a86259-87a9-4a69-a3d9-75c9aa0a1d25 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.220539 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a86259-87a9-4a69-a3d9-75c9aa0a1d25 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.220796 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a86259-87a9-4a69-a3d9-75c9aa0a1d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.246761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-37a86259-87a9-4a69-a3d9-75c9aa0a1d25 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:25.248039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-37a86259-87a9-4a69-a3d9-75c9aa0a1d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:25.297541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245aa54-953d-429d-bf1c-63f757730d76 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:25.336959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837da4a4-1dfa-426b-b989-1fa01a77521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:25.337725 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837da4a4-1dfa-426b-b989-1fa01a77521c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.338016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837da4a4-1dfa-426b-b989-1fa01a77521c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.338310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837da4a4-1dfa-426b-b989-1fa01a77521c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.339156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837da4a4-1dfa-426b-b989-1fa01a77521c None admin] RBAC: Adding query filter params (role.id=44468cf4511643498cf7830993b8c9e5, scope.project.id=7192d8f0799049abb47bcece952f59e6, user.id=1e88330c8d8b49a79c15d2a198869b44) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:25.339468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837da4a4-1dfa-426b-b989-1fa01a77521c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:25.340924 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837da4a4-1dfa-426b-b989-1fa01a77521c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:25.348143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 84/176] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:25.348566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 93/177] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:25 2022] GET /identity/v3/role_assignments?user.id=1e88330c8d8b49a79c15d2a198869b44&scope.project.id=7192d8f0799049abb47bcece952f59e6&role.id=44468cf4511643498cf7830993b8c9e5 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:25.348730 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a86259-87a9-4a69-a3d9-75c9aa0a1d25 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:25.393568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837da4a4-1dfa-426b-b989-1fa01a77521c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:25.474412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a86259-87a9-4a69-a3d9-75c9aa0a1d25 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:25.518730 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4dbe6-cc1f-444e-8cfe-d931f2c6cbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:25.519430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4dbe6-cc1f-444e-8cfe-d931f2c6cbbf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.519711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4dbe6-cc1f-444e-8cfe-d931f2c6cbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.519984 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4dbe6-cc1f-444e-8cfe-d931f2c6cbbf None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.520751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4dbe6-cc1f-444e-8cfe-d931f2c6cbbf None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:25.521054 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4dbe6-cc1f-444e-8cfe-d931f2c6cbbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:25.522502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4dbe6-cc1f-444e-8cfe-d931f2c6cbbf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:25.538431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 85/178] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:25.541850 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837da4a4-1dfa-426b-b989-1fa01a77521c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:25.543690 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4dbe6-cc1f-444e-8cfe-d931f2c6cbbf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:25.579629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8ceb6-3fe0-4dab-ae61-d6a5e9a64604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:25.580520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ceb6-3fe0-4dab-ae61-d6a5e9a64604 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.580804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ceb6-3fe0-4dab-ae61-d6a5e9a64604 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.581077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ceb6-3fe0-4dab-ae61-d6a5e9a64604 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.593653 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8ceb6-3fe0-4dab-ae61-d6a5e9a64604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-2af8ceb6-3fe0-4dab-ae61-d6a5e9a64604 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:25.601518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:25.603632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:25.604429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:25.604429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:25.604429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:25.604429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:25.604429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:25.604429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:25.604429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:25.604429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:25.604429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:25.604429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:25.604429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:25.604429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:25.604429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 94/179] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:12:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:25.612656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8ceb6-3fe0-4dab-ae61-d6a5e9a64604 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:25.756138 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4dbe6-cc1f-444e-8cfe-d931f2c6cbbf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:25.794526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8ceb6-3fe0-4dab-ae61-d6a5e9a64604 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:25.813261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329918b-6a33-48a8-bde3-c0461a938b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:25.814382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329918b-6a33-48a8-bde3-c0461a938b85 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.814767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329918b-6a33-48a8-bde3-c0461a938b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.815140 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329918b-6a33-48a8-bde3-c0461a938b85 None admin] PATH_INFO: `/v3/users/1e88330c8d8b49a79c15d2a198869b44` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.816458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329918b-6a33-48a8-bde3-c0461a938b85 None admin] RBAC: Authorizing `identity:get_user(user_id=1e88330c8d8b49a79c15d2a198869b44)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:25.818001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329918b-6a33-48a8-bde3-c0461a938b85 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:25.819780 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 86/180] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:25 2022] GET /identity/v3/users/1e88330c8d8b49a79c15d2a198869b44 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:25.821246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa0e1c-8ac4-40b4-bf2a-d45e022ddd47 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.821646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa0e1c-8ac4-40b4-bf2a-d45e022ddd47 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.822019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa0e1c-8ac4-40b4-bf2a-d45e022ddd47 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.823510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 87/181] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:25.824777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223b22f-ee29-4919-8839-abe1c919b906 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.825209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223b22f-ee29-4919-8839-abe1c919b906 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.825584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223b22f-ee29-4919-8839-abe1c919b906 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.827047 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 88/182] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:25.829653 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223b22f-ee29-4919-8839-abe1c919b906 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:25.842346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf2e92-ee07-42e0-9c15-7abfed7604c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:25.843899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2e92-ee07-42e0-9c15-7abfed7604c4 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.844017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2e92-ee07-42e0-9c15-7abfed7604c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.844220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2e92-ee07-42e0-9c15-7abfed7604c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.844979 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf2e92-ee07-42e0-9c15-7abfed7604c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:25.845281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf2e92-ee07-42e0-9c15-7abfed7604c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:25.846769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf2e92-ee07-42e0-9c15-7abfed7604c4 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:25.856106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 95/183] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:25.857619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a1e0-3322-456a-bed2-092dc9f08d94 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.858007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a1e0-3322-456a-bed2-092dc9f08d94 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.858459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a1e0-3322-456a-bed2-092dc9f08d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.879053 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6567a1e0-3322-456a-bed2-092dc9f08d94 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:25.880245 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6567a1e0-3322-456a-bed2-092dc9f08d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:25.941585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223b22f-ee29-4919-8839-abe1c919b906 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:25.950458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 96/184] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:25.950458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5053-7e26-4aba-ba6a-095dc92fa34b None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.950458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5053-7e26-4aba-ba6a-095dc92fa34b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.950458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5053-7e26-4aba-ba6a-095dc92fa34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:25.966845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-cc4b5053-7e26-4aba-ba6a-095dc92fa34b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:25.968063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-cc4b5053-7e26-4aba-ba6a-095dc92fa34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:25.978991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcec94d-8506-4d42-8e15-64b3a5ae1ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:25.979646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcec94d-8506-4d42-8e15-64b3a5ae1ddc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:25.979925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcec94d-8506-4d42-8e15-64b3a5ae1ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:25.980203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcec94d-8506-4d42-8e15-64b3a5ae1ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:26.033018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 97/185] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:26.034846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5053-7e26-4aba-ba6a-095dc92fa34b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:26.049854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcec94d-8506-4d42-8e15-64b3a5ae1ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:26.051340 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcec94d-8506-4d42-8e15-64b3a5ae1ddc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:26.129610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5053-7e26-4aba-ba6a-095dc92fa34b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:26.144240 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 89/186] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:26.145075 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcec94d-8506-4d42-8e15-64b3a5ae1ddc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:26.163159 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7912bd-1f2e-4a50-b057-6873a72fbd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:26.164043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7912bd-1f2e-4a50-b057-6873a72fbd24 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:26.164327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7912bd-1f2e-4a50-b057-6873a72fbd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:26.164601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7912bd-1f2e-4a50-b057-6873a72fbd24 None admin] PATH_INFO: `/v3/users/f04220f7cb99438c9a6f081cf43ff2d8` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:26.177259 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7912bd-1f2e-4a50-b057-6873a72fbd24 None admin] RBAC: Authorizing `identity:get_user(user_id=f04220f7cb99438c9a6f081cf43ff2d8)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:26.178750 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7912bd-1f2e-4a50-b057-6873a72fbd24 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:26.180401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 98/187] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:26 2022] GET /identity/v3/users/f04220f7cb99438c9a6f081cf43ff2d8 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:26.181602 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04a6f8-b4d1-48b1-81c9-e02ecba4da0c None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:26.181885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04a6f8-b4d1-48b1-81c9-e02ecba4da0c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:26.182159 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04a6f8-b4d1-48b1-81c9-e02ecba4da0c None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:26.183587 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 99/188] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:26.184104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04a6f8-b4d1-48b1-81c9-e02ecba4da0c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:26.240392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcec94d-8506-4d42-8e15-64b3a5ae1ddc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:26.272909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e57f3-5440-48f6-baa5-9bb43564dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:26.273696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e57f3-5440-48f6-baa5-9bb43564dc31 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:26.273974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e57f3-5440-48f6-baa5-9bb43564dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:26.274245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e57f3-5440-48f6-baa5-9bb43564dc31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:26.284052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e57f3-5440-48f6-baa5-9bb43564dc31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:26.287420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04a6f8-b4d1-48b1-81c9-e02ecba4da0c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b05e57f3-5440-48f6-baa5-9bb43564dc31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:26.291854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:26.292845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:26.293899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:26.293899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:26.293899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:26.293899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:26.293899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:26.293899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:26.293899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:26.293899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:26.293899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:26.293899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:26.293899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:26.293899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:26.293899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 90/189] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:26.295177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e57f3-5440-48f6-baa5-9bb43564dc31 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:26.321161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e5471-47a2-4a99-acbc-222501168dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:26.321968 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5471-47a2-4a99-acbc-222501168dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:26.322248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5471-47a2-4a99-acbc-222501168dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:26.322563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5471-47a2-4a99-acbc-222501168dc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:26.332848 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e5471-47a2-4a99-acbc-222501168dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-0f7e5471-47a2-4a99-acbc-222501168dc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:26.340946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:26.341980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:26.342839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:26.342839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:26.342839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:26.342839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:26.342839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:26.342839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:26.342839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:26.342839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:26.342839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:26.342839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:26.342839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:26.342839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:26.342839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 100/190] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:12:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:26.343505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e5471-47a2-4a99-acbc-222501168dc4 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:26.398813 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e57f3-5440-48f6-baa5-9bb43564dc31 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:26.436056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab92f1d-af70-4dd8-990f-68e828317c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:26.437961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab92f1d-af70-4dd8-990f-68e828317c22 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:26.438246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab92f1d-af70-4dd8-990f-68e828317c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:26.438554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab92f1d-af70-4dd8-990f-68e828317c22 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:26.438875 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e5471-47a2-4a99-acbc-222501168dc4 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:26.439740 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab92f1d-af70-4dd8-990f-68e828317c22 None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:26.441209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab92f1d-af70-4dd8-990f-68e828317c22 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:26.442951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 91/191] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:26 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:26.444104 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e54cd2-e5c5-4a05-9a44-09785a917bda None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:26.444388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e54cd2-e5c5-4a05-9a44-09785a917bda None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:26.444662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e54cd2-e5c5-4a05-9a44-09785a917bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:26.460697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-71e54cd2-e5c5-4a05-9a44-09785a917bda None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:26.461883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-71e54cd2-e5c5-4a05-9a44-09785a917bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:26.470732 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004916b-1360-414a-b6c6-3f7ed758b60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:26.471385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004916b-1360-414a-b6c6-3f7ed758b60f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:26.471666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004916b-1360-414a-b6c6-3f7ed758b60f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:26.471940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004916b-1360-414a-b6c6-3f7ed758b60f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:26.526354 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 92/192] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:26.528110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e54cd2-e5c5-4a05-9a44-09785a917bda None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:26.536015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004916b-1360-414a-b6c6-3f7ed758b60f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:26.537453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004916b-1360-414a-b6c6-3f7ed758b60f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:26.622894 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e54cd2-e5c5-4a05-9a44-09785a917bda None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:26.630945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 101/193] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:26.633335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004916b-1360-414a-b6c6-3f7ed758b60f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:26.660319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cdae5-d093-4ff3-ad51-50da2012cb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:26.661250 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cdae5-d093-4ff3-ad51-50da2012cb1c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:26.661530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cdae5-d093-4ff3-ad51-50da2012cb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:26.661801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cdae5-d093-4ff3-ad51-50da2012cb1c None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:26.662733 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cdae5-d093-4ff3-ad51-50da2012cb1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:26.667710 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cdae5-d093-4ff3-ad51-50da2012cb1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:26.667710 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cdae5-d093-4ff3-ad51-50da2012cb1c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:26.672947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 93/194] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:26.673739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cdae5-d093-4ff3-ad51-50da2012cb1c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:26.735918 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004916b-1360-414a-b6c6-3f7ed758b60f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:26.768548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c5edb-37ca-41e9-a602-98259f4038b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:26.769217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c5edb-37ca-41e9-a602-98259f4038b8 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:26.769499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c5edb-37ca-41e9-a602-98259f4038b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:26.769776 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c5edb-37ca-41e9-a602-98259f4038b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:26.770103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cdae5-d093-4ff3-ad51-50da2012cb1c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:26.770631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c5edb-37ca-41e9-a602-98259f4038b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:26.770938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c5edb-37ca-41e9-a602-98259f4038b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:26.772358 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c5edb-37ca-41e9-a602-98259f4038b8 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:26.780034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 102/195] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:12:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:26.781748 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c5edb-37ca-41e9-a602-98259f4038b8 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:26.803006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68a720-76b6-4e3a-afd0-91bd4537f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:26.803595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68a720-76b6-4e3a-afd0-91bd4537f873 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:26.803881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68a720-76b6-4e3a-afd0-91bd4537f873 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:26.804160 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68a720-76b6-4e3a-afd0-91bd4537f873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:26.804982 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68a720-76b6-4e3a-afd0-91bd4537f873 None admin] RBAC: Adding query filter params (role.id=e2401a0c8c204431b0eff57c19186866, scope.project.id=7192d8f0799049abb47bcece952f59e6, user.id=1e88330c8d8b49a79c15d2a198869b44) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:26.805323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68a720-76b6-4e3a-afd0-91bd4537f873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:26.806760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68a720-76b6-4e3a-afd0-91bd4537f873 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:26.812944 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 94/196] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:26 2022] GET /identity/v3/role_assignments?user.id=1e88330c8d8b49a79c15d2a198869b44&scope.project.id=7192d8f0799049abb47bcece952f59e6&role.id=e2401a0c8c204431b0eff57c19186866 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:26.813731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68a720-76b6-4e3a-afd0-91bd4537f873 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:26.888246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c5edb-37ca-41e9-a602-98259f4038b8 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:26.920580 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68a720-76b6-4e3a-afd0-91bd4537f873 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:26.933410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4339e-6a1a-4b6c-9d1f-e76f05823873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:26.934241 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4339e-6a1a-4b6c-9d1f-e76f05823873 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:26.934556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4339e-6a1a-4b6c-9d1f-e76f05823873 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:26.934885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4339e-6a1a-4b6c-9d1f-e76f05823873 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:26.936075 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4339e-6a1a-4b6c-9d1f-e76f05823873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:26.938093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4339e-6a1a-4b6c-9d1f-e76f05823873 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:26.944489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 103/197] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:12:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:26.944489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4339e-6a1a-4b6c-9d1f-e76f05823873 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:26.962785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac04e7a-3ec2-47da-9298-972824d36d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:26.963681 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac04e7a-3ec2-47da-9298-972824d36d5d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:26.963974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac04e7a-3ec2-47da-9298-972824d36d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:26.964255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac04e7a-3ec2-47da-9298-972824d36d5d None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:26.965528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac04e7a-3ec2-47da-9298-972824d36d5d None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:26.967085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac04e7a-3ec2-47da-9298-972824d36d5d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:26.969183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 95/198] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:26 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:26.970002 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac04e7a-3ec2-47da-9298-972824d36d5d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:27.067829 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4339e-6a1a-4b6c-9d1f-e76f05823873 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:27.083019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac04e7a-3ec2-47da-9298-972824d36d5d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:27.101031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79e7f8-e209-408e-89c2-a6aaa83012e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:27.102000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79e7f8-e209-408e-89c2-a6aaa83012e7 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:27.102378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79e7f8-e209-408e-89c2-a6aaa83012e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:27.102724 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79e7f8-e209-408e-89c2-a6aaa83012e7 None admin] PATH_INFO: `/v3/users/36dc27a599a94fd49430f058307bf7e4` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:27.103961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79e7f8-e209-408e-89c2-a6aaa83012e7 None admin] RBAC: Authorizing `identity:get_user(user_id=36dc27a599a94fd49430f058307bf7e4)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:27.105418 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79e7f8-e209-408e-89c2-a6aaa83012e7 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:27.107065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 104/199] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:26 2022] GET /identity/v3/users/36dc27a599a94fd49430f058307bf7e4 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:27.109133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79e7f8-e209-408e-89c2-a6aaa83012e7 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:27.117813 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903b38e-2ad4-4dd9-a6f3-33c249938c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:27.118731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903b38e-2ad4-4dd9-a6f3-33c249938c48 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:27.119016 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903b38e-2ad4-4dd9-a6f3-33c249938c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:27.119295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903b38e-2ad4-4dd9-a6f3-33c249938c48 None admin] PATH_INFO: `/v3/users/f04220f7cb99438c9a6f081cf43ff2d8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:27.120488 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903b38e-2ad4-4dd9-a6f3-33c249938c48 None admin] RBAC: Authorizing `identity:get_user(user_id=f04220f7cb99438c9a6f081cf43ff2d8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:27.121934 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903b38e-2ad4-4dd9-a6f3-33c249938c48 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:27.128699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 96/200] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:26 2022] GET /identity/v3/users/f04220f7cb99438c9a6f081cf43ff2d8 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:27.128699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903b38e-2ad4-4dd9-a6f3-33c249938c48 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:27.208799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79e7f8-e209-408e-89c2-a6aaa83012e7 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:27.218778 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903b38e-2ad4-4dd9-a6f3-33c249938c48 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:27.240749 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5e2c3-1218-48b9-a2ff-930e7a11c8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:27.241423 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e2c3-1218-48b9-a2ff-930e7a11c8b4 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:27.241703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e2c3-1218-48b9-a2ff-930e7a11c8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:27.241979 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e2c3-1218-48b9-a2ff-930e7a11c8b4 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:27.242719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5e2c3-1218-48b9-a2ff-930e7a11c8b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:27.244164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5e2c3-1218-48b9-a2ff-930e7a11c8b4 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:27.250564 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12503d77-4c10-4518-83c7-2718e5cb3de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:27.251213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12503d77-4c10-4518-83c7-2718e5cb3de1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:27.251493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12503d77-4c10-4518-83c7-2718e5cb3de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:27.251768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12503d77-4c10-4518-83c7-2718e5cb3de1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:27.252591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12503d77-4c10-4518-83c7-2718e5cb3de1 None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=ab41116bb62b44b9bd7c18431c0286a3, user.id=f04220f7cb99438c9a6f081cf43ff2d8) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:27.252901 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12503d77-4c10-4518-83c7-2718e5cb3de1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:27.254348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12503d77-4c10-4518-83c7-2718e5cb3de1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:27.259711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 97/201] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:27 2022] GET /identity/v3/role_assignments?user.id=f04220f7cb99438c9a6f081cf43ff2d8&scope.project.id=ab41116bb62b44b9bd7c18431c0286a3&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:27.274546 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12503d77-4c10-4518-83c7-2718e5cb3de1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:27.362563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 105/202] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:12:27 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:27.363340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5e2c3-1218-48b9-a2ff-930e7a11c8b4 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:27.380611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12503d77-4c10-4518-83c7-2718e5cb3de1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:27.424349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7beadc-e194-4694-b12e-2a9b06629900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:27.425413 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7beadc-e194-4694-b12e-2a9b06629900 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:27.425898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7beadc-e194-4694-b12e-2a9b06629900 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:27.426467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7beadc-e194-4694-b12e-2a9b06629900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:27.510170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5e2c3-1218-48b9-a2ff-930e7a11c8b4 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:27.510917 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7beadc-e194-4694-b12e-2a9b06629900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:27.512628 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7beadc-e194-4694-b12e-2a9b06629900 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:27.551751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06106cc-df5a-4759-894d-3b45c0bf0d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:27.552413 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06106cc-df5a-4759-894d-3b45c0bf0d0f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:27.552694 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06106cc-df5a-4759-894d-3b45c0bf0d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:27.552966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06106cc-df5a-4759-894d-3b45c0bf0d0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:27.632508 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 98/203] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:27.633842 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06106cc-df5a-4759-894d-3b45c0bf0d0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:27.635372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7beadc-e194-4694-b12e-2a9b06629900 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:27.636226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06106cc-df5a-4759-894d-3b45c0bf0d0f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:27.743291 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7beadc-e194-4694-b12e-2a9b06629900 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:27.781398 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadb7b1-1a52-4be4-bcf4-312a7dab42b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:27.782320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadb7b1-1a52-4be4-bcf4-312a7dab42b2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:27.782608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadb7b1-1a52-4be4-bcf4-312a7dab42b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:27.782889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadb7b1-1a52-4be4-bcf4-312a7dab42b2 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:27.784141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadb7b1-1a52-4be4-bcf4-312a7dab42b2 None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:27.785041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 106/204] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:27.789909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadb7b1-1a52-4be4-bcf4-312a7dab42b2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:27.789909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 99/205] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:27 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:27.791486 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadb7b1-1a52-4be4-bcf4-312a7dab42b2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:27.795174 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06106cc-df5a-4759-894d-3b45c0bf0d0f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:27.892233 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadb7b1-1a52-4be4-bcf4-312a7dab42b2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:27.904244 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06106cc-df5a-4759-894d-3b45c0bf0d0f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:27.927176 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6585ce-bc02-4198-8c95-7f5f239e23cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:27.928337 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6585ce-bc02-4198-8c95-7f5f239e23cc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:27.928616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6585ce-bc02-4198-8c95-7f5f239e23cc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:27.928887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6585ce-bc02-4198-8c95-7f5f239e23cc None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:27.930124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6585ce-bc02-4198-8c95-7f5f239e23cc None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:27.931607 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6585ce-bc02-4198-8c95-7f5f239e23cc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:27.938390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 100/206] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:27 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:27.939744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6585ce-bc02-4198-8c95-7f5f239e23cc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:27.943344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf2f1c-8280-455a-bc88-e6222c6cec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:27.944434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf2f1c-8280-455a-bc88-e6222c6cec60 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:27.944922 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf2f1c-8280-455a-bc88-e6222c6cec60 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:27.945397 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf2f1c-8280-455a-bc88-e6222c6cec60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:27.946461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf2f1c-8280-455a-bc88-e6222c6cec60 None admin] RBAC: Adding query filter params (role.id=a4ca52325cbd4f7192e085966d529a71, scope.project.id=7192d8f0799049abb47bcece952f59e6, user.id=36dc27a599a94fd49430f058307bf7e4) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:27.947015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf2f1c-8280-455a-bc88-e6222c6cec60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:27.948686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf2f1c-8280-455a-bc88-e6222c6cec60 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:27.957343 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 107/207] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:27 2022] GET /identity/v3/role_assignments?user.id=36dc27a599a94fd49430f058307bf7e4&scope.project.id=7192d8f0799049abb47bcece952f59e6&role.id=a4ca52325cbd4f7192e085966d529a71 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:28.047834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6585ce-bc02-4198-8c95-7f5f239e23cc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:28.084775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab55b5-5852-44b0-b1f9-d2d3fac54876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:28.085864 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab55b5-5852-44b0-b1f9-d2d3fac54876 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:28.086379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab55b5-5852-44b0-b1f9-d2d3fac54876 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:28.086866 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab55b5-5852-44b0-b1f9-d2d3fac54876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:28.087947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab55b5-5852-44b0-b1f9-d2d3fac54876 None admin] RBAC: Adding query filter params (role.id=44468cf4511643498cf7830993b8c9e5, scope.project.id=ab41116bb62b44b9bd7c18431c0286a3, user.id=f04220f7cb99438c9a6f081cf43ff2d8) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:28.088475 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab55b5-5852-44b0-b1f9-d2d3fac54876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:28.090182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab55b5-5852-44b0-b1f9-d2d3fac54876 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:28.097022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 101/208] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:27 2022] GET /identity/v3/role_assignments?user.id=f04220f7cb99438c9a6f081cf43ff2d8&scope.project.id=ab41116bb62b44b9bd7c18431c0286a3&role.id=44468cf4511643498cf7830993b8c9e5 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:29.670884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e278b0-0ed7-4be4-b4a8-dfc9b8b79a7f None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:29.671901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e278b0-0ed7-4be4-b4a8-dfc9b8b79a7f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:29.672041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e278b0-0ed7-4be4-b4a8-dfc9b8b79a7f None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:29.673779 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 108/209] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:29.679321 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f099a4-ff3a-4bd0-8f24-d3d8ba495c88 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:29.679728 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f099a4-ff3a-4bd0-8f24-d3d8ba495c88 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:29.679914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f099a4-ff3a-4bd0-8f24-d3d8ba495c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:29.697194 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c4f099a4-ff3a-4bd0-8f24-d3d8ba495c88 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:29.698432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c4f099a4-ff3a-4bd0-8f24-d3d8ba495c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:29.779148 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 102/210] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:29.804077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e278b0-0ed7-4be4-b4a8-dfc9b8b79a7f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:29.913600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e278b0-0ed7-4be4-b4a8-dfc9b8b79a7f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:29.948647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961e303-30a4-41d4-a8cb-c40d64cb0faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:29.949375 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e303-30a4-41d4-a8cb-c40d64cb0faf None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:29.949657 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e303-30a4-41d4-a8cb-c40d64cb0faf None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:29.949937 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e303-30a4-41d4-a8cb-c40d64cb0faf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:29.960485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961e303-30a4-41d4-a8cb-c40d64cb0faf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-1961e303-30a4-41d4-a8cb-c40d64cb0faf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:29.968826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:29.971026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:29.973368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:29.973368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:29.973368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:29.973368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:29.973368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:29.973368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:29.973368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:29.973368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:29.973368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:29.973368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:29.973368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:29.973368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:29.973368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 109/211] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:29.982328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f099a4-ff3a-4bd0-8f24-d3d8ba495c88 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:30.066399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e768fd8-7f14-4980-905f-23217ed67a9c None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.066726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e768fd8-7f14-4980-905f-23217ed67a9c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.066952 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e768fd8-7f14-4980-905f-23217ed67a9c None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.068826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 110/212] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:30.079862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0305275-b5a4-4982-832d-2e76f733af4d None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.080623 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0305275-b5a4-4982-832d-2e76f733af4d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.081027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0305275-b5a4-4982-832d-2e76f733af4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.085946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f099a4-ff3a-4bd0-8f24-d3d8ba495c88 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:30.101989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b0305275-b5a4-4982-832d-2e76f733af4d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:30.103875 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b0305275-b5a4-4982-832d-2e76f733af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:30.125873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a242d0d-fb2e-4fa4-a492-86a810fab6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:30.126750 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a242d0d-fb2e-4fa4-a492-86a810fab6cf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.127353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a242d0d-fb2e-4fa4-a492-86a810fab6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.127635 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a242d0d-fb2e-4fa4-a492-86a810fab6cf None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.128395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a242d0d-fb2e-4fa4-a492-86a810fab6cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:30.128708 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a242d0d-fb2e-4fa4-a492-86a810fab6cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:30.130591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a242d0d-fb2e-4fa4-a492-86a810fab6cf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:30.141919 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 103/213] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:30.148107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a242d0d-fb2e-4fa4-a492-86a810fab6cf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:30.183552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 111/214] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:30.185016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdf61b-839c-4f2e-b77b-c85eaf7d8648 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.185371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdf61b-839c-4f2e-b77b-c85eaf7d8648 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.185725 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdf61b-839c-4f2e-b77b-c85eaf7d8648 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.191027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 112/215] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:30.192368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae8f2a-12cd-4f43-9231-873d06468eae None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.192651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae8f2a-12cd-4f43-9231-873d06468eae None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.192924 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae8f2a-12cd-4f43-9231-873d06468eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.215843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-3bae8f2a-12cd-4f43-9231-873d06468eae None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:30.216950 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-3bae8f2a-12cd-4f43-9231-873d06468eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:30.264101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a242d0d-fb2e-4fa4-a492-86a810fab6cf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:30.287016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 113/216] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:30.287730 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae8f2a-12cd-4f43-9231-873d06468eae None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:30.311197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7bff2-8b22-40cc-b6c3-4a11783c7f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:30.312764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7bff2-8b22-40cc-b6c3-4a11783c7f16 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.313057 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7bff2-8b22-40cc-b6c3-4a11783c7f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.313337 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7bff2-8b22-40cc-b6c3-4a11783c7f16 None admin] PATH_INFO: `/v3/users/f04220f7cb99438c9a6f081cf43ff2d8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.314734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7bff2-8b22-40cc-b6c3-4a11783c7f16 None admin] RBAC: Authorizing `identity:get_user(user_id=f04220f7cb99438c9a6f081cf43ff2d8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:30.316278 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7bff2-8b22-40cc-b6c3-4a11783c7f16 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:30.318142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 104/217] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:30 2022] GET /identity/v3/users/f04220f7cb99438c9a6f081cf43ff2d8 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:30.323283 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7bff2-8b22-40cc-b6c3-4a11783c7f16 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:30.391328 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae8f2a-12cd-4f43-9231-873d06468eae None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:30.424243 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7741880-f69c-4335-983b-352dcd1d2790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:30.425052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7741880-f69c-4335-983b-352dcd1d2790 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.425346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7741880-f69c-4335-983b-352dcd1d2790 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.425621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7741880-f69c-4335-983b-352dcd1d2790 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.427585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7bff2-8b22-40cc-b6c3-4a11783c7f16 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:30.435517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7741880-f69c-4335-983b-352dcd1d2790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-e7741880-f69c-4335-983b-352dcd1d2790 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:30.443420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:30.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 114/218] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:30.447041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7741880-f69c-4335-983b-352dcd1d2790 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:30.467330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb1cb4-1433-4710-8f28-37aa182d4cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:30.468154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb1cb4-1433-4710-8f28-37aa182d4cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.468436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb1cb4-1433-4710-8f28-37aa182d4cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.468736 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb1cb4-1433-4710-8f28-37aa182d4cd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.469966 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb1cb4-1433-4710-8f28-37aa182d4cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:30.471476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb1cb4-1433-4710-8f28-37aa182d4cd8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:30.473094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 105/219] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:12:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:30.478175 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb1cb4-1433-4710-8f28-37aa182d4cd8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:30.542922 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7741880-f69c-4335-983b-352dcd1d2790 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:30.573975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb1cb4-1433-4710-8f28-37aa182d4cd8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:30.575324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f7f2e-4dd5-4628-a691-4acbd8012af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:30.576189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f7f2e-4dd5-4628-a691-4acbd8012af9 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.576474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f7f2e-4dd5-4628-a691-4acbd8012af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.576752 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f7f2e-4dd5-4628-a691-4acbd8012af9 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.578829 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f7f2e-4dd5-4628-a691-4acbd8012af9 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:30.580385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f7f2e-4dd5-4628-a691-4acbd8012af9 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:30.582246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 115/220] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:30 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:30.582859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f7f2e-4dd5-4628-a691-4acbd8012af9 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:30.610520 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70eceb-4356-4120-a0bc-2cfc4465f655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:30.611198 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70eceb-4356-4120-a0bc-2cfc4465f655 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.611484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70eceb-4356-4120-a0bc-2cfc4465f655 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.611771 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70eceb-4356-4120-a0bc-2cfc4465f655 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.612514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70eceb-4356-4120-a0bc-2cfc4465f655 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:30.612824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70eceb-4356-4120-a0bc-2cfc4465f655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:30.614201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70eceb-4356-4120-a0bc-2cfc4465f655 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:30.622061 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 106/221] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:30.624804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bdba5-09b4-4040-acf6-9fe24a791937 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.625100 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bdba5-09b4-4040-acf6-9fe24a791937 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.625384 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bdba5-09b4-4040-acf6-9fe24a791937 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.626776 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 107/222] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:30.631434 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bdba5-09b4-4040-acf6-9fe24a791937 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:30.679984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f7f2e-4dd5-4628-a691-4acbd8012af9 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:30.712543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0729cf-8103-4ae0-9160-c2064df1b1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:30.713392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0729cf-8103-4ae0-9160-c2064df1b1be None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.713590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0729cf-8103-4ae0-9160-c2064df1b1be None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.713866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0729cf-8103-4ae0-9160-c2064df1b1be None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.714615 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0729cf-8103-4ae0-9160-c2064df1b1be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:30.716061 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0729cf-8103-4ae0-9160-c2064df1b1be None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:30.725659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bdba5-09b4-4040-acf6-9fe24a791937 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:30.756633 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25e705-f59d-40d7-89d7-b2bbc7931ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:30.757534 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e705-f59d-40d7-89d7-b2bbc7931ed8 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.757817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e705-f59d-40d7-89d7-b2bbc7931ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.758098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e705-f59d-40d7-89d7-b2bbc7931ed8 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3/users/f04220f7cb99438c9a6f081cf43ff2d8/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.760153 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25e705-f59d-40d7-89d7-b2bbc7931ed8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab41116bb62b44b9bd7c18431c0286a3, user_id=f04220f7cb99438c9a6f081cf43ff2d8, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:30.761586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25e705-f59d-40d7-89d7-b2bbc7931ed8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:30.834530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 116/223] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:12:30 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:30.835364 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0729cf-8103-4ae0-9160-c2064df1b1be None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:30.865334 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 108/224] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:12:30 2022] PUT /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3/users/f04220f7cb99438c9a6f081cf43ff2d8/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:30.866618 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe133ee-2aea-4357-b921-393ff354513a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:30.866915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe133ee-2aea-4357-b921-393ff354513a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:30.867200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe133ee-2aea-4357-b921-393ff354513a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:30.885241 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-efe133ee-2aea-4357-b921-393ff354513a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:30.886572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-efe133ee-2aea-4357-b921-393ff354513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:30.972816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0729cf-8103-4ae0-9160-c2064df1b1be None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:30.982859 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 109/225] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:31.005959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe133ee-2aea-4357-b921-393ff354513a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:31.014238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc8161-a0ac-4397-8e73-41d484b822bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:31.015733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc8161-a0ac-4397-8e73-41d484b822bf None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:31.016014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc8161-a0ac-4397-8e73-41d484b822bf None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:31.016293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc8161-a0ac-4397-8e73-41d484b822bf None admin] PATH_INFO: `/v3/users/da536919a5b6458eaca614ea8d6d37c2` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:31.032430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc8161-a0ac-4397-8e73-41d484b822bf None admin] RBAC: Authorizing `identity:get_user(user_id=da536919a5b6458eaca614ea8d6d37c2)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:31.033967 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc8161-a0ac-4397-8e73-41d484b822bf None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:31.036508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 117/226] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:30 2022] GET /identity/v3/users/da536919a5b6458eaca614ea8d6d37c2 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:31.041772 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc8161-a0ac-4397-8e73-41d484b822bf None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:31.144555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe133ee-2aea-4357-b921-393ff354513a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:31.176065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc8161-a0ac-4397-8e73-41d484b822bf None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:31.196094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ecfb0-820f-444f-9ee9-6a3e07f273f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:31.196945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ecfb0-820f-444f-9ee9-6a3e07f273f9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:31.197221 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ecfb0-820f-444f-9ee9-6a3e07f273f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:31.197493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ecfb0-820f-444f-9ee9-6a3e07f273f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:31.212873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01351d08-ab09-4a2e-85d2-bd53b6865729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:31.213372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ecfb0-820f-444f-9ee9-6a3e07f273f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:31.213478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01351d08-ab09-4a2e-85d2-bd53b6865729 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:31.213741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01351d08-ab09-4a2e-85d2-bd53b6865729 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:31.214016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01351d08-ab09-4a2e-85d2-bd53b6865729 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-8f5ecfb0-820f-444f-9ee9-6a3e07f273f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:31.222822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:31.224063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:31.224850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:31.224850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:31.224850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:31.224850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:31.224850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:31.224850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:31.224850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:31.224850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:31.224850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:31.224850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:31.224850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:31.224850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:31.226346 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 110/227] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:12:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:12:31.230523 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ecfb0-820f-444f-9ee9-6a3e07f273f9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:31.306617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01351d08-ab09-4a2e-85d2-bd53b6865729 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:31.308752 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01351d08-ab09-4a2e-85d2-bd53b6865729 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:31.356651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ecfb0-820f-444f-9ee9-6a3e07f273f9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:31.392672 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9784731-8105-44eb-af99-a31290d48883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:31.393346 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9784731-8105-44eb-af99-a31290d48883 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:31.393624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9784731-8105-44eb-af99-a31290d48883 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:31.393899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9784731-8105-44eb-af99-a31290d48883 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:31.394685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9784731-8105-44eb-af99-a31290d48883 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:31.394990 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9784731-8105-44eb-af99-a31290d48883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:31.396376 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9784731-8105-44eb-af99-a31290d48883 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:31.404616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 111/228] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:12:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:31.411385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9784731-8105-44eb-af99-a31290d48883 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:31.420499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 118/229] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:12:31.426410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01351d08-ab09-4a2e-85d2-bd53b6865729 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:31.516943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9784731-8105-44eb-af99-a31290d48883 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:31.529102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01351d08-ab09-4a2e-85d2-bd53b6865729 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:31.553621 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2045e4-4f12-4dff-a4dc-0ca517fb448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:31.554882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2045e4-4f12-4dff-a4dc-0ca517fb448c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:31.555170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2045e4-4f12-4dff-a4dc-0ca517fb448c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:31.555445 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2045e4-4f12-4dff-a4dc-0ca517fb448c None admin] PATH_INFO: `/v3/users/f04220f7cb99438c9a6f081cf43ff2d8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:31.557141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2045e4-4f12-4dff-a4dc-0ca517fb448c None admin] RBAC: Authorizing `identity:get_user(user_id=f04220f7cb99438c9a6f081cf43ff2d8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:31.558863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2045e4-4f12-4dff-a4dc-0ca517fb448c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:31.565522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699f14d-2266-4af1-b37b-b7658baa8851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:31.566573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 112/230] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:31 2022] GET /identity/v3/users/f04220f7cb99438c9a6f081cf43ff2d8 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:31.567025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f14d-2266-4af1-b37b-b7658baa8851 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:31.567501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f14d-2266-4af1-b37b-b7658baa8851 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:31.567851 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2045e4-4f12-4dff-a4dc-0ca517fb448c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:31.568195 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f14d-2266-4af1-b37b-b7658baa8851 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:31.569707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699f14d-2266-4af1-b37b-b7658baa8851 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:31.571428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699f14d-2266-4af1-b37b-b7658baa8851 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:31.574335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 119/231] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:31 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:31.587233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699f14d-2266-4af1-b37b-b7658baa8851 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:31.680959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2045e4-4f12-4dff-a4dc-0ca517fb448c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:31.728446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360b084-fcae-47de-b4bd-f0a753bb7d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:31.729315 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360b084-fcae-47de-b4bd-f0a753bb7d93 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:31.729598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360b084-fcae-47de-b4bd-f0a753bb7d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:31.729939 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360b084-fcae-47de-b4bd-f0a753bb7d93 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:31.734412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360b084-fcae-47de-b4bd-f0a753bb7d93 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:31.735844 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360b084-fcae-47de-b4bd-f0a753bb7d93 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:31.737518 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 113/232] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:31 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:31.743285 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360b084-fcae-47de-b4bd-f0a753bb7d93 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:31.752106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699f14d-2266-4af1-b37b-b7658baa8851 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:31.802977 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f66bd-47a6-45b4-b97d-cb045959dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:31.804052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f66bd-47a6-45b4-b97d-cb045959dff8 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:31.804535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f66bd-47a6-45b4-b97d-cb045959dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:31.805012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f66bd-47a6-45b4-b97d-cb045959dff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:31.806044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f66bd-47a6-45b4-b97d-cb045959dff8 None admin] RBAC: Adding query filter params (role.id=e2401a0c8c204431b0eff57c19186866, scope.project.id=ab41116bb62b44b9bd7c18431c0286a3, user.id=da536919a5b6458eaca614ea8d6d37c2) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:31.806592 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f66bd-47a6-45b4-b97d-cb045959dff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:31.808293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f66bd-47a6-45b4-b97d-cb045959dff8 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:31.814551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 120/233] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:31 2022] GET /identity/v3/role_assignments?user.id=da536919a5b6458eaca614ea8d6d37c2&scope.project.id=ab41116bb62b44b9bd7c18431c0286a3&role.id=e2401a0c8c204431b0eff57c19186866 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:31.870208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360b084-fcae-47de-b4bd-f0a753bb7d93 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:31.906127 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eb1c9-cda9-44d5-aa31-5c3b10f9e99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:31.907056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eb1c9-cda9-44d5-aa31-5c3b10f9e99e None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:31.907336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eb1c9-cda9-44d5-aa31-5c3b10f9e99e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:31.907607 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eb1c9-cda9-44d5-aa31-5c3b10f9e99e None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3/users/f04220f7cb99438c9a6f081cf43ff2d8/roles/44468cf4511643498cf7830993b8c9e5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:31.909940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eb1c9-cda9-44d5-aa31-5c3b10f9e99e None admin] RBAC: Authorizing `identity:create_grant(project_id=ab41116bb62b44b9bd7c18431c0286a3, user_id=f04220f7cb99438c9a6f081cf43ff2d8, role_id=44468cf4511643498cf7830993b8c9e5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:31.911772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eb1c9-cda9-44d5-aa31-5c3b10f9e99e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:32.030058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 114/234] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:12:31 2022] PUT /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3/users/f04220f7cb99438c9a6f081cf43ff2d8/roles/44468cf4511643498cf7830993b8c9e5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:12:33.690891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7c3ea-8852-4173-8b7f-a7de68c48e99 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:33.691906 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7c3ea-8852-4173-8b7f-a7de68c48e99 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:33.692408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7c3ea-8852-4173-8b7f-a7de68c48e99 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:33.694103 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 121/235] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:33.700232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dbdc5-8cc6-4537-8b83-f026af1050b7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:33.703377 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dbdc5-8cc6-4537-8b83-f026af1050b7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:33.703377 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dbdc5-8cc6-4537-8b83-f026af1050b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:33.762934 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d409e1-7fdd-46df-85ef-ad72f61c302b None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:33.763841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d409e1-7fdd-46df-85ef-ad72f61c302b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:33.763841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d409e1-7fdd-46df-85ef-ad72f61c302b None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:33.765375 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 122/236] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:33.766345 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae56ec-9713-4c1f-96ca-4e1730d7ab94 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:33.766632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae56ec-9713-4c1f-96ca-4e1730d7ab94 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:33.766960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae56ec-9713-4c1f-96ca-4e1730d7ab94 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:33.768342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 123/237] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:33.768759 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5b3dbdc5-8cc6-4537-8b83-f026af1050b7 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:33.769997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5b3dbdc5-8cc6-4537-8b83-f026af1050b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:33.771625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099e482-a2a0-41b7-a7c9-bc216aeb1eaa None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:33.772107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099e482-a2a0-41b7-a7c9-bc216aeb1eaa None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:33.772553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099e482-a2a0-41b7-a7c9-bc216aeb1eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:33.790481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-5099e482-a2a0-41b7-a7c9-bc216aeb1eaa None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:33.791895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-5099e482-a2a0-41b7-a7c9-bc216aeb1eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:33.848175 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 115/238] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:33.849485 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7687a-5daf-4bfd-a4d0-18b0c1acffc4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:33.849773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7687a-5daf-4bfd-a4d0-18b0c1acffc4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:33.850053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7687a-5daf-4bfd-a4d0-18b0c1acffc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:33.862313 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 124/239] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:33.883515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e0e7687a-5daf-4bfd-a4d0-18b0c1acffc4 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:33.884788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e0e7687a-5daf-4bfd-a4d0-18b0c1acffc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:33.885891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099e482-a2a0-41b7-a7c9-bc216aeb1eaa None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:33.955073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 116/240] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:33.956244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7687a-5daf-4bfd-a4d0-18b0c1acffc4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:34.018911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099e482-a2a0-41b7-a7c9-bc216aeb1eaa None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:34.054241 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da38c4-82d0-4fa5-b693-eb98f67fbe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:34.055085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da38c4-82d0-4fa5-b693-eb98f67fbe73 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:34.055374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da38c4-82d0-4fa5-b693-eb98f67fbe73 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:34.055657 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da38c4-82d0-4fa5-b693-eb98f67fbe73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:34.060284 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7687a-5daf-4bfd-a4d0-18b0c1acffc4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:34.066326 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da38c4-82d0-4fa5-b693-eb98f67fbe73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-75da38c4-82d0-4fa5-b693-eb98f67fbe73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:34.074112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:34.075255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 125/241] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:12:34.076206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da38c4-82d0-4fa5-b693-eb98f67fbe73 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:34.102639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3a6cf-7af1-4f51-a69a-13ef91a78579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:34.104130 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3a6cf-7af1-4f51-a69a-13ef91a78579 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:34.104828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3a6cf-7af1-4f51-a69a-13ef91a78579 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:34.105254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3a6cf-7af1-4f51-a69a-13ef91a78579 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:34.119202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3a6cf-7af1-4f51-a69a-13ef91a78579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-86d3a6cf-7af1-4f51-a69a-13ef91a78579 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:34.129993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:34.131168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:34.132163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:34.132163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:34.132163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:34.132163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:34.132163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:34.132163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:34.132163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:34.132163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:34.132163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:34.132163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:34.132163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:34.132163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:34.134659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 117/242] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:12:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:34.135594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3a6cf-7af1-4f51-a69a-13ef91a78579 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:34.191336 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da38c4-82d0-4fa5-b693-eb98f67fbe73 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:34.235429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0087a-2e84-4b77-954d-26ce1e195580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:34.237030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0087a-2e84-4b77-954d-26ce1e195580 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:34.237457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0087a-2e84-4b77-954d-26ce1e195580 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:34.237870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0087a-2e84-4b77-954d-26ce1e195580 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:34.239828 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0087a-2e84-4b77-954d-26ce1e195580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:34.241940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0087a-2e84-4b77-954d-26ce1e195580 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:34.244030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 126/243] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:12:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:34.245005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0087a-2e84-4b77-954d-26ce1e195580 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:34.263017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3a6cf-7af1-4f51-a69a-13ef91a78579 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:34.307002 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d6e97-f693-4094-a575-4c41bb374b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:34.308273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d6e97-f693-4094-a575-4c41bb374b7f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:34.308722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d6e97-f693-4094-a575-4c41bb374b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:34.309294 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d6e97-f693-4094-a575-4c41bb374b7f None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:34.311295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d6e97-f693-4094-a575-4c41bb374b7f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:34.312290 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d6e97-f693-4094-a575-4c41bb374b7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:34.314826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d6e97-f693-4094-a575-4c41bb374b7f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:34.332237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 118/244] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:34.332980 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d6e97-f693-4094-a575-4c41bb374b7f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:34.364045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0087a-2e84-4b77-954d-26ce1e195580 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:34.411879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8c7a-10c7-4cc4-a8dc-5d374e8d1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:34.412856 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8c7a-10c7-4cc4-a8dc-5d374e8d1b7b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:34.413670 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8c7a-10c7-4cc4-a8dc-5d374e8d1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:34.414093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8c7a-10c7-4cc4-a8dc-5d374e8d1b7b None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:34.415017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c8c7a-10c7-4cc4-a8dc-5d374e8d1b7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:34.415828 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c8c7a-10c7-4cc4-a8dc-5d374e8d1b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:34.417944 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c8c7a-10c7-4cc4-a8dc-5d374e8d1b7b None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:34.428964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 127/245] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:34.430578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8c7a-10c7-4cc4-a8dc-5d374e8d1b7b None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:34.439761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d6e97-f693-4094-a575-4c41bb374b7f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:34.474519 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf99eff-32cd-4eda-b20e-7ed2ad264871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:34.475201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf99eff-32cd-4eda-b20e-7ed2ad264871 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:34.475557 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf99eff-32cd-4eda-b20e-7ed2ad264871 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:34.475771 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf99eff-32cd-4eda-b20e-7ed2ad264871 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:34.476649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf99eff-32cd-4eda-b20e-7ed2ad264871 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:34.478181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf99eff-32cd-4eda-b20e-7ed2ad264871 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:34.545629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8c7a-10c7-4cc4-a8dc-5d374e8d1b7b None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:34.572331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 119/246] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:12:34 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:34.574096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf99eff-32cd-4eda-b20e-7ed2ad264871 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:34.601695 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbb515-2414-40bd-8289-f9003367eae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:34.603406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb515-2414-40bd-8289-f9003367eae4 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:34.605241 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb515-2414-40bd-8289-f9003367eae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:34.605791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb515-2414-40bd-8289-f9003367eae4 None admin] PATH_INFO: `/v3/users/a906d475918e4f0d998a061641e15b19` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:34.637569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbb515-2414-40bd-8289-f9003367eae4 None admin] RBAC: Authorizing `identity:get_user(user_id=a906d475918e4f0d998a061641e15b19)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:34.642926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbb515-2414-40bd-8289-f9003367eae4 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:34.647542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 128/247] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:34 2022] GET /identity/v3/users/a906d475918e4f0d998a061641e15b19 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:34.657429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbb515-2414-40bd-8289-f9003367eae4 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:34.788858 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbb515-2414-40bd-8289-f9003367eae4 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:34.816421 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf99eff-32cd-4eda-b20e-7ed2ad264871 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:34.829438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2d9be-67de-4480-805f-1b3641e5cb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:34.830094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2d9be-67de-4480-805f-1b3641e5cb74 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:34.830420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2d9be-67de-4480-805f-1b3641e5cb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:34.830758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2d9be-67de-4480-805f-1b3641e5cb74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:34.852827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a29a9c-b0e7-4b33-a38c-400e4c1b4c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:34.853727 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a29a9c-b0e7-4b33-a38c-400e4c1b4c3c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:34.854010 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a29a9c-b0e7-4b33-a38c-400e4c1b4c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:34.854334 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a29a9c-b0e7-4b33-a38c-400e4c1b4c3c None admin] PATH_INFO: `/v3/users/f04220f7cb99438c9a6f081cf43ff2d8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:34.855555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a29a9c-b0e7-4b33-a38c-400e4c1b4c3c None admin] RBAC: Authorizing `identity:get_user(user_id=f04220f7cb99438c9a6f081cf43ff2d8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:34.857246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a29a9c-b0e7-4b33-a38c-400e4c1b4c3c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:34.861440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 120/248] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:34 2022] GET /identity/v3/users/f04220f7cb99438c9a6f081cf43ff2d8 => generated 283 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:34.866305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae282e-56e1-4852-8fbb-164b57860963 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:34.866305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae282e-56e1-4852-8fbb-164b57860963 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:34.866305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae282e-56e1-4852-8fbb-164b57860963 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:34.866305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 121/249] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:34.872748 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b0ef3-1f0b-4fac-8676-24bb547f822f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:34.872748 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b0ef3-1f0b-4fac-8676-24bb547f822f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:34.872748 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b0ef3-1f0b-4fac-8676-24bb547f822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:34.892372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f21b0ef3-1f0b-4fac-8676-24bb547f822f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:34.897222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f21b0ef3-1f0b-4fac-8676-24bb547f822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:34.925295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2d9be-67de-4480-805f-1b3641e5cb74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:34.926991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2d9be-67de-4480-805f-1b3641e5cb74 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:34.977769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 122/250] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:34.978662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b0ef3-1f0b-4fac-8676-24bb547f822f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:35.054745 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 129/251] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:12:35.056204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abdb3d-1a54-4b02-9310-17d4f172b189 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:35.056500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abdb3d-1a54-4b02-9310-17d4f172b189 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:35.056780 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abdb3d-1a54-4b02-9310-17d4f172b189 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:35.058061 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 130/252] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:35.058791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abdb3d-1a54-4b02-9310-17d4f172b189 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:35.121198 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b0ef3-1f0b-4fac-8676-24bb547f822f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:35.169545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273e26d-644b-4e8d-9489-1f92fdb70031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:35.170405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273e26d-644b-4e8d-9489-1f92fdb70031 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:35.170696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273e26d-644b-4e8d-9489-1f92fdb70031 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:35.172103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273e26d-644b-4e8d-9489-1f92fdb70031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:35.190904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abdb3d-1a54-4b02-9310-17d4f172b189 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:35.231636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937cc54-256c-49be-b248-290d991eaacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:35.232955 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937cc54-256c-49be-b248-290d991eaacd None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:35.233242 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937cc54-256c-49be-b248-290d991eaacd None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:35.234068 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937cc54-256c-49be-b248-290d991eaacd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:35.246961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937cc54-256c-49be-b248-290d991eaacd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:35.253756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273e26d-644b-4e8d-9489-1f92fdb70031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:35.255352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273e26d-644b-4e8d-9489-1f92fdb70031 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-e937cc54-256c-49be-b248-290d991eaacd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:35.256547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:35.257421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:35.258202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:35.258202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:35.258202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:35.258202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:35.258202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:35.258202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:35.258202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:35.258202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:35.258202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:35.258202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:35.258202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:35.258202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:35.258941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 131/253] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:35.259971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937cc54-256c-49be-b248-290d991eaacd None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:35.375892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 123/254] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:35.377070 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be911ce-3be4-485c-9817-adf79f4dae5b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:35.377368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be911ce-3be4-485c-9817-adf79f4dae5b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:35.377657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be911ce-3be4-485c-9817-adf79f4dae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:35.393002 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937cc54-256c-49be-b248-290d991eaacd None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:35.396765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1be911ce-3be4-485c-9817-adf79f4dae5b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:35.398344 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1be911ce-3be4-485c-9817-adf79f4dae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:35.433161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341a9dc-e634-4d4c-811a-868507b07950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:35.434223 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341a9dc-e634-4d4c-811a-868507b07950 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:35.434634 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341a9dc-e634-4d4c-811a-868507b07950 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:35.434916 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341a9dc-e634-4d4c-811a-868507b07950 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:35.436100 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341a9dc-e634-4d4c-811a-868507b07950 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:35.438551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341a9dc-e634-4d4c-811a-868507b07950 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:35.440463 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 132/255] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:35 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:35.441017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341a9dc-e634-4d4c-811a-868507b07950 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:35.470786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 124/256] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:35.478961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be911ce-3be4-485c-9817-adf79f4dae5b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:35.569152 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341a9dc-e634-4d4c-811a-868507b07950 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:35.596277 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be911ce-3be4-485c-9817-adf79f4dae5b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:35.612475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f7602-61fa-471b-969e-24a167fc1ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:35.613537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f7602-61fa-471b-969e-24a167fc1ccd None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:35.613821 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f7602-61fa-471b-969e-24a167fc1ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:35.614403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f7602-61fa-471b-969e-24a167fc1ccd None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:35.615168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f7602-61fa-471b-969e-24a167fc1ccd None admin] RBAC: Adding query filter params (name=member) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:35.615632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f7602-61fa-471b-969e-24a167fc1ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:35.617341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f7602-61fa-471b-969e-24a167fc1ccd None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:35.628943 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 133/257] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:35.629496 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f7602-61fa-471b-969e-24a167fc1ccd None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:35.636732 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344ce0c-ceaa-4b6c-a0a8-2fde66046e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:35.637706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344ce0c-ceaa-4b6c-a0a8-2fde66046e92 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:35.637996 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344ce0c-ceaa-4b6c-a0a8-2fde66046e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:35.638276 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344ce0c-ceaa-4b6c-a0a8-2fde66046e92 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:35.641966 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344ce0c-ceaa-4b6c-a0a8-2fde66046e92 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:35.641966 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344ce0c-ceaa-4b6c-a0a8-2fde66046e92 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:35.643968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 125/258] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:35 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:35.644971 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344ce0c-ceaa-4b6c-a0a8-2fde66046e92 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:35.747261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f7602-61fa-471b-969e-24a167fc1ccd None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:35.761495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344ce0c-ceaa-4b6c-a0a8-2fde66046e92 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:35.794030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7780be-e276-4ab2-a082-dff5d4dcc06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:35.795397 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7780be-e276-4ab2-a082-dff5d4dcc06a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:35.796004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7780be-e276-4ab2-a082-dff5d4dcc06a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:35.797158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7780be-e276-4ab2-a082-dff5d4dcc06a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:35.798138 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20719aea-a4ea-4ebe-9286-f33ee6144f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:35.798267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7780be-e276-4ab2-a082-dff5d4dcc06a None admin] RBAC: Adding query filter params (role.id=a4ca52325cbd4f7192e085966d529a71, scope.project.id=ab41116bb62b44b9bd7c18431c0286a3, user.id=a906d475918e4f0d998a061641e15b19) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:35.798730 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7780be-e276-4ab2-a082-dff5d4dcc06a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:35.799036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20719aea-a4ea-4ebe-9286-f33ee6144f70 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:35.799333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20719aea-a4ea-4ebe-9286-f33ee6144f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:35.799602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20719aea-a4ea-4ebe-9286-f33ee6144f70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:35.800843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7780be-e276-4ab2-a082-dff5d4dcc06a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:35.807049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 134/259] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:35 2022] GET /identity/v3/role_assignments?user.id=a906d475918e4f0d998a061641e15b19&scope.project.id=ab41116bb62b44b9bd7c18431c0286a3&role.id=a4ca52325cbd4f7192e085966d529a71 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:35.808014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7780be-e276-4ab2-a082-dff5d4dcc06a None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:35.810323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20719aea-a4ea-4ebe-9286-f33ee6144f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-20719aea-a4ea-4ebe-9286-f33ee6144f70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:35.819008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:35.820707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 126/260] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:12:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:35.821756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20719aea-a4ea-4ebe-9286-f33ee6144f70 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:35.929640 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20719aea-a4ea-4ebe-9286-f33ee6144f70 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:35.931811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7780be-e276-4ab2-a082-dff5d4dcc06a None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:35.969039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be806bdf-f991-4e13-9ee8-afcb3a24ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:35.969743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806bdf-f991-4e13-9ee8-afcb3a24ab06 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:35.970030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806bdf-f991-4e13-9ee8-afcb3a24ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:35.970261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4baa3-2dd8-487b-a9fb-88754793b7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:35.970408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806bdf-f991-4e13-9ee8-afcb3a24ab06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:35.971162 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be806bdf-f991-4e13-9ee8-afcb3a24ab06 None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=ab41116bb62b44b9bd7c18431c0286a3, user.id=f04220f7cb99438c9a6f081cf43ff2d8) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:35.971476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be806bdf-f991-4e13-9ee8-afcb3a24ab06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:35.971731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4baa3-2dd8-487b-a9fb-88754793b7ce None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:35.972152 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4baa3-2dd8-487b-a9fb-88754793b7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:35.972577 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4baa3-2dd8-487b-a9fb-88754793b7ce None admin] PATH_INFO: `/v3/users/da536919a5b6458eaca614ea8d6d37c2` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:35.972940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be806bdf-f991-4e13-9ee8-afcb3a24ab06 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:35.974148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4baa3-2dd8-487b-a9fb-88754793b7ce None admin] RBAC: Authorizing `identity:get_user(user_id=da536919a5b6458eaca614ea8d6d37c2)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:35.975836 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4baa3-2dd8-487b-a9fb-88754793b7ce None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:35.977954 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 135/261] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:35 2022] GET /identity/v3/users/da536919a5b6458eaca614ea8d6d37c2 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:35.978932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4baa3-2dd8-487b-a9fb-88754793b7ce None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:35.979786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 127/262] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:35 2022] GET /identity/v3/role_assignments?user.id=f04220f7cb99438c9a6f081cf43ff2d8&scope.project.id=ab41116bb62b44b9bd7c18431c0286a3&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:35.987342 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be806bdf-f991-4e13-9ee8-afcb3a24ab06 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:36.103217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4baa3-2dd8-487b-a9fb-88754793b7ce None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:36.148732 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c833fd0-e9fd-4789-a120-294709e520ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:36.149739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c833fd0-e9fd-4789-a120-294709e520ce None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:36.150262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c833fd0-e9fd-4789-a120-294709e520ce None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:36.150704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c833fd0-e9fd-4789-a120-294709e520ce None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:36.151737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c833fd0-e9fd-4789-a120-294709e520ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:36.152198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c833fd0-e9fd-4789-a120-294709e520ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:36.154644 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c833fd0-e9fd-4789-a120-294709e520ce None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:36.169751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 136/263] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:12:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:36.182052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c833fd0-e9fd-4789-a120-294709e520ce None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:36.189732 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be806bdf-f991-4e13-9ee8-afcb3a24ab06 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:36.268373 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41147f2d-5e0a-4d20-8d57-dfce67b6706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:36.269517 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41147f2d-5e0a-4d20-8d57-dfce67b6706a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:36.269950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41147f2d-5e0a-4d20-8d57-dfce67b6706a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:36.270400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41147f2d-5e0a-4d20-8d57-dfce67b6706a None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:36.272720 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41147f2d-5e0a-4d20-8d57-dfce67b6706a None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:36.274436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41147f2d-5e0a-4d20-8d57-dfce67b6706a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:36.278249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 128/264] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:35 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:36.285299 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41147f2d-5e0a-4d20-8d57-dfce67b6706a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:36.372322 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c833fd0-e9fd-4789-a120-294709e520ce None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:36.440232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee71ed-4943-49bb-a2ee-fc89a2cfde66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:36.441053 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee71ed-4943-49bb-a2ee-fc89a2cfde66 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:36.441339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee71ed-4943-49bb-a2ee-fc89a2cfde66 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:36.441617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee71ed-4943-49bb-a2ee-fc89a2cfde66 None admin] PATH_INFO: `/v3/users/f04220f7cb99438c9a6f081cf43ff2d8` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:36.443520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee71ed-4943-49bb-a2ee-fc89a2cfde66 None admin] RBAC: Authorizing `identity:get_user(user_id=f04220f7cb99438c9a6f081cf43ff2d8)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:36.444976 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee71ed-4943-49bb-a2ee-fc89a2cfde66 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:36.446649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 137/265] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:36 2022] GET /identity/v3/users/f04220f7cb99438c9a6f081cf43ff2d8 => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:36.455680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee71ed-4943-49bb-a2ee-fc89a2cfde66 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:36.487027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41147f2d-5e0a-4d20-8d57-dfce67b6706a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:36.531734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babbbb4-a177-4ae3-91bb-e9f038e2b281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:36.532661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babbbb4-a177-4ae3-91bb-e9f038e2b281 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:36.532947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babbbb4-a177-4ae3-91bb-e9f038e2b281 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:36.533226 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babbbb4-a177-4ae3-91bb-e9f038e2b281 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3/users/da536919a5b6458eaca614ea8d6d37c2/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:36.535467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babbbb4-a177-4ae3-91bb-e9f038e2b281 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab41116bb62b44b9bd7c18431c0286a3, user_id=da536919a5b6458eaca614ea8d6d37c2, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:36.538124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babbbb4-a177-4ae3-91bb-e9f038e2b281 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:36.614606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee71ed-4943-49bb-a2ee-fc89a2cfde66 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:36.631447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 129/266] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:12:36 2022] PUT /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3/users/da536919a5b6458eaca614ea8d6d37c2/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:36.666800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73b31-cddc-49b2-8008-103a16111e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:36.667887 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73b31-cddc-49b2-8008-103a16111e26 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:36.668348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73b31-cddc-49b2-8008-103a16111e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:36.668824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73b31-cddc-49b2-8008-103a16111e26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:36.777947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc73b31-cddc-49b2-8008-103a16111e26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:36.779801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc73b31-cddc-49b2-8008-103a16111e26 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:36.909074 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 138/267] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:36.915852 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babbbb4-a177-4ae3-91bb-e9f038e2b281 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:37.021688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babbbb4-a177-4ae3-91bb-e9f038e2b281 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:37.056989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f2a25-dc0a-48b6-b05d-537879d394f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:37.058224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f2a25-dc0a-48b6-b05d-537879d394f9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:37.058742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f2a25-dc0a-48b6-b05d-537879d394f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:37.059206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f2a25-dc0a-48b6-b05d-537879d394f9 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:37.060640 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f2a25-dc0a-48b6-b05d-537879d394f9 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:37.063008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f2a25-dc0a-48b6-b05d-537879d394f9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:37.065317 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 130/268] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:36 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:37.071330 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73b31-cddc-49b2-8008-103a16111e26 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:37.192413 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73b31-cddc-49b2-8008-103a16111e26 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:37.227563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343aed3-0011-4e5e-b015-e970ba711e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:37.228553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343aed3-0011-4e5e-b015-e970ba711e09 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:37.229016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343aed3-0011-4e5e-b015-e970ba711e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:37.229499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343aed3-0011-4e5e-b015-e970ba711e09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:37.230602 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343aed3-0011-4e5e-b015-e970ba711e09 None admin] RBAC: Adding query filter params (role.id=44468cf4511643498cf7830993b8c9e5, scope.project.id=ab41116bb62b44b9bd7c18431c0286a3, user.id=f04220f7cb99438c9a6f081cf43ff2d8) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:37.231117 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343aed3-0011-4e5e-b015-e970ba711e09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:37.232865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343aed3-0011-4e5e-b015-e970ba711e09 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:37.244836 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 139/269] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:37 2022] GET /identity/v3/role_assignments?user.id=f04220f7cb99438c9a6f081cf43ff2d8&scope.project.id=ab41116bb62b44b9bd7c18431c0286a3&role.id=44468cf4511643498cf7830993b8c9e5 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:37.471922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94881859-22e5-4607-a71f-011498e3da07 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:37.472649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94881859-22e5-4607-a71f-011498e3da07 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:37.473146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94881859-22e5-4607-a71f-011498e3da07 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:37.474816 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 131/270] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:37.480899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28276a4-df63-4f2e-a5a1-bf5f56146a27 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:37.481629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28276a4-df63-4f2e-a5a1-bf5f56146a27 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:37.482115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28276a4-df63-4f2e-a5a1-bf5f56146a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:37.504670 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-c28276a4-df63-4f2e-a5a1-bf5f56146a27 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:37.506354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c28276a4-df63-4f2e-a5a1-bf5f56146a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:37.594028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 140/271] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:37.618335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94881859-22e5-4607-a71f-011498e3da07 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:37.734474 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94881859-22e5-4607-a71f-011498e3da07 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:37.739956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0306a-1e06-4f86-a4fa-6ed9f10647fe None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:37.740249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0306a-1e06-4f86-a4fa-6ed9f10647fe None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:37.740528 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0306a-1e06-4f86-a4fa-6ed9f10647fe None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:37.742120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 141/272] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:37.747703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca926d-12e1-40dd-badd-3bb94da86643 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:37.747992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca926d-12e1-40dd-badd-3bb94da86643 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:37.748272 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca926d-12e1-40dd-badd-3bb94da86643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:37.780180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-2aca926d-12e1-40dd-badd-3bb94da86643 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:37.782064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2aca926d-12e1-40dd-badd-3bb94da86643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:37.783043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d226e-f9ab-4ae9-bb83-f47bc790474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:37.784096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d226e-f9ab-4ae9-bb83-f47bc790474d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:37.784570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d226e-f9ab-4ae9-bb83-f47bc790474d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:37.785041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d226e-f9ab-4ae9-bb83-f47bc790474d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:37.801113 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d226e-f9ab-4ae9-bb83-f47bc790474d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-0f2d226e-f9ab-4ae9-bb83-f47bc790474d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:37.811066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:37.812181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:37.812951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:37.812951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:37.812951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:37.812951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:37.812951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:37.812951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:37.812951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:37.812951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:37.812951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:37.812951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:37.812951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:37.812951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:37.815339 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 132/273] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:37.821709 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d226e-f9ab-4ae9-bb83-f47bc790474d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:37.865346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 142/274] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:37.892436 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca926d-12e1-40dd-badd-3bb94da86643 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:37.969751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d226e-f9ab-4ae9-bb83-f47bc790474d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:38.003377 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1d9a8-dbbe-437b-b784-e79d329bbbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:38.004272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1d9a8-dbbe-437b-b784-e79d329bbbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:38.004714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1d9a8-dbbe-437b-b784-e79d329bbbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:38.004823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca926d-12e1-40dd-badd-3bb94da86643 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:38.005551 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1d9a8-dbbe-437b-b784-e79d329bbbc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:38.006484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1d9a8-dbbe-437b-b784-e79d329bbbc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:38.006922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1d9a8-dbbe-437b-b784-e79d329bbbc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:38.008509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1d9a8-dbbe-437b-b784-e79d329bbbc8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:38.017875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 133/275] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:38.024616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1d9a8-dbbe-437b-b784-e79d329bbbc8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:38.056504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239c30d-e876-4e32-a4b5-8d1ed1f5ab4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:38.057695 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239c30d-e876-4e32-a4b5-8d1ed1f5ab4b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:38.058636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239c30d-e876-4e32-a4b5-8d1ed1f5ab4b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:38.059446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239c30d-e876-4e32-a4b5-8d1ed1f5ab4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:38.061972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239c30d-e876-4e32-a4b5-8d1ed1f5ab4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:38.064394 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239c30d-e876-4e32-a4b5-8d1ed1f5ab4b None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:38.072864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 143/276] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:12:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:38.075751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239c30d-e876-4e32-a4b5-8d1ed1f5ab4b None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:38.149980 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1d9a8-dbbe-437b-b784-e79d329bbbc8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:38.196662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65cc51-30ef-4684-93b8-847840f36007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:38.198042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65cc51-30ef-4684-93b8-847840f36007 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:38.198420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65cc51-30ef-4684-93b8-847840f36007 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:38.198708 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65cc51-30ef-4684-93b8-847840f36007 None admin] PATH_INFO: `/v3/users/d002217e60684c33ba922475651c78de` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:38.213350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239c30d-e876-4e32-a4b5-8d1ed1f5ab4b None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:38.217805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65cc51-30ef-4684-93b8-847840f36007 None admin] RBAC: Authorizing `identity:get_user(user_id=d002217e60684c33ba922475651c78de)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:38.219799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65cc51-30ef-4684-93b8-847840f36007 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:38.221927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 134/277] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:38 2022] GET /identity/v3/users/d002217e60684c33ba922475651c78de => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:38.228573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65cc51-30ef-4684-93b8-847840f36007 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:38.255414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f181f-93ec-4914-bfd4-c68c8491f869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:38.256014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f181f-93ec-4914-bfd4-c68c8491f869 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:38.256300 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f181f-93ec-4914-bfd4-c68c8491f869 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:38.256579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f181f-93ec-4914-bfd4-c68c8491f869 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:38.257642 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f181f-93ec-4914-bfd4-c68c8491f869 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:38.259370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f181f-93ec-4914-bfd4-c68c8491f869 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:38.341132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65cc51-30ef-4684-93b8-847840f36007 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:38.382436 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 144/278] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:12:38 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:12:38.385385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094b032-209c-49a9-9f04-70c4896a8d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:38.386375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094b032-209c-49a9-9f04-70c4896a8d96 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:38.386888 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094b032-209c-49a9-9f04-70c4896a8d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:38.387378 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094b032-209c-49a9-9f04-70c4896a8d96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:38.388436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094b032-209c-49a9-9f04-70c4896a8d96 None admin] RBAC: Adding query filter params (role.id=e2401a0c8c204431b0eff57c19186866, user.id=d002217e60684c33ba922475651c78de, scope.system=all) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:38.389027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094b032-209c-49a9-9f04-70c4896a8d96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:38.390916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094b032-209c-49a9-9f04-70c4896a8d96 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:38.397826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 135/279] 10.222.0.44 () {56 vars in 1308 bytes} [Thu May 5 15:12:38 2022] GET /identity/v3/role_assignments?user.id=d002217e60684c33ba922475651c78de&scope.system=all&role.id=e2401a0c8c204431b0eff57c19186866 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:38.629854 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f6b7b-b93d-44e9-b0a1-53dc3a591722 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:38.629854 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f6b7b-b93d-44e9-b0a1-53dc3a591722 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:38.629854 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f6b7b-b93d-44e9-b0a1-53dc3a591722 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:38.629854 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 145/280] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:38.635646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c3899-8579-4c93-8cc4-d79980580bc7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:38.635948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c3899-8579-4c93-8cc4-d79980580bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:38.636235 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c3899-8579-4c93-8cc4-d79980580bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:38.654867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-129c3899-8579-4c93-8cc4-d79980580bc7 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:38.656153 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-129c3899-8579-4c93-8cc4-d79980580bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:38.724612 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 136/281] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:38.746912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f6b7b-b93d-44e9-b0a1-53dc3a591722 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:38.860913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f6b7b-b93d-44e9-b0a1-53dc3a591722 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:38.896246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098351d6-d374-42e0-a82e-cfd2295ca649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:38.897055 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098351d6-d374-42e0-a82e-cfd2295ca649 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:38.897338 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098351d6-d374-42e0-a82e-cfd2295ca649 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:38.897613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098351d6-d374-42e0-a82e-cfd2295ca649 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:38.908669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098351d6-d374-42e0-a82e-cfd2295ca649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-098351d6-d374-42e0-a82e-cfd2295ca649 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:38.917065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:38.917940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:38.918768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:38.918768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:38.918768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:38.918768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:38.918768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:38.918768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:38.918768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:38.918768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:38.918768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:38.918768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:38.918768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:38.918768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:38.918768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 146/282] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:38.925504 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c3899-8579-4c93-8cc4-d79980580bc7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:39.033689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c3899-8579-4c93-8cc4-d79980580bc7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:39.080354 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87237c22-0b99-4bfa-9227-6aa37e990f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:39.081038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87237c22-0b99-4bfa-9227-6aa37e990f85 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:39.081322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87237c22-0b99-4bfa-9227-6aa37e990f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:39.081600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87237c22-0b99-4bfa-9227-6aa37e990f85 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:39.082387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87237c22-0b99-4bfa-9227-6aa37e990f85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:39.082697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87237c22-0b99-4bfa-9227-6aa37e990f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:39.084086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87237c22-0b99-4bfa-9227-6aa37e990f85 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:39.097418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 137/283] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:39.099424 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098351d6-d374-42e0-a82e-cfd2295ca649 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:39.270500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098351d6-d374-42e0-a82e-cfd2295ca649 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:39.319001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb38ae0-25bf-4935-a010-6e67b4b2dcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:39.319891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb38ae0-25bf-4935-a010-6e67b4b2dcdc None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:39.320176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb38ae0-25bf-4935-a010-6e67b4b2dcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:39.320452 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb38ae0-25bf-4935-a010-6e67b4b2dcdc None admin] PATH_INFO: `/v3/users/a906d475918e4f0d998a061641e15b19` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:39.321709 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb38ae0-25bf-4935-a010-6e67b4b2dcdc None admin] RBAC: Authorizing `identity:get_user(user_id=a906d475918e4f0d998a061641e15b19)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:39.323193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb38ae0-25bf-4935-a010-6e67b4b2dcdc None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:39.325165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 147/284] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:39 2022] GET /identity/v3/users/a906d475918e4f0d998a061641e15b19 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:39.331079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87237c22-0b99-4bfa-9227-6aa37e990f85 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:39.351445 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8244d-88b8-4e0b-a3e8-d68fc400ab2b None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:39.351731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8244d-88b8-4e0b-a3e8-d68fc400ab2b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:39.351995 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8244d-88b8-4e0b-a3e8-d68fc400ab2b None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:39.353620 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 148/285] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:39.359214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebac7a-8bef-4d42-8934-4cd3bf2e4e2f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:39.359575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebac7a-8bef-4d42-8934-4cd3bf2e4e2f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:39.359865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebac7a-8bef-4d42-8934-4cd3bf2e4e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:39.392146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-06ebac7a-8bef-4d42-8934-4cd3bf2e4e2f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:39.393351 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-06ebac7a-8bef-4d42-8934-4cd3bf2e4e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:39.474374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87237c22-0b99-4bfa-9227-6aa37e990f85 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:39.501089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 149/286] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:39.519842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7596a5d-edba-4462-a8ed-893a3dbffeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:39.520777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7596a5d-edba-4462-a8ed-893a3dbffeef None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:39.521002 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7596a5d-edba-4462-a8ed-893a3dbffeef None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:39.521277 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7596a5d-edba-4462-a8ed-893a3dbffeef None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:39.522493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7596a5d-edba-4462-a8ed-893a3dbffeef None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:39.523936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7596a5d-edba-4462-a8ed-893a3dbffeef None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:39.525968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 138/287] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:39 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:39.526603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebac7a-8bef-4d42-8934-4cd3bf2e4e2f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:39.533397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7596a5d-edba-4462-a8ed-893a3dbffeef None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:39.636094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7596a5d-edba-4462-a8ed-893a3dbffeef None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:39.644316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebac7a-8bef-4d42-8934-4cd3bf2e4e2f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:39.671576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a56fa-3459-4b81-a792-cf47fe229872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:39.672658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a56fa-3459-4b81-a792-cf47fe229872 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:39.672938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a56fa-3459-4b81-a792-cf47fe229872 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:39.673212 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a56fa-3459-4b81-a792-cf47fe229872 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3/users/a906d475918e4f0d998a061641e15b19/roles/a4ca52325cbd4f7192e085966d529a71` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:39.683020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a56fa-3459-4b81-a792-cf47fe229872 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab41116bb62b44b9bd7c18431c0286a3, user_id=a906d475918e4f0d998a061641e15b19, role_id=a4ca52325cbd4f7192e085966d529a71)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:39.684726 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a56fa-3459-4b81-a792-cf47fe229872 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:39.690613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c96b5-6194-4681-96f1-934b281c0ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:39.691574 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c96b5-6194-4681-96f1-934b281c0ece None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:39.691922 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c96b5-6194-4681-96f1-934b281c0ece None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:39.692230 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c96b5-6194-4681-96f1-934b281c0ece None admin] PATH_INFO: `/v3/roles/member` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:39.706244 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c96b5-6194-4681-96f1-934b281c0ece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-849c96b5-6194-4681-96f1-934b281c0ece None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:39.715091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:39.717209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:39.719369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:39.719369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:39.719369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:39.719369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:39.719369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:39.719369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:39.719369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:39.719369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:39.719369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:39.719369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:39.719369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:39.719369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:39.719369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 150/288] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:12:39.726886 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c96b5-6194-4681-96f1-934b281c0ece None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:39.772446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 139/289] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:12:39 2022] PUT /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3/users/a906d475918e4f0d998a061641e15b19/roles/a4ca52325cbd4f7192e085966d529a71 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:39.847687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c96b5-6194-4681-96f1-934b281c0ece None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:39.889578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead192a-794f-43b3-971a-5a925516dfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:39.890592 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead192a-794f-43b3-971a-5a925516dfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:39.890877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead192a-794f-43b3-971a-5a925516dfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:39.891155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead192a-794f-43b3-971a-5a925516dfd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:39.891926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead192a-794f-43b3-971a-5a925516dfd1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:39.892231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead192a-794f-43b3-971a-5a925516dfd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:39.893721 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead192a-794f-43b3-971a-5a925516dfd1 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:39.903271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 151/290] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:39.909840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a56fa-3459-4b81-a792-cf47fe229872 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:40.041246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a56fa-3459-4b81-a792-cf47fe229872 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:40.078654 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a527e4-41bc-4f33-aa6b-1a3eace778ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:40.079549 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a527e4-41bc-4f33-aa6b-1a3eace778ac None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:40.079830 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a527e4-41bc-4f33-aa6b-1a3eace778ac None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:40.080101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a527e4-41bc-4f33-aa6b-1a3eace778ac None admin] PATH_INFO: `/v3/users/da536919a5b6458eaca614ea8d6d37c2` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:40.081363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a527e4-41bc-4f33-aa6b-1a3eace778ac None admin] RBAC: Authorizing `identity:get_user(user_id=da536919a5b6458eaca614ea8d6d37c2)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:40.082895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a527e4-41bc-4f33-aa6b-1a3eace778ac None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:40.084614 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 140/291] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:39 2022] GET /identity/v3/users/da536919a5b6458eaca614ea8d6d37c2 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:40.090327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead192a-794f-43b3-971a-5a925516dfd1 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:40.192797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead192a-794f-43b3-971a-5a925516dfd1 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:40.225712 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f290302-dfc2-4932-abce-36eb6bad2db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:40.226389 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f290302-dfc2-4932-abce-36eb6bad2db4 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:40.226679 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f290302-dfc2-4932-abce-36eb6bad2db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:40.226957 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f290302-dfc2-4932-abce-36eb6bad2db4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:40.294675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f290302-dfc2-4932-abce-36eb6bad2db4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:40.296622 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f290302-dfc2-4932-abce-36eb6bad2db4 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:40.397835 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 152/292] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:40.407742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a527e4-41bc-4f33-aa6b-1a3eace778ac None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:40.534017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a527e4-41bc-4f33-aa6b-1a3eace778ac None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:40.579848 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f1495-2eed-40e9-a89e-f0a0dfdffa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:40.580639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f1495-2eed-40e9-a89e-f0a0dfdffa41 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:40.580916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f1495-2eed-40e9-a89e-f0a0dfdffa41 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:40.581187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f1495-2eed-40e9-a89e-f0a0dfdffa41 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:40.582371 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f1495-2eed-40e9-a89e-f0a0dfdffa41 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:40.583882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f1495-2eed-40e9-a89e-f0a0dfdffa41 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:40.586861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 141/293] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:40 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:40.591698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f290302-dfc2-4932-abce-36eb6bad2db4 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:40.691615 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f290302-dfc2-4932-abce-36eb6bad2db4 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:40.726945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31883510-352d-4a7a-b411-94ce6de14f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:40.727601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883510-352d-4a7a-b411-94ce6de14f10 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:40.727880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883510-352d-4a7a-b411-94ce6de14f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:40.728151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883510-352d-4a7a-b411-94ce6de14f10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:40.728985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31883510-352d-4a7a-b411-94ce6de14f10 None admin] RBAC: Adding query filter params (role.id=e2401a0c8c204431b0eff57c19186866, scope.project.id=ab41116bb62b44b9bd7c18431c0286a3, user.id=da536919a5b6458eaca614ea8d6d37c2) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:40.729293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31883510-352d-4a7a-b411-94ce6de14f10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:40.730769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31883510-352d-4a7a-b411-94ce6de14f10 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:40.737383 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 153/294] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:40 2022] GET /identity/v3/role_assignments?user.id=da536919a5b6458eaca614ea8d6d37c2&scope.project.id=ab41116bb62b44b9bd7c18431c0286a3&role.id=e2401a0c8c204431b0eff57c19186866 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:40.948913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658a7a5-a48b-4784-ba22-87a2be809a11 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:40.949294 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658a7a5-a48b-4784-ba22-87a2be809a11 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:40.949466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658a7a5-a48b-4784-ba22-87a2be809a11 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:40.951115 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 142/295] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:40.956908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3155f8-75f8-46df-9b13-64d1aa59e82f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:40.957205 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3155f8-75f8-46df-9b13-64d1aa59e82f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:40.957486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3155f8-75f8-46df-9b13-64d1aa59e82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:40.974625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-2a3155f8-75f8-46df-9b13-64d1aa59e82f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:40.975841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2a3155f8-75f8-46df-9b13-64d1aa59e82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:41.043903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 154/296] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:41.069550 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658a7a5-a48b-4784-ba22-87a2be809a11 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:41.176328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658a7a5-a48b-4784-ba22-87a2be809a11 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:41.212211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac41349-6d23-44af-a6f1-6d7b5583b95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:41.212990 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41349-6d23-44af-a6f1-6d7b5583b95a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:41.213281 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41349-6d23-44af-a6f1-6d7b5583b95a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:41.213557 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41349-6d23-44af-a6f1-6d7b5583b95a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:41.224879 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac41349-6d23-44af-a6f1-6d7b5583b95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-8ac41349-6d23-44af-a6f1-6d7b5583b95a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:41.232820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:41.235630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:41.237567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:41.237567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:41.237567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:41.237567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:41.237567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:41.237567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:41.237567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:41.237567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:41.237567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:41.237567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:41.237567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:41.237567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:41.237567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 143/297] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:41.242313 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3155f8-75f8-46df-9b13-64d1aa59e82f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:41.354341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3155f8-75f8-46df-9b13-64d1aa59e82f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:41.392076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caaef2-3eb6-4523-923e-96a6eac7b062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:41.392805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caaef2-3eb6-4523-923e-96a6eac7b062 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:41.393097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caaef2-3eb6-4523-923e-96a6eac7b062 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:41.393380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caaef2-3eb6-4523-923e-96a6eac7b062 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:41.394137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caaef2-3eb6-4523-923e-96a6eac7b062 None admin] RBAC: Adding query filter params (name=member) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:41.394497 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caaef2-3eb6-4523-923e-96a6eac7b062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:41.395870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caaef2-3eb6-4523-923e-96a6eac7b062 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:41.404247 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 155/298] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:41.410257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac41349-6d23-44af-a6f1-6d7b5583b95a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:41.520244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac41349-6d23-44af-a6f1-6d7b5583b95a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:41.559147 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e46f4e-5cfe-48a7-953c-3e7ce9c39e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:41.559844 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46f4e-5cfe-48a7-953c-3e7ce9c39e46 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:41.560199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46f4e-5cfe-48a7-953c-3e7ce9c39e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:41.560483 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46f4e-5cfe-48a7-953c-3e7ce9c39e46 None admin] PATH_INFO: `/v3/users/d002217e60684c33ba922475651c78de` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:41.561815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e46f4e-5cfe-48a7-953c-3e7ce9c39e46 None admin] RBAC: Authorizing `identity:get_user(user_id=d002217e60684c33ba922475651c78de)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:41.563429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e46f4e-5cfe-48a7-953c-3e7ce9c39e46 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:41.565378 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 144/299] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:41 2022] GET /identity/v3/users/d002217e60684c33ba922475651c78de => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:41.571144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caaef2-3eb6-4523-923e-96a6eac7b062 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:41.673760 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caaef2-3eb6-4523-923e-96a6eac7b062 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:41.675256 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9646e-4f18-484a-bf89-bd5f21018ee4 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:41.675587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9646e-4f18-484a-bf89-bd5f21018ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:41.675871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9646e-4f18-484a-bf89-bd5f21018ee4 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:41.677216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 145/300] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:41.683676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f7094-d769-4039-8757-22fb8838e952 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:41.684234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f7094-d769-4039-8757-22fb8838e952 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:41.684706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f7094-d769-4039-8757-22fb8838e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:41.705228 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0f2f7094-d769-4039-8757-22fb8838e952 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:41.707461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0f2f7094-d769-4039-8757-22fb8838e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:41.711026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b556a8-fbce-46b2-9e95-6e40b02cbcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:41.711906 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b556a8-fbce-46b2-9e95-6e40b02cbcf0 None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:41.712193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b556a8-fbce-46b2-9e95-6e40b02cbcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:41.712524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b556a8-fbce-46b2-9e95-6e40b02cbcf0 None admin] PATH_INFO: `/v3/system/users/d002217e60684c33ba922475651c78de/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:41.714211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b556a8-fbce-46b2-9e95-6e40b02cbcf0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d002217e60684c33ba922475651c78de, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:41.715630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b556a8-fbce-46b2-9e95-6e40b02cbcf0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:41.772283 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 156/301] 10.222.0.44 () {58 vars in 1334 bytes} [Thu May 5 15:12:41 2022] PUT /identity/v3/system/users/d002217e60684c33ba922475651c78de/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:41.773486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831048-6e28-41a9-b000-3fe255335bc9 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:41.773784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831048-6e28-41a9-b000-3fe255335bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:41.774068 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831048-6e28-41a9-b000-3fe255335bc9 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:41.775768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 157/302] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:41.781998 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7945c-5d11-46fe-85d4-8a6135ddf6c0 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:41.782333 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7945c-5d11-46fe-85d4-8a6135ddf6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:41.782670 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7945c-5d11-46fe-85d4-8a6135ddf6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:41.784881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 146/303] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:41.803505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-68d7945c-5d11-46fe-85d4-8a6135ddf6c0 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:41.805183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-68d7945c-5d11-46fe-85d4-8a6135ddf6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:41.808457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f7094-d769-4039-8757-22fb8838e952 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:41.890166 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 158/304] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:41.909184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7945c-5d11-46fe-85d4-8a6135ddf6c0 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:41.918871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f7094-d769-4039-8757-22fb8838e952 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:41.958425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd9e7b-beb7-40d4-b547-c23f6d6a9b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:41.958425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9e7b-beb7-40d4-b547-c23f6d6a9b50 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:41.958425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9e7b-beb7-40d4-b547-c23f6d6a9b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:41.958425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9e7b-beb7-40d4-b547-c23f6d6a9b50 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:41.970896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd9e7b-beb7-40d4-b547-c23f6d6a9b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-24fd9e7b-beb7-40d4-b547-c23f6d6a9b50 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:41.979423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:41.980331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:41.981243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:41.981243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:41.981243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:41.981243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:41.981243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:41.981243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:41.981243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:41.981243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:41.981243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:41.981243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:41.981243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:41.981243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:41.981243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 147/305] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:12:41.989702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd9e7b-beb7-40d4-b547-c23f6d6a9b50 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:42.023440 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7945c-5d11-46fe-85d4-8a6135ddf6c0 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:42.066198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f715a-04ef-4729-8153-9de488878326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:42.067350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f715a-04ef-4729-8153-9de488878326 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:42.067702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f715a-04ef-4729-8153-9de488878326 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:42.068344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f715a-04ef-4729-8153-9de488878326 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:42.069855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f715a-04ef-4729-8153-9de488878326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:42.071421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f715a-04ef-4729-8153-9de488878326 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:42.078458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 159/306] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:12:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:42.080205 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f715a-04ef-4729-8153-9de488878326 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:42.107273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd9e7b-beb7-40d4-b547-c23f6d6a9b50 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:42.142754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5588b71-508f-4686-8412-31a01b8fc7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:42.143204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5588b71-508f-4686-8412-31a01b8fc7ba None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:42.143488 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5588b71-508f-4686-8412-31a01b8fc7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:42.143763 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5588b71-508f-4686-8412-31a01b8fc7ba None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:42.144508 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5588b71-508f-4686-8412-31a01b8fc7ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:42.144879 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5588b71-508f-4686-8412-31a01b8fc7ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:42.146189 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5588b71-508f-4686-8412-31a01b8fc7ba None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:42.160196 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 148/307] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:42.161754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5588b71-508f-4686-8412-31a01b8fc7ba None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:42.187078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f715a-04ef-4729-8153-9de488878326 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:42.224498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876988c-9636-4527-88d5-dbd055c36d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:42.225508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876988c-9636-4527-88d5-dbd055c36d13 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:42.226001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876988c-9636-4527-88d5-dbd055c36d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:42.226521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876988c-9636-4527-88d5-dbd055c36d13 None admin] PATH_INFO: `/v3/groups` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:42.227400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876988c-9636-4527-88d5-dbd055c36d13 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:42.229084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876988c-9636-4527-88d5-dbd055c36d13 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:42.261133 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5588b71-508f-4686-8412-31a01b8fc7ba None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:42.293830 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d982cd4-4938-4053-b09a-5b56b5007182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:42.294749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d982cd4-4938-4053-b09a-5b56b5007182 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:42.295028 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d982cd4-4938-4053-b09a-5b56b5007182 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:42.295300 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d982cd4-4938-4053-b09a-5b56b5007182 None admin] PATH_INFO: `/v3/users/d80c118d1f764aa6802bf2437fc3407a` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:42.312104 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d982cd4-4938-4053-b09a-5b56b5007182 None admin] RBAC: Authorizing `identity:get_user(user_id=d80c118d1f764aa6802bf2437fc3407a)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:42.313806 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d982cd4-4938-4053-b09a-5b56b5007182 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:42.320480 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 149/308] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:42 2022] GET /identity/v3/users/d80c118d1f764aa6802bf2437fc3407a => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:42.321710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 160/309] 10.222.0.44 () {60 vars in 1134 bytes} [Thu May 5 15:12:42 2022] POST /identity/v3/groups => generated 229 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:12:42.322144 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d982cd4-4938-4053-b09a-5b56b5007182 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:42.434645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d982cd4-4938-4053-b09a-5b56b5007182 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:42.478800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7e6d7-84ee-49ca-821a-f66c0db07204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:42.479865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7e6d7-84ee-49ca-821a-f66c0db07204 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:42.480362 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7e6d7-84ee-49ca-821a-f66c0db07204 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:42.480830 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7e6d7-84ee-49ca-821a-f66c0db07204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:42.481856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7e6d7-84ee-49ca-821a-f66c0db07204 None admin] RBAC: Adding query filter params (role.id=a4ca52325cbd4f7192e085966d529a71, user.id=d80c118d1f764aa6802bf2437fc3407a, scope.system=all) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:42.482393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7e6d7-84ee-49ca-821a-f66c0db07204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:42.484392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7e6d7-84ee-49ca-821a-f66c0db07204 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:42.488955 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e09e7-50ef-4cdd-848c-bc5372727a4f None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:42.489240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e09e7-50ef-4cdd-848c-bc5372727a4f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:42.489530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e09e7-50ef-4cdd-848c-bc5372727a4f None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:42.490984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 161/310] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:42.491426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 150/311] 10.222.0.44 () {56 vars in 1308 bytes} [Thu May 5 15:12:42 2022] GET /identity/v3/role_assignments?user.id=d80c118d1f764aa6802bf2437fc3407a&scope.system=all&role.id=a4ca52325cbd4f7192e085966d529a71 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:42.496514 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f980050-ba51-400f-83c2-42ab4d1c2a23 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:42.496920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f980050-ba51-400f-83c2-42ab4d1c2a23 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:42.497308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f980050-ba51-400f-83c2-42ab4d1c2a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:42.516508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-0f980050-ba51-400f-83c2-42ab4d1c2a23 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:42.518063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-0f980050-ba51-400f-83c2-42ab4d1c2a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:42.597900 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 162/312] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:42.621793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7e6d7-84ee-49ca-821a-f66c0db07204 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:42.729273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7e6d7-84ee-49ca-821a-f66c0db07204 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:42.771322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b69fb7-6866-445e-b55d-64a17bade516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:42.772423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b69fb7-6866-445e-b55d-64a17bade516 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:42.772910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b69fb7-6866-445e-b55d-64a17bade516 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:42.773385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b69fb7-6866-445e-b55d-64a17bade516 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:42.784699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b69fb7-6866-445e-b55d-64a17bade516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a2b69fb7-6866-445e-b55d-64a17bade516 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:42.793114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:42.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:42.794825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:42.794825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:42.794825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:42.794825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:42.794825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:42.794825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:42.794825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:42.794825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:42.794825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:42.794825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:42.794825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:42.794825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:42.797889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 151/313] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:42.807619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f980050-ba51-400f-83c2-42ab4d1c2a23 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:42.910413 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f980050-ba51-400f-83c2-42ab4d1c2a23 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:42.945227 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d928f-1c17-46f2-967e-ea5a14d1d71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:42.945908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d928f-1c17-46f2-967e-ea5a14d1d71e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:42.946196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d928f-1c17-46f2-967e-ea5a14d1d71e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:42.946508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d928f-1c17-46f2-967e-ea5a14d1d71e None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:42.947261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d928f-1c17-46f2-967e-ea5a14d1d71e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:42.947572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d928f-1c17-46f2-967e-ea5a14d1d71e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:42.948944 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d928f-1c17-46f2-967e-ea5a14d1d71e None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:42.958065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 163/314] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:42.963558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b69fb7-6866-445e-b55d-64a17bade516 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:43.069476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b69fb7-6866-445e-b55d-64a17bade516 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:43.101942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c590ed-47b5-4ae6-b535-7eaddc0dfd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:43.102851 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c590ed-47b5-4ae6-b535-7eaddc0dfd67 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:43.103129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c590ed-47b5-4ae6-b535-7eaddc0dfd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:43.103400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c590ed-47b5-4ae6-b535-7eaddc0dfd67 None admin] PATH_INFO: `/v3/users/a906d475918e4f0d998a061641e15b19` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:43.104570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c590ed-47b5-4ae6-b535-7eaddc0dfd67 None admin] RBAC: Authorizing `identity:get_user(user_id=a906d475918e4f0d998a061641e15b19)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:43.106009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c590ed-47b5-4ae6-b535-7eaddc0dfd67 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:43.107934 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 152/315] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:42 2022] GET /identity/v3/users/a906d475918e4f0d998a061641e15b19 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:43.115517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d928f-1c17-46f2-967e-ea5a14d1d71e None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:43.219938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d928f-1c17-46f2-967e-ea5a14d1d71e None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:43.254576 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c694a71-1319-4b17-9432-f7beb34f6f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:43.255246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694a71-1319-4b17-9432-f7beb34f6f54 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:43.255530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694a71-1319-4b17-9432-f7beb34f6f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:43.255810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694a71-1319-4b17-9432-f7beb34f6f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:43.325695 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c694a71-1319-4b17-9432-f7beb34f6f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:43.327819 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c694a71-1319-4b17-9432-f7beb34f6f54 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:43.434910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 164/316] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:43.441199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c590ed-47b5-4ae6-b535-7eaddc0dfd67 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:43.544692 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c590ed-47b5-4ae6-b535-7eaddc0dfd67 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:43.579305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f2ed5-d72d-492d-b531-1cf6fb099df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:43.580181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f2ed5-d72d-492d-b531-1cf6fb099df2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:43.580459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f2ed5-d72d-492d-b531-1cf6fb099df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:43.580739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f2ed5-d72d-492d-b531-1cf6fb099df2 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:43.582180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f2ed5-d72d-492d-b531-1cf6fb099df2 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:43.583718 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f2ed5-d72d-492d-b531-1cf6fb099df2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:43.585888 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 153/317] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:43 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:43.591961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c694a71-1319-4b17-9432-f7beb34f6f54 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:43.715988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c694a71-1319-4b17-9432-f7beb34f6f54 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:43.763904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b82c89-b3c9-478f-9508-764053e7d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:43.764771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b82c89-b3c9-478f-9508-764053e7d76b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:43.765547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b82c89-b3c9-478f-9508-764053e7d76b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:43.765830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b82c89-b3c9-478f-9508-764053e7d76b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:43.766707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b82c89-b3c9-478f-9508-764053e7d76b None admin] RBAC: Adding query filter params (role.id=a4ca52325cbd4f7192e085966d529a71, scope.project.id=ab41116bb62b44b9bd7c18431c0286a3, user.id=a906d475918e4f0d998a061641e15b19) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:43.767020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b82c89-b3c9-478f-9508-764053e7d76b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:43.768472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b82c89-b3c9-478f-9508-764053e7d76b None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:43.782448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 165/318] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:12:43 2022] GET /identity/v3/role_assignments?user.id=a906d475918e4f0d998a061641e15b19&scope.project.id=ab41116bb62b44b9bd7c18431c0286a3&role.id=a4ca52325cbd4f7192e085966d529a71 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:44.212153 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07731d-c3b2-4d40-b5d8-c67a205a68e5 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:44.212778 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07731d-c3b2-4d40-b5d8-c67a205a68e5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:44.212778 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07731d-c3b2-4d40-b5d8-c67a205a68e5 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:44.214345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 154/319] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:44.219310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98695c3-fdaf-44d0-9c16-99548e973118 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:44.219610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98695c3-fdaf-44d0-9c16-99548e973118 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:44.219895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98695c3-fdaf-44d0-9c16-99548e973118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:44.236813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e98695c3-fdaf-44d0-9c16-99548e973118 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:44.238025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e98695c3-fdaf-44d0-9c16-99548e973118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:44.303719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 166/320] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:44.327857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07731d-c3b2-4d40-b5d8-c67a205a68e5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:44.429094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07731d-c3b2-4d40-b5d8-c67a205a68e5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:44.461826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a374d9-b850-4c3a-a32c-e6254940e98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:44.462712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a374d9-b850-4c3a-a32c-e6254940e98a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:44.462948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a374d9-b850-4c3a-a32c-e6254940e98a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:44.463228 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a374d9-b850-4c3a-a32c-e6254940e98a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:44.473193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a374d9-b850-4c3a-a32c-e6254940e98a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a1a374d9-b850-4c3a-a32c-e6254940e98a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:44.480953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:44.482541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:44.483860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:44.483860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:44.483860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:44.483860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:44.483860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:44.483860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:44.483860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:44.483860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:44.483860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:44.483860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:44.483860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:44.483860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:44.483860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 155/321] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:44.488557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98695c3-fdaf-44d0-9c16-99548e973118 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:44.590601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98695c3-fdaf-44d0-9c16-99548e973118 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:44.629359 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c48b7f-6918-48aa-aef2-0fe3d1de29b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:44.646360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c48b7f-6918-48aa-aef2-0fe3d1de29b1 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:44.646360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c48b7f-6918-48aa-aef2-0fe3d1de29b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:44.646360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c48b7f-6918-48aa-aef2-0fe3d1de29b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:44.646360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c48b7f-6918-48aa-aef2-0fe3d1de29b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:44.646360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c48b7f-6918-48aa-aef2-0fe3d1de29b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:44.646360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c48b7f-6918-48aa-aef2-0fe3d1de29b1 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:44.646814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 167/322] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:44.648526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a374d9-b850-4c3a-a32c-e6254940e98a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:44.771993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a374d9-b850-4c3a-a32c-e6254940e98a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:44.809742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e92b68-9323-488f-91df-55bf35bc6c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:44.810647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e92b68-9323-488f-91df-55bf35bc6c70 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:44.810932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e92b68-9323-488f-91df-55bf35bc6c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:44.811712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e92b68-9323-488f-91df-55bf35bc6c70 None admin] PATH_INFO: `/v3/users/d002217e60684c33ba922475651c78de` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:44.813815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e92b68-9323-488f-91df-55bf35bc6c70 None admin] RBAC: Authorizing `identity:get_user(user_id=d002217e60684c33ba922475651c78de)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:44.816190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e92b68-9323-488f-91df-55bf35bc6c70 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:44.823381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 156/323] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:44 2022] GET /identity/v3/users/d002217e60684c33ba922475651c78de => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:44.827881 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad02f1-5e20-4259-971f-98b421e64112 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:44.828215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad02f1-5e20-4259-971f-98b421e64112 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:44.828576 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad02f1-5e20-4259-971f-98b421e64112 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:44.829957 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 168/324] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:44.830297 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e92b68-9323-488f-91df-55bf35bc6c70 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:44.835052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9547b-542a-4138-9c9b-12717cd6e723 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:44.835417 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9547b-542a-4138-9c9b-12717cd6e723 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:44.835795 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9547b-542a-4138-9c9b-12717cd6e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:44.852754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-19d9547b-542a-4138-9c9b-12717cd6e723 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:44.853947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-19d9547b-542a-4138-9c9b-12717cd6e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:44.941263 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e92b68-9323-488f-91df-55bf35bc6c70 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:44.942436 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 169/325] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:44.943668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3394-c62b-4ed8-ba47-a3a592c8c33f None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:44.943958 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3394-c62b-4ed8-ba47-a3a592c8c33f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:44.944238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3394-c62b-4ed8-ba47-a3a592c8c33f None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:44.945486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 170/326] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:44.951048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eb60a-6ccf-4ab2-aa33-614abb44c623 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:44.951330 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eb60a-6ccf-4ab2-aa33-614abb44c623 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:44.951605 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eb60a-6ccf-4ab2-aa33-614abb44c623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:44.969228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-2e8eb60a-6ccf-4ab2-aa33-614abb44c623 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:44.970426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2e8eb60a-6ccf-4ab2-aa33-614abb44c623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:44.977504 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7a5b2-93af-4560-b415-8c931f939d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:44.978168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7a5b2-93af-4560-b415-8c931f939d5f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:44.978483 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7a5b2-93af-4560-b415-8c931f939d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:44.978765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7a5b2-93af-4560-b415-8c931f939d5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:44.979596 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7a5b2-93af-4560-b415-8c931f939d5f None admin] RBAC: Adding query filter params (role.id=e2401a0c8c204431b0eff57c19186866, user.id=d002217e60684c33ba922475651c78de, scope.system=all) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:44.979912 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7a5b2-93af-4560-b415-8c931f939d5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:44.981341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7a5b2-93af-4560-b415-8c931f939d5f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:44.993421 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 157/327] 10.222.0.44 () {56 vars in 1308 bytes} [Thu May 5 15:12:44 2022] GET /identity/v3/role_assignments?user.id=d002217e60684c33ba922475651c78de&scope.system=all&role.id=e2401a0c8c204431b0eff57c19186866 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:44.994246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7a5b2-93af-4560-b415-8c931f939d5f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:45.049881 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 171/328] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:45.078458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8eb60a-6ccf-4ab2-aa33-614abb44c623 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:45.109815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7a5b2-93af-4560-b415-8c931f939d5f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:45.149850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8581f-8239-452d-8910-0d709821cf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:45.150703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8581f-8239-452d-8910-0d709821cf6c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:45.150991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8581f-8239-452d-8910-0d709821cf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:45.151270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8581f-8239-452d-8910-0d709821cf6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:45.152517 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8581f-8239-452d-8910-0d709821cf6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:45.154636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8581f-8239-452d-8910-0d709821cf6c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:45.156948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 158/329] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:12:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:45.163000 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8581f-8239-452d-8910-0d709821cf6c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:45.193203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8eb60a-6ccf-4ab2-aa33-614abb44c623 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:45.234887 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262481da-9f65-4ddf-a2b1-0e430c2960bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:45.235713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262481da-9f65-4ddf-a2b1-0e430c2960bf None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:45.235995 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262481da-9f65-4ddf-a2b1-0e430c2960bf None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:45.236271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262481da-9f65-4ddf-a2b1-0e430c2960bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:45.246686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262481da-9f65-4ddf-a2b1-0e430c2960bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-262481da-9f65-4ddf-a2b1-0e430c2960bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:45.255768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:45.256857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:45.257710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:45.257710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:45.257710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:45.257710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:45.257710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:45.257710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:45.257710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:45.257710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:45.257710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:45.257710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:45.257710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:45.257710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:45.257710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 172/330] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:45.262797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262481da-9f65-4ddf-a2b1-0e430c2960bf None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:45.270171 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8581f-8239-452d-8910-0d709821cf6c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:45.303386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4682d-7d24-4bcd-a159-bcb73fd200d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:45.303980 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4682d-7d24-4bcd-a159-bcb73fd200d9 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:45.304268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4682d-7d24-4bcd-a159-bcb73fd200d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:45.304545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4682d-7d24-4bcd-a159-bcb73fd200d9 None admin] PATH_INFO: `/v3/groups` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:45.305226 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4682d-7d24-4bcd-a159-bcb73fd200d9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:45.306698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4682d-7d24-4bcd-a159-bcb73fd200d9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:45.357377 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262481da-9f65-4ddf-a2b1-0e430c2960bf None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:45.388972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0d144-50d7-4db6-8507-4942be4a0ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:45.389721 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0d144-50d7-4db6-8507-4942be4a0ece None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:45.389994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0d144-50d7-4db6-8507-4942be4a0ece None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:45.390266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0d144-50d7-4db6-8507-4942be4a0ece None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:45.391031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0d144-50d7-4db6-8507-4942be4a0ece None admin] RBAC: Adding query filter params (name=reader) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:45.391333 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0d144-50d7-4db6-8507-4942be4a0ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:45.392704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0d144-50d7-4db6-8507-4942be4a0ece None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:45.400368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 173/331] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:45.408058 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0d144-50d7-4db6-8507-4942be4a0ece None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:45.428399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 159/332] 10.222.0.44 () {60 vars in 1134 bytes} [Thu May 5 15:12:45 2022] POST /identity/v3/groups => generated 226 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:12:45.527155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0d144-50d7-4db6-8507-4942be4a0ece None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:45.565314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb65785-7928-4e14-8361-af6e6a2b055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:45.566128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb65785-7928-4e14-8361-af6e6a2b055d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:45.566457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb65785-7928-4e14-8361-af6e6a2b055d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:45.566737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb65785-7928-4e14-8361-af6e6a2b055d None admin] PATH_INFO: `/v3/users/d80c118d1f764aa6802bf2437fc3407a` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:45.568018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb65785-7928-4e14-8361-af6e6a2b055d None admin] RBAC: Authorizing `identity:get_user(user_id=d80c118d1f764aa6802bf2437fc3407a)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:45.569498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb65785-7928-4e14-8361-af6e6a2b055d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:45.571477 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 174/333] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:45 2022] GET /identity/v3/users/d80c118d1f764aa6802bf2437fc3407a => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:45.577722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4682d-7d24-4bcd-a159-bcb73fd200d9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:45.699101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4682d-7d24-4bcd-a159-bcb73fd200d9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:45.738228 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d124cb-3a0f-44c9-95d6-022ec88c424c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:45.739368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d124cb-3a0f-44c9-95d6-022ec88c424c None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:45.739658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d124cb-3a0f-44c9-95d6-022ec88c424c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:45.739942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d124cb-3a0f-44c9-95d6-022ec88c424c None admin] PATH_INFO: `/v3/system/users/d80c118d1f764aa6802bf2437fc3407a/roles/a4ca52325cbd4f7192e085966d529a71` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:45.741550 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d124cb-3a0f-44c9-95d6-022ec88c424c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d80c118d1f764aa6802bf2437fc3407a, role_id=a4ca52325cbd4f7192e085966d529a71)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:45.742993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d124cb-3a0f-44c9-95d6-022ec88c424c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:45.801220 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 160/334] 10.222.0.44 () {58 vars in 1334 bytes} [Thu May 5 15:12:45 2022] PUT /identity/v3/system/users/d80c118d1f764aa6802bf2437fc3407a/roles/a4ca52325cbd4f7192e085966d529a71 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:12:48.328180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0087506-06c8-4372-861b-cce18183fbf9 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:48.329047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0087506-06c8-4372-861b-cce18183fbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:48.329475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0087506-06c8-4372-861b-cce18183fbf9 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:48.331030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 175/335] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:48.336617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a37cf1-23a6-49f9-b870-4c96fc1a25e5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:48.337485 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a37cf1-23a6-49f9-b870-4c96fc1a25e5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:48.337995 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a37cf1-23a6-49f9-b870-4c96fc1a25e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:48.363324 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b0a37cf1-23a6-49f9-b870-4c96fc1a25e5 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:48.364897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b0a37cf1-23a6-49f9-b870-4c96fc1a25e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:48.438685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 161/336] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:48.471028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0087506-06c8-4372-861b-cce18183fbf9 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:48.599793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcce267-4ece-4648-8264-60ab52922dda None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:48.600403 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcce267-4ece-4648-8264-60ab52922dda None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:48.600894 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcce267-4ece-4648-8264-60ab52922dda None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:48.606369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 162/337] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:48.608350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0087506-06c8-4372-861b-cce18183fbf9 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:48.615026 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada7690-8218-4e97-9b65-8190c93fdcee None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:48.615645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada7690-8218-4e97-9b65-8190c93fdcee None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:48.616145 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada7690-8218-4e97-9b65-8190c93fdcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:48.656636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1ada7690-8218-4e97-9b65-8190c93fdcee None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:48.658356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1ada7690-8218-4e97-9b65-8190c93fdcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:48.658587 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1987c6-7322-41ba-8bc4-123b3cb9ca22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:48.659713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1987c6-7322-41ba-8bc4-123b3cb9ca22 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:48.660154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1987c6-7322-41ba-8bc4-123b3cb9ca22 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:48.660571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1987c6-7322-41ba-8bc4-123b3cb9ca22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:48.678717 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1987c6-7322-41ba-8bc4-123b3cb9ca22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-9c1987c6-7322-41ba-8bc4-123b3cb9ca22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:48.688386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:48.689498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:48.690526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:48.690526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:48.690526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:48.690526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:48.690526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:48.690526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:48.690526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:48.690526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:48.690526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:48.690526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:48.690526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:48.690526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:48.692912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 176/338] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:12:48.698215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1987c6-7322-41ba-8bc4-123b3cb9ca22 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:48.831277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1987c6-7322-41ba-8bc4-123b3cb9ca22 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:48.833091 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 163/339] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 05 15:12:48.865833 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada7690-8218-4e97-9b65-8190c93fdcee None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:48.868546 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31098ec6-8992-41a1-a464-294c35b21b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:48.869230 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31098ec6-8992-41a1-a464-294c35b21b09 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:48.869517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31098ec6-8992-41a1-a464-294c35b21b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:48.869798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31098ec6-8992-41a1-a464-294c35b21b09 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:48.870589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31098ec6-8992-41a1-a464-294c35b21b09 None admin] RBAC: Adding query filter params (name=member) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:48.870898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31098ec6-8992-41a1-a464-294c35b21b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:48.872275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31098ec6-8992-41a1-a464-294c35b21b09 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:48.888871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 177/340] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:48.890624 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092bd25-ae4e-47ea-8645-48b2b08d78de None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:48.891004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092bd25-ae4e-47ea-8645-48b2b08d78de None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:48.891182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092bd25-ae4e-47ea-8645-48b2b08d78de None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:48.893138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 178/341] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:48.899381 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092bd25-ae4e-47ea-8645-48b2b08d78de None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:49.019566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092bd25-ae4e-47ea-8645-48b2b08d78de None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:49.069008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09dbc7-d65b-4b52-9eec-45b63dc29f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:49.069691 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09dbc7-d65b-4b52-9eec-45b63dc29f12 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:49.069978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09dbc7-d65b-4b52-9eec-45b63dc29f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:49.070259 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09dbc7-d65b-4b52-9eec-45b63dc29f12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:49.115264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada7690-8218-4e97-9b65-8190c93fdcee None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:49.149687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09dbc7-d65b-4b52-9eec-45b63dc29f12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:49.151705 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09dbc7-d65b-4b52-9eec-45b63dc29f12 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:49.168211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe86ecf-a3d9-4ece-be77-5709aa304c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:49.169323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe86ecf-a3d9-4ece-be77-5709aa304c72 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:49.169764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe86ecf-a3d9-4ece-be77-5709aa304c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:49.170184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe86ecf-a3d9-4ece-be77-5709aa304c72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:49.181545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe86ecf-a3d9-4ece-be77-5709aa304c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9fe86ecf-a3d9-4ece-be77-5709aa304c72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:49.190499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:49.191641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:49.192579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:49.192579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:49.192579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:49.192579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:49.192579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:49.192579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:49.192579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:49.192579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:49.192579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:49.192579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:49.192579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:49.192579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:49.196684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 164/342] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:12:49.198253 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efb47e-b4d8-4d19-9b6a-19e3db59b5f1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:49.198711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efb47e-b4d8-4d19-9b6a-19e3db59b5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:49.199138 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efb47e-b4d8-4d19-9b6a-19e3db59b5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:49.219974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c3efb47e-b4d8-4d19-9b6a-19e3db59b5f1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:49.221932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c3efb47e-b4d8-4d19-9b6a-19e3db59b5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:49.282034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 179/343] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:49.284018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacbdfb-4f19-4998-be06-676999425307 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:49.284763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacbdfb-4f19-4998-be06-676999425307 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:49.285472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacbdfb-4f19-4998-be06-676999425307 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:49.287614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 180/344] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:49.288487 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacbdfb-4f19-4998-be06-676999425307 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:49.320596 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 165/345] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:49.321747 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efb47e-b4d8-4d19-9b6a-19e3db59b5f1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:49.407878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacbdfb-4f19-4998-be06-676999425307 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:49.429022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efb47e-b4d8-4d19-9b6a-19e3db59b5f1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:49.443758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd507c-0f0d-4736-829e-3545e0360859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:49.444690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd507c-0f0d-4736-829e-3545e0360859 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:49.445162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd507c-0f0d-4736-829e-3545e0360859 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:49.445642 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd507c-0f0d-4736-829e-3545e0360859 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:49.446669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd507c-0f0d-4736-829e-3545e0360859 None admin] RBAC: Adding query filter params (name=member) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:49.447200 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd507c-0f0d-4736-829e-3545e0360859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:49.448839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd507c-0f0d-4736-829e-3545e0360859 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:49.459239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 181/346] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:49.460905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e341f2-2918-4618-b50b-cf8e57bd01a5 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:49.461396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e341f2-2918-4618-b50b-cf8e57bd01a5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:49.461900 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e341f2-2918-4618-b50b-cf8e57bd01a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:49.468679 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbce15-fcb6-419f-8193-82e87483df92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:49.469729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbce15-fcb6-419f-8193-82e87483df92 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:49.470015 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbce15-fcb6-419f-8193-82e87483df92 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:49.470307 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbce15-fcb6-419f-8193-82e87483df92 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:49.471537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbce15-fcb6-419f-8193-82e87483df92 None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:49.473482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbce15-fcb6-419f-8193-82e87483df92 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:49.475691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 166/347] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:49 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:49.476510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbce15-fcb6-419f-8193-82e87483df92 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:49.481616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-65e341f2-2918-4618-b50b-cf8e57bd01a5 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:49.483154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-65e341f2-2918-4618-b50b-cf8e57bd01a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:49.553709 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 182/348] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:49.559344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e341f2-2918-4618-b50b-cf8e57bd01a5 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:49.581768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbce15-fcb6-419f-8193-82e87483df92 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:49.620482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3db360-b1ee-4ef8-b848-266572a91031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:49.621691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3db360-b1ee-4ef8-b848-266572a91031 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:49.622149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3db360-b1ee-4ef8-b848-266572a91031 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:49.622618 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3db360-b1ee-4ef8-b848-266572a91031 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:49.634444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3db360-b1ee-4ef8-b848-266572a91031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ab3db360-b1ee-4ef8-b848-266572a91031 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:49.644893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:49.645882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:49.646722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:49.646722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:49.646722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:49.646722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:49.646722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:49.646722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:49.646722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:49.646722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:49.646722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:49.646722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:49.646722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:49.646722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:49.649879 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 167/349] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:12:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:49.651063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3db360-b1ee-4ef8-b848-266572a91031 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:49.691389 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e341f2-2918-4618-b50b-cf8e57bd01a5 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:49.729755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06035e33-1a6d-4384-8936-4484021c6c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:49.730711 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06035e33-1a6d-4384-8936-4484021c6c90 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:49.731329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06035e33-1a6d-4384-8936-4484021c6c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:49.731827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06035e33-1a6d-4384-8936-4484021c6c90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:49.766955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3db360-b1ee-4ef8-b848-266572a91031 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:49.802142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2e707-9cf0-4d26-abcc-5efef3c5b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:49.803321 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2e707-9cf0-4d26-abcc-5efef3c5b7ef None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:49.803752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2e707-9cf0-4d26-abcc-5efef3c5b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:49.804214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2e707-9cf0-4d26-abcc-5efef3c5b7ef None admin] PATH_INFO: `/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:49.804405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06035e33-1a6d-4384-8936-4484021c6c90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:49.806040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06035e33-1a6d-4384-8936-4484021c6c90 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:49.811322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2e707-9cf0-4d26-abcc-5efef3c5b7ef None admin] RBAC: Authorizing `identity:get_group(group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:49.813060 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2e707-9cf0-4d26-abcc-5efef3c5b7ef None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:49.815023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 168/350] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:12:49 2022] GET /identity/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:49.816001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2e707-9cf0-4d26-abcc-5efef3c5b7ef None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:49.913456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 183/351] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:49.915998 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06035e33-1a6d-4384-8936-4484021c6c90 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:49.924502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2e707-9cf0-4d26-abcc-5efef3c5b7ef None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:49.971861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b43fc-fadd-40e8-b4cd-7b264aabc0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:49.972462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b43fc-fadd-40e8-b4cd-7b264aabc0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:49.972747 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b43fc-fadd-40e8-b4cd-7b264aabc0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:49.973024 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b43fc-fadd-40e8-b4cd-7b264aabc0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:49.973772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b43fc-fadd-40e8-b4cd-7b264aabc0f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:49.974080 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b43fc-fadd-40e8-b4cd-7b264aabc0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:49.975520 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b43fc-fadd-40e8-b4cd-7b264aabc0f1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:49.985634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 169/352] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:12:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:49.986882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b43fc-fadd-40e8-b4cd-7b264aabc0f1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:50.041600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06035e33-1a6d-4384-8936-4484021c6c90 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:50.083744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f3ba-f35a-4a47-90de-76293a590f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:50.084961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f3ba-f35a-4a47-90de-76293a590f57 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:50.085307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f3ba-f35a-4a47-90de-76293a590f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:50.085782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f3ba-f35a-4a47-90de-76293a590f57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:50.100579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434f3ba-f35a-4a47-90de-76293a590f57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-8434f3ba-f35a-4a47-90de-76293a590f57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:50.109550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:50.110801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:50.111597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:50.111597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:50.111597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:50.111597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:50.111597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:50.111597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:50.111597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:50.111597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:50.111597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:50.111597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:50.111597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:12:50.111597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:50.117387 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 184/353] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:50.117387 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3dc0d-5218-4e4c-b509-276fa8fb36e7 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:50.117387 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3dc0d-5218-4e4c-b509-276fa8fb36e7 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:50.117387 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3dc0d-5218-4e4c-b509-276fa8fb36e7 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:50.117978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 185/354] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:50.118602 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3dc0d-5218-4e4c-b509-276fa8fb36e7 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:50.129396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b43fc-fadd-40e8-b4cd-7b264aabc0f1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:50.172154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457d48f-4b57-48dc-9bfb-8f0e19d32971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:50.172827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457d48f-4b57-48dc-9bfb-8f0e19d32971 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:50.173111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457d48f-4b57-48dc-9bfb-8f0e19d32971 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:50.173387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457d48f-4b57-48dc-9bfb-8f0e19d32971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:50.174225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457d48f-4b57-48dc-9bfb-8f0e19d32971 None admin] RBAC: Adding query filter params (group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5, role.id=e2401a0c8c204431b0eff57c19186866, scope.project.id=7192d8f0799049abb47bcece952f59e6) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:50.174589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457d48f-4b57-48dc-9bfb-8f0e19d32971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:50.176027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457d48f-4b57-48dc-9bfb-8f0e19d32971 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:50.183914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 170/355] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 5 15:12:49 2022] GET /identity/v3/role_assignments?group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5&scope.project.id=7192d8f0799049abb47bcece952f59e6&role.id=e2401a0c8c204431b0eff57c19186866 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:50.185152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457d48f-4b57-48dc-9bfb-8f0e19d32971 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:50.270941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3dc0d-5218-4e4c-b509-276fa8fb36e7 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:50.312137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1475c7a-627c-4960-b428-3368b09420a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:50.313301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1475c7a-627c-4960-b428-3368b09420a2 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:50.313587 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1475c7a-627c-4960-b428-3368b09420a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:50.313963 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1475c7a-627c-4960-b428-3368b09420a2 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:50.317543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1475c7a-627c-4960-b428-3368b09420a2 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:50.319671 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457d48f-4b57-48dc-9bfb-8f0e19d32971 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:50.319803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1475c7a-627c-4960-b428-3368b09420a2 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:50.321713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 186/356] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:50 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:50.322712 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1475c7a-627c-4960-b428-3368b09420a2 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:50.372384 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767ec82-8541-41a9-af58-9c4b20c1da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:50.373057 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ec82-8541-41a9-af58-9c4b20c1da2a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:50.373342 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ec82-8541-41a9-af58-9c4b20c1da2a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:50.374141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ec82-8541-41a9-af58-9c4b20c1da2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:50.451606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1475c7a-627c-4960-b428-3368b09420a2 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:50.458629 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767ec82-8541-41a9-af58-9c4b20c1da2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:50.460657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767ec82-8541-41a9-af58-9c4b20c1da2a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:50.491454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce329e-91a0-46c9-93a5-4fbe0a6c9911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:50.492699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce329e-91a0-46c9-93a5-4fbe0a6c9911 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:50.493164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce329e-91a0-46c9-93a5-4fbe0a6c9911 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:50.493580 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce329e-91a0-46c9-93a5-4fbe0a6c9911 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:50.494588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce329e-91a0-46c9-93a5-4fbe0a6c9911 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:50.495082 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce329e-91a0-46c9-93a5-4fbe0a6c9911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:50.496638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce329e-91a0-46c9-93a5-4fbe0a6c9911 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:50.509067 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 187/357] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:50.510696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aed66-cbf6-4cbd-9ce7-7c0e3fb7c104 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:50.510993 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aed66-cbf6-4cbd-9ce7-7c0e3fb7c104 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:50.511280 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aed66-cbf6-4cbd-9ce7-7c0e3fb7c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:50.531975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e54aed66-cbf6-4cbd-9ce7-7c0e3fb7c104 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:50.533107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e54aed66-cbf6-4cbd-9ce7-7c0e3fb7c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:50.582372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 171/358] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:50.584966 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33a9df-fe65-40b4-9be2-57146ccf0c7e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:50.585460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33a9df-fe65-40b4-9be2-57146ccf0c7e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:50.585951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33a9df-fe65-40b4-9be2-57146ccf0c7e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:50.587567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 172/359] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:50.588913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33a9df-fe65-40b4-9be2-57146ccf0c7e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:50.621917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 188/360] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:50.623132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aed66-cbf6-4cbd-9ce7-7c0e3fb7c104 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:50.722033 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33a9df-fe65-40b4-9be2-57146ccf0c7e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:50.743911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aed66-cbf6-4cbd-9ce7-7c0e3fb7c104 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:50.766668 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4dc31-43c2-45a8-afee-7929d06a78b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:50.767820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4dc31-43c2-45a8-afee-7929d06a78b7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:50.768110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4dc31-43c2-45a8-afee-7929d06a78b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:50.768391 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4dc31-43c2-45a8-afee-7929d06a78b7 None admin] PATH_INFO: `/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:50.769580 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4dc31-43c2-45a8-afee-7929d06a78b7 None admin] RBAC: Authorizing `identity:get_group(group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:50.771101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4dc31-43c2-45a8-afee-7929d06a78b7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:50.774447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 173/361] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:12:50 2022] GET /identity/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:50.774447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4dc31-43c2-45a8-afee-7929d06a78b7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:50.789600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0392-4bc6-4945-9855-efe5a2a15b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:50.790788 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0392-4bc6-4945-9855-efe5a2a15b21 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:50.791224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0392-4bc6-4945-9855-efe5a2a15b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:50.791554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0392-4bc6-4945-9855-efe5a2a15b21 None admin] PATH_INFO: `/v3/users/d80c118d1f764aa6802bf2437fc3407a` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:50.792834 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd0392-4bc6-4945-9855-efe5a2a15b21 None admin] RBAC: Authorizing `identity:get_user(user_id=d80c118d1f764aa6802bf2437fc3407a)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:50.794621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd0392-4bc6-4945-9855-efe5a2a15b21 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:50.798174 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 189/362] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:12:50 2022] GET /identity/v3/users/d80c118d1f764aa6802bf2437fc3407a => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:50.799632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552ecd3-4d4e-4c86-80b9-213e1fba9c1c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:50.800122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552ecd3-4d4e-4c86-80b9-213e1fba9c1c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:50.800595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552ecd3-4d4e-4c86-80b9-213e1fba9c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:50.818908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-0552ecd3-4d4e-4c86-80b9-213e1fba9c1c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:50.820321 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-0552ecd3-4d4e-4c86-80b9-213e1fba9c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:50.895427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 190/363] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:50.899253 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552ecd3-4d4e-4c86-80b9-213e1fba9c1c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:50.907389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4dc31-43c2-45a8-afee-7929d06a78b7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:50.955112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c5bbb-9c2b-4378-b9fc-6c7e54f19cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:50.955987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c5bbb-9c2b-4378-b9fc-6c7e54f19cfa None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:50.956430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c5bbb-9c2b-4378-b9fc-6c7e54f19cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:50.956533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c5bbb-9c2b-4378-b9fc-6c7e54f19cfa None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:50.957725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c5bbb-9c2b-4378-b9fc-6c7e54f19cfa None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:50.959349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c5bbb-9c2b-4378-b9fc-6c7e54f19cfa None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:50.961401 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 174/364] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:50 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:50.962929 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c5bbb-9c2b-4378-b9fc-6c7e54f19cfa None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:51.032465 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552ecd3-4d4e-4c86-80b9-213e1fba9c1c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:51.080566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4ab2e-4f60-4d1c-a530-d68c184d306f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:51.081743 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4ab2e-4f60-4d1c-a530-d68c184d306f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:51.082230 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4ab2e-4f60-4d1c-a530-d68c184d306f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:51.082744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4ab2e-4f60-4d1c-a530-d68c184d306f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:51.096210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4ab2e-4f60-4d1c-a530-d68c184d306f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:51.102381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c5bbb-9c2b-4378-b9fc-6c7e54f19cfa None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-00a4ab2e-4f60-4d1c-a530-d68c184d306f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:51.105119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:51.106119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:51.107181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:51.107181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:51.107181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:51.107181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:51.107181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:51.107181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:51.107181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:51.107181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:51.107181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:51.107181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:51.107181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:51.107181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:51.107181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 191/365] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:12:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:51.110422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4ab2e-4f60-4d1c-a530-d68c184d306f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:51.143311 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d851b83-11f1-46ec-8472-e56452cc596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:51.144283 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d851b83-11f1-46ec-8472-e56452cc596e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:51.144767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d851b83-11f1-46ec-8472-e56452cc596e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:51.145245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d851b83-11f1-46ec-8472-e56452cc596e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:51.146258 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d851b83-11f1-46ec-8472-e56452cc596e None admin] RBAC: Adding query filter params (group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5, role.id=e2401a0c8c204431b0eff57c19186866, scope.project.id=ab41116bb62b44b9bd7c18431c0286a3) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:51.146847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d851b83-11f1-46ec-8472-e56452cc596e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:51.148585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d851b83-11f1-46ec-8472-e56452cc596e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:51.158323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 175/366] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 5 15:12:50 2022] GET /identity/v3/role_assignments?group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5&scope.project.id=ab41116bb62b44b9bd7c18431c0286a3&role.id=e2401a0c8c204431b0eff57c19186866 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:51.158323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d851b83-11f1-46ec-8472-e56452cc596e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:51.281319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4ab2e-4f60-4d1c-a530-d68c184d306f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:51.299670 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d851b83-11f1-46ec-8472-e56452cc596e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:51.328613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133adc4a-dd41-4c02-9c16-489a56c200f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:51.329851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133adc4a-dd41-4c02-9c16-489a56c200f2 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:51.330301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133adc4a-dd41-4c02-9c16-489a56c200f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:51.330801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133adc4a-dd41-4c02-9c16-489a56c200f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:51.332341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133adc4a-dd41-4c02-9c16-489a56c200f2 None admin] RBAC: Adding query filter params (role.id=a4ca52325cbd4f7192e085966d529a71, user.id=d80c118d1f764aa6802bf2437fc3407a, scope.system=all) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:51.333159 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133adc4a-dd41-4c02-9c16-489a56c200f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:51.335397 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133adc4a-dd41-4c02-9c16-489a56c200f2 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:51.346451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4f46d-2ed5-425d-826b-5d67c254d401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:51.347692 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4f46d-2ed5-425d-826b-5d67c254d401 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:51.348164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4f46d-2ed5-425d-826b-5d67c254d401 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:51.348665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4f46d-2ed5-425d-826b-5d67c254d401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:51.351359 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 192/367] 10.222.0.44 () {56 vars in 1308 bytes} [Thu May 5 15:12:51 2022] GET /identity/v3/role_assignments?user.id=d80c118d1f764aa6802bf2437fc3407a&scope.system=all&role.id=a4ca52325cbd4f7192e085966d529a71 => generated 510 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:51.352142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133adc4a-dd41-4c02-9c16-489a56c200f2 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:51.362295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4f46d-2ed5-425d-826b-5d67c254d401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-bbf4f46d-2ed5-425d-826b-5d67c254d401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:51.370663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:51.371616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:51.372411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:51.372411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:51.372411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:51.372411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:51.372411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:51.372411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:51.372411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:51.372411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:51.372411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:51.372411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:51.372411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:51.372411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:51.374677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 176/368] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:12:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:51.375686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4f46d-2ed5-425d-826b-5d67c254d401 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:51.493759 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4f46d-2ed5-425d-826b-5d67c254d401 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:51.531381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc8a69-708a-4a08-a6d0-c6993f0b9730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:51.532632 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc8a69-708a-4a08-a6d0-c6993f0b9730 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:51.533087 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc8a69-708a-4a08-a6d0-c6993f0b9730 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:51.533505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc8a69-708a-4a08-a6d0-c6993f0b9730 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:51.534568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc8a69-708a-4a08-a6d0-c6993f0b9730 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:51.535035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc8a69-708a-4a08-a6d0-c6993f0b9730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:51.536810 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc8a69-708a-4a08-a6d0-c6993f0b9730 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:51.546810 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 177/369] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:12:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:51.547992 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc8a69-708a-4a08-a6d0-c6993f0b9730 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:51.566514 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133adc4a-dd41-4c02-9c16-489a56c200f2 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:51.617537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503398dd-cfc2-4bd0-8a7c-a3822ad2c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:51.618367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503398dd-cfc2-4bd0-8a7c-a3822ad2c61a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:51.618652 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503398dd-cfc2-4bd0-8a7c-a3822ad2c61a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:51.618925 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503398dd-cfc2-4bd0-8a7c-a3822ad2c61a None admin] PATH_INFO: `/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:51.620177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503398dd-cfc2-4bd0-8a7c-a3822ad2c61a None admin] RBAC: Authorizing `identity:get_group(group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:51.622010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503398dd-cfc2-4bd0-8a7c-a3822ad2c61a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:51.623317 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 193/370] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:12:51 2022] GET /identity/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:51.624616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503398dd-cfc2-4bd0-8a7c-a3822ad2c61a None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:51.661857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc8a69-708a-4a08-a6d0-c6993f0b9730 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:51.697151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359d4df-7de6-4062-8616-97b95191078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:51.698070 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359d4df-7de6-4062-8616-97b95191078f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:51.698606 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359d4df-7de6-4062-8616-97b95191078f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:51.699029 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359d4df-7de6-4062-8616-97b95191078f None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:51.701001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359d4df-7de6-4062-8616-97b95191078f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:51.701588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359d4df-7de6-4062-8616-97b95191078f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:51.703916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359d4df-7de6-4062-8616-97b95191078f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:51.713255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 178/371] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:51.714420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359d4df-7de6-4062-8616-97b95191078f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:51.776499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503398dd-cfc2-4bd0-8a7c-a3822ad2c61a None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:51.829526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ce320-ce43-47ec-8050-a248b15c4574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:51.830191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ce320-ce43-47ec-8050-a248b15c4574 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:51.830507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ce320-ce43-47ec-8050-a248b15c4574 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:51.830842 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ce320-ce43-47ec-8050-a248b15c4574 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:51.834601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359d4df-7de6-4062-8616-97b95191078f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:51.871064 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807a572-8e55-4d43-a7ca-3ab45caa8a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:51.871949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807a572-8e55-4d43-a7ca-3ab45caa8a00 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:51.872375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807a572-8e55-4d43-a7ca-3ab45caa8a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:51.872796 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807a572-8e55-4d43-a7ca-3ab45caa8a00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:51.873858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807a572-8e55-4d43-a7ca-3ab45caa8a00 None admin] RBAC: Adding query filter params (group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5, role.id=44468cf4511643498cf7830993b8c9e5, scope.project.id=7192d8f0799049abb47bcece952f59e6) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:51.874338 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807a572-8e55-4d43-a7ca-3ab45caa8a00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:51.875998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807a572-8e55-4d43-a7ca-3ab45caa8a00 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:51.882258 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 179/372] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 5 15:12:51 2022] GET /identity/v3/role_assignments?group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5&scope.project.id=7192d8f0799049abb47bcece952f59e6&role.id=44468cf4511643498cf7830993b8c9e5 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:51.883289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807a572-8e55-4d43-a7ca-3ab45caa8a00 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:51.919625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ce320-ce43-47ec-8050-a248b15c4574 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:51.921837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ce320-ce43-47ec-8050-a248b15c4574 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:51.999590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807a572-8e55-4d43-a7ca-3ab45caa8a00 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:52.030831 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 194/373] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:52.036873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ce320-ce43-47ec-8050-a248b15c4574 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:52.038769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6ed57-256f-4136-8a52-1dcd6b0ea395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:52.039623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6ed57-256f-4136-8a52-1dcd6b0ea395 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:52.040050 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6ed57-256f-4136-8a52-1dcd6b0ea395 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:52.040471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6ed57-256f-4136-8a52-1dcd6b0ea395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:52.115040 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6ed57-256f-4136-8a52-1dcd6b0ea395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:52.116782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6ed57-256f-4136-8a52-1dcd6b0ea395 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:52.142943 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ce320-ce43-47ec-8050-a248b15c4574 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:52.179689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3a79a-3cab-4983-a818-1d2d9c2e3cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:52.180337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a79a-3cab-4983-a818-1d2d9c2e3cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:52.180617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a79a-3cab-4983-a818-1d2d9c2e3cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:52.180891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a79a-3cab-4983-a818-1d2d9c2e3cc1 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:52.182162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3a79a-3cab-4983-a818-1d2d9c2e3cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:52.183634 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3a79a-3cab-4983-a818-1d2d9c2e3cc1 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:52.190481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 195/374] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:52 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:52.191393 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3a79a-3cab-4983-a818-1d2d9c2e3cc1 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:52.231880 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 180/375] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:52.239357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6ed57-256f-4136-8a52-1dcd6b0ea395 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:52.314703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3a79a-3cab-4983-a818-1d2d9c2e3cc1 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:52.360032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6ed57-256f-4136-8a52-1dcd6b0ea395 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:52.362367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a73d-3811-4fac-b58a-4d8a71227891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:52.364265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a73d-3811-4fac-b58a-4d8a71227891 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:52.364699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a73d-3811-4fac-b58a-4d8a71227891 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:52.365117 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a73d-3811-4fac-b58a-4d8a71227891 None admin] PATH_INFO: `/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:52.366594 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3a73d-3811-4fac-b58a-4d8a71227891 None admin] RBAC: Authorizing `identity:get_group(group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:52.368703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3a73d-3811-4fac-b58a-4d8a71227891 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:52.370651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 196/376] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:12:52 2022] GET /identity/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:52.379459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a73d-3811-4fac-b58a-4d8a71227891 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:52.406161 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7a6a7-7cdc-43dc-bcec-18009b74b88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:52.407085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7a6a7-7cdc-43dc-bcec-18009b74b88f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:52.407442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7a6a7-7cdc-43dc-bcec-18009b74b88f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:52.407790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7a6a7-7cdc-43dc-bcec-18009b74b88f None admin] PATH_INFO: `/v3/projects/02855100ad2c4964b2978e96832f8664` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:52.409179 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7a6a7-7cdc-43dc-bcec-18009b74b88f None admin] RBAC: Authorizing `identity:get_project(project_id=02855100ad2c4964b2978e96832f8664)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:52.410790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7a6a7-7cdc-43dc-bcec-18009b74b88f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:52.413154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 181/377] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:52 2022] GET /identity/v3/projects/02855100ad2c4964b2978e96832f8664 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:52.419500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7a6a7-7cdc-43dc-bcec-18009b74b88f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:52.504392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a73d-3811-4fac-b58a-4d8a71227891 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:52.540471 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187a0a4-8f33-417b-ad0b-ff0823b43af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:52.541139 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a0a4-8f33-417b-ad0b-ff0823b43af5 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:52.541427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a0a4-8f33-417b-ad0b-ff0823b43af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:52.542009 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a0a4-8f33-417b-ad0b-ff0823b43af5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:52.542896 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187a0a4-8f33-417b-ad0b-ff0823b43af5 None admin] RBAC: Adding query filter params (group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5, role.id=44468cf4511643498cf7830993b8c9e5, scope.project.id=ab41116bb62b44b9bd7c18431c0286a3) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:52.543378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187a0a4-8f33-417b-ad0b-ff0823b43af5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:52.544847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187a0a4-8f33-417b-ad0b-ff0823b43af5 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:52.552007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 197/378] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 5 15:12:52 2022] GET /identity/v3/role_assignments?group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5&scope.project.id=ab41116bb62b44b9bd7c18431c0286a3&role.id=44468cf4511643498cf7830993b8c9e5 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:52.560675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7a6a7-7cdc-43dc-bcec-18009b74b88f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:52.628851 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eddb73-4bbf-40b5-a5de-51ace4e78c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:52.629750 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eddb73-4bbf-40b5-a5de-51ace4e78c38 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:52.630032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eddb73-4bbf-40b5-a5de-51ace4e78c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:52.630327 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eddb73-4bbf-40b5-a5de-51ace4e78c38 None admin] PATH_INFO: `/v3/groups/1ecd01eaf5724a05bc22c4af07f9f3c3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:52.640965 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eddb73-4bbf-40b5-a5de-51ace4e78c38 None admin] RBAC: Authorizing `identity:get_group(group_id=1ecd01eaf5724a05bc22c4af07f9f3c3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:52.642493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eddb73-4bbf-40b5-a5de-51ace4e78c38 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:52.645639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 182/379] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:12:52 2022] GET /identity/v3/groups/1ecd01eaf5724a05bc22c4af07f9f3c3 => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:52.650803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187a0a4-8f33-417b-ad0b-ff0823b43af5 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:52.826364 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187a0a4-8f33-417b-ad0b-ff0823b43af5 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:52.871410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adf81d-c0b9-4adb-a25b-76e513262d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:52.872091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adf81d-c0b9-4adb-a25b-76e513262d7b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:52.872378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adf81d-c0b9-4adb-a25b-76e513262d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:52.872659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adf81d-c0b9-4adb-a25b-76e513262d7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:52.873643 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adf81d-c0b9-4adb-a25b-76e513262d7b None admin] RBAC: Adding query filter params (group.id=1ecd01eaf5724a05bc22c4af07f9f3c3, role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=02855100ad2c4964b2978e96832f8664) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:52.874489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adf81d-c0b9-4adb-a25b-76e513262d7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:52.876044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adf81d-c0b9-4adb-a25b-76e513262d7b None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:52.885104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 198/380] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 5 15:12:52 2022] GET /identity/v3/role_assignments?group.id=1ecd01eaf5724a05bc22c4af07f9f3c3&scope.project.id=02855100ad2c4964b2978e96832f8664&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:52.907121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c3a3a-9f05-40cf-9486-83374c0224f3 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:52.907121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c3a3a-9f05-40cf-9486-83374c0224f3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:52.907121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c3a3a-9f05-40cf-9486-83374c0224f3 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:52.907797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 183/381] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:52.914249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6712-a9aa-43db-af9a-8e5a3e7e5b50 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:52.914569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6712-a9aa-43db-af9a-8e5a3e7e5b50 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:52.914859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6712-a9aa-43db-af9a-8e5a3e7e5b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:52.935014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-0bce6712-a9aa-43db-af9a-8e5a3e7e5b50 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:52.936855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-0bce6712-a9aa-43db-af9a-8e5a3e7e5b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:53.031945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 199/382] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:53.071200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c3a3a-9f05-40cf-9486-83374c0224f3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:53.217127 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c3a3a-9f05-40cf-9486-83374c0224f3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:53.263030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5ec83-6b04-4b36-9b8a-c4105e6ca10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:53.263860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5ec83-6b04-4b36-9b8a-c4105e6ca10a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:53.264192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5ec83-6b04-4b36-9b8a-c4105e6ca10a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:53.265079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5ec83-6b04-4b36-9b8a-c4105e6ca10a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:53.275978 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5ec83-6b04-4b36-9b8a-c4105e6ca10a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-42b5ec83-6b04-4b36-9b8a-c4105e6ca10a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:53.285083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:53.286349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:53.287141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:53.287141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:53.287141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:53.287141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:53.287141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:53.287141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:53.287141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:53.287141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:53.287141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:53.287141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:53.287141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:53.287141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:53.287141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 184/383] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:53.294130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce6712-a9aa-43db-af9a-8e5a3e7e5b50 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:53.451188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce6712-a9aa-43db-af9a-8e5a3e7e5b50 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:53.488788 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cfd4d-f4fb-4f7b-b0eb-56f6e923a96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:53.489455 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cfd4d-f4fb-4f7b-b0eb-56f6e923a96d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:53.489743 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cfd4d-f4fb-4f7b-b0eb-56f6e923a96d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:53.490024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cfd4d-f4fb-4f7b-b0eb-56f6e923a96d None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:53.490816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cfd4d-f4fb-4f7b-b0eb-56f6e923a96d None admin] RBAC: Adding query filter params (name=member) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:53.491125 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cfd4d-f4fb-4f7b-b0eb-56f6e923a96d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:53.492518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cfd4d-f4fb-4f7b-b0eb-56f6e923a96d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:53.501695 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 200/384] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:53.511365 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5ec83-6b04-4b36-9b8a-c4105e6ca10a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:53.664268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5ec83-6b04-4b36-9b8a-c4105e6ca10a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:53.702420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1b8a2-082e-4983-a711-e79ab437af48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:53.703515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1b8a2-082e-4983-a711-e79ab437af48 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:53.703814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1b8a2-082e-4983-a711-e79ab437af48 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:53.704112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1b8a2-082e-4983-a711-e79ab437af48 None admin] PATH_INFO: `/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:53.705360 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1b8a2-082e-4983-a711-e79ab437af48 None admin] RBAC: Authorizing `identity:get_group(group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:53.706927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1b8a2-082e-4983-a711-e79ab437af48 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:53.708914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 185/385] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:12:53 2022] GET /identity/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:53.716691 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cfd4d-f4fb-4f7b-b0eb-56f6e923a96d None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:53.852775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cfd4d-f4fb-4f7b-b0eb-56f6e923a96d None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:53.897440 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35638429-275c-4999-891a-4179a4faca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:53.898367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35638429-275c-4999-891a-4179a4faca7a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:53.898659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35638429-275c-4999-891a-4179a4faca7a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:53.898936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35638429-275c-4999-891a-4179a4faca7a None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:53.900186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35638429-275c-4999-891a-4179a4faca7a None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:53.901643 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35638429-275c-4999-891a-4179a4faca7a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:53.903373 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 201/386] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:53 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:53.910217 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1b8a2-082e-4983-a711-e79ab437af48 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:54.037722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1b8a2-082e-4983-a711-e79ab437af48 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:54.080950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc691f-4076-43f8-9c05-b84d6b19b3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:54.081848 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc691f-4076-43f8-9c05-b84d6b19b3c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:54.082122 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc691f-4076-43f8-9c05-b84d6b19b3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:54.082433 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc691f-4076-43f8-9c05-b84d6b19b3c0 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:54.084438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc691f-4076-43f8-9c05-b84d6b19b3c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7192d8f0799049abb47bcece952f59e6, group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:54.085889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc691f-4076-43f8-9c05-b84d6b19b3c0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:54.172222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 186/387] 10.222.0.44 () {58 vars in 1442 bytes} [Thu May 5 15:12:53 2022] PUT /identity/v3/projects/7192d8f0799049abb47bcece952f59e6/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:54.473434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb89770-39c9-45c0-8aea-fb80d9848e7c None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:54.473695 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb89770-39c9-45c0-8aea-fb80d9848e7c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:54.474102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb89770-39c9-45c0-8aea-fb80d9848e7c None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:54.475631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 202/388] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:54.482085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc3b9b-a132-41a7-b562-7a814188dbef None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:54.482465 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc3b9b-a132-41a7-b562-7a814188dbef None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:54.482707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc3b9b-a132-41a7-b562-7a814188dbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:54.501475 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-91bc3b9b-a132-41a7-b562-7a814188dbef None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:54.502708 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-91bc3b9b-a132-41a7-b562-7a814188dbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:54.592054 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 187/389] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:54.618970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb89770-39c9-45c0-8aea-fb80d9848e7c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:54.765742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb89770-39c9-45c0-8aea-fb80d9848e7c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:54.809806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2946f-2bc4-465e-8514-75c032d896db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:54.810653 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2946f-2bc4-465e-8514-75c032d896db None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:54.810933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2946f-2bc4-465e-8514-75c032d896db None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:54.811434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2946f-2bc4-465e-8514-75c032d896db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:54.824483 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2946f-2bc4-465e-8514-75c032d896db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-31e2946f-2bc4-465e-8514-75c032d896db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:54.837093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:54.838054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:54.838894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:54.838894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:54.838894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:54.838894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:54.838894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:54.838894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:54.838894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:54.838894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:54.838894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:54.838894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:54.838894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:54.838894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:54.838894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 203/390] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:54.845555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc3b9b-a132-41a7-b562-7a814188dbef None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:54.999863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc3b9b-a132-41a7-b562-7a814188dbef None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:55.041829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75854d-7793-4eb2-bd4c-116dc23ff8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:55.042867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75854d-7793-4eb2-bd4c-116dc23ff8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:55.043353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75854d-7793-4eb2-bd4c-116dc23ff8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:55.043824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75854d-7793-4eb2-bd4c-116dc23ff8b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:55.044785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75854d-7793-4eb2-bd4c-116dc23ff8b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:55.045286 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75854d-7793-4eb2-bd4c-116dc23ff8b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:55.047009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75854d-7793-4eb2-bd4c-116dc23ff8b3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:55.056252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 188/391] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:55.062471 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2946f-2bc4-465e-8514-75c032d896db None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:55.082945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0b27b-84b7-4ace-a51a-ef11523a54b8 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:55.083556 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0b27b-84b7-4ace-a51a-ef11523a54b8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:55.084038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0b27b-84b7-4ace-a51a-ef11523a54b8 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:55.085859 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 189/392] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:55.091149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5214-8076-4bba-89be-f533635976c1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:55.091676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5214-8076-4bba-89be-f533635976c1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:55.092235 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5214-8076-4bba-89be-f533635976c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:55.112071 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-dc8d5214-8076-4bba-89be-f533635976c1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:55.113647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dc8d5214-8076-4bba-89be-f533635976c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:55.183566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 190/393] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:55.206954 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d5214-8076-4bba-89be-f533635976c1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:55.274090 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2946f-2bc4-465e-8514-75c032d896db None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:55.310137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d5214-8076-4bba-89be-f533635976c1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:55.351029 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaefc6-1c95-4682-ac55-e0718653537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:55.352192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaefc6-1c95-4682-ac55-e0718653537a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:55.352721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaefc6-1c95-4682-ac55-e0718653537a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:55.353209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaefc6-1c95-4682-ac55-e0718653537a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:55.365292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aaefc6-1c95-4682-ac55-e0718653537a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-85aaefc6-1c95-4682-ac55-e0718653537a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:55.374187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:55.375109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:55.375926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:55.375926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:55.375926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:55.375926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:55.375926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:55.375926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:55.375926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:55.375926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:55.375926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:55.375926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:55.375926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:55.375926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:55.376521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899819-db36-43aa-ad04-f88b94ffb5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:55.376521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899819-db36-43aa-ad04-f88b94ffb5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:55.376678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899819-db36-43aa-ad04-f88b94ffb5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:55.377273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899819-db36-43aa-ad04-f88b94ffb5d3 None admin] PATH_INFO: `/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:55.378170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f899819-db36-43aa-ad04-f88b94ffb5d3 None admin] RBAC: Authorizing `identity:get_group(group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:55.379341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 191/394] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:12:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:12:55.384151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f899819-db36-43aa-ad04-f88b94ffb5d3 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:55.385252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaefc6-1c95-4682-ac55-e0718653537a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:55.385553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 204/395] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:12:55 2022] GET /identity/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5 => generated 226 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:55.391750 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899819-db36-43aa-ad04-f88b94ffb5d3 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:55.492535 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaefc6-1c95-4682-ac55-e0718653537a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:55.527541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fddb9d-ef6a-42c7-8596-f4066f3d6120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:55.528578 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fddb9d-ef6a-42c7-8596-f4066f3d6120 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:55.529065 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fddb9d-ef6a-42c7-8596-f4066f3d6120 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:55.529577 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fddb9d-ef6a-42c7-8596-f4066f3d6120 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:55.531190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fddb9d-ef6a-42c7-8596-f4066f3d6120 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:55.531705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fddb9d-ef6a-42c7-8596-f4066f3d6120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:55.533288 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fddb9d-ef6a-42c7-8596-f4066f3d6120 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:55.542686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 192/396] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:12:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:55.548911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fddb9d-ef6a-42c7-8596-f4066f3d6120 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:55.584742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899819-db36-43aa-ad04-f88b94ffb5d3 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:55.657666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fddb9d-ef6a-42c7-8596-f4066f3d6120 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:55.695562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3f2ee-f311-4687-85d3-b3c2a2e01db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:55.695915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824386d-7974-4e9c-9e2a-dd10e4e3b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:55.696748 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824386d-7974-4e9c-9e2a-dd10e4e3b198 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:55.697041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824386d-7974-4e9c-9e2a-dd10e4e3b198 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:55.697323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824386d-7974-4e9c-9e2a-dd10e4e3b198 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:55.697682 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f2ee-f311-4687-85d3-b3c2a2e01db1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:55.698166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f2ee-f311-4687-85d3-b3c2a2e01db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:55.698669 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f2ee-f311-4687-85d3-b3c2a2e01db1 None admin] PATH_INFO: `/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:55.698789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824386d-7974-4e9c-9e2a-dd10e4e3b198 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:55.700195 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824386d-7974-4e9c-9e2a-dd10e4e3b198 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:55.700600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3f2ee-f311-4687-85d3-b3c2a2e01db1 None admin] RBAC: Authorizing `identity:get_group(group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:55.703102 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3f2ee-f311-4687-85d3-b3c2a2e01db1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:55.703264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 205/397] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:55 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:55.705620 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 193/398] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:12:55 2022] GET /identity/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:55.709835 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824386d-7974-4e9c-9e2a-dd10e4e3b198 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:55.711781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3f2ee-f311-4687-85d3-b3c2a2e01db1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:55.829751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3f2ee-f311-4687-85d3-b3c2a2e01db1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:55.873069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a56f6c-b3a2-4c16-a216-afdef99513e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:55.875471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56f6c-b3a2-4c16-a216-afdef99513e0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:55.875961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56f6c-b3a2-4c16-a216-afdef99513e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:55.876459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56f6c-b3a2-4c16-a216-afdef99513e0 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:55.877886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a56f6c-b3a2-4c16-a216-afdef99513e0 None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:55.879597 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a56f6c-b3a2-4c16-a216-afdef99513e0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:55.881527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 194/399] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:55 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:55.882977 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503f66-9fef-44b3-8c33-937c89db368d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:55.888419 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503f66-9fef-44b3-8c33-937c89db368d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:55.889188 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503f66-9fef-44b3-8c33-937c89db368d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:55.891024 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 195/400] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:55.891964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9503f66-9fef-44b3-8c33-937c89db368d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:55.922709 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824386d-7974-4e9c-9e2a-dd10e4e3b198 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:55.956706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841b52e-bcf5-4f40-a98a-59d4a3473bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:55.957589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841b52e-bcf5-4f40-a98a-59d4a3473bd4 None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:55.957884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841b52e-bcf5-4f40-a98a-59d4a3473bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:55.958160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841b52e-bcf5-4f40-a98a-59d4a3473bd4 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:55.960158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841b52e-bcf5-4f40-a98a-59d4a3473bd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab41116bb62b44b9bd7c18431c0286a3, group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:55.961608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841b52e-bcf5-4f40-a98a-59d4a3473bd4 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:55.996791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9503f66-9fef-44b3-8c33-937c89db368d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:56.022459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 206/401] 10.222.0.44 () {58 vars in 1442 bytes} [Thu May 5 15:12:55 2022] PUT /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:56.027971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efcbb3-b847-4100-b742-8c98f416b53c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:56.027971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efcbb3-b847-4100-b742-8c98f416b53c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:56.027971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efcbb3-b847-4100-b742-8c98f416b53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:56.042361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f61ffa-59b5-433d-b44a-d4a97be396a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:56.042610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a7efcbb3-b847-4100-b742-8c98f416b53c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:56.043303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f61ffa-59b5-433d-b44a-d4a97be396a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:56.043608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a7efcbb3-b847-4100-b742-8c98f416b53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:56.043707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f61ffa-59b5-433d-b44a-d4a97be396a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:56.043893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f61ffa-59b5-433d-b44a-d4a97be396a6 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5/roles/44468cf4511643498cf7830993b8c9e5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:56.047149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f61ffa-59b5-433d-b44a-d4a97be396a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7192d8f0799049abb47bcece952f59e6, group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5, role_id=44468cf4511643498cf7830993b8c9e5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:56.048902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f61ffa-59b5-433d-b44a-d4a97be396a6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:56.118354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 207/402] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:56.119803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde9b01-9f32-47bc-92ba-3ea510c6dbc5 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:56.120092 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde9b01-9f32-47bc-92ba-3ea510c6dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:56.120541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde9b01-9f32-47bc-92ba-3ea510c6dbc5 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:56.121934 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 208/403] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:12:56.128442 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42f49f-e9ec-4d6e-bf21-6b0937d24596 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:56.128695 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42f49f-e9ec-4d6e-bf21-6b0937d24596 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:56.129028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42f49f-e9ec-4d6e-bf21-6b0937d24596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:56.149756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 196/404] 10.222.0.44 () {58 vars in 1442 bytes} [Thu May 5 15:12:55 2022] PUT /identity/v3/projects/7192d8f0799049abb47bcece952f59e6/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5/roles/44468cf4511643498cf7830993b8c9e5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:56.157554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f61ffa-59b5-433d-b44a-d4a97be396a6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:56.163597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-bd42f49f-e9ec-4d6e-bf21-6b0937d24596 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:56.165550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-bd42f49f-e9ec-4d6e-bf21-6b0937d24596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:56.290120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 209/405] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:56.312107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f61ffa-59b5-433d-b44a-d4a97be396a6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:56.325226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42f49f-e9ec-4d6e-bf21-6b0937d24596 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:56.374105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7465d77-4cef-49b3-9d2d-be97a2916da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:56.374962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7465d77-4cef-49b3-9d2d-be97a2916da4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:56.375249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7465d77-4cef-49b3-9d2d-be97a2916da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:56.375530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7465d77-4cef-49b3-9d2d-be97a2916da4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:56.388021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7465d77-4cef-49b3-9d2d-be97a2916da4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e7465d77-4cef-49b3-9d2d-be97a2916da4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:56.396998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:56.397925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:56.398749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:56.398749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:56.398749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:56.398749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:56.398749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:56.398749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:56.398749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:56.398749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:56.398749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:56.398749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:56.398749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:56.398749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:56.399814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 197/406] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:12:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:12:56.404026 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7465d77-4cef-49b3-9d2d-be97a2916da4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:56.461704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42f49f-e9ec-4d6e-bf21-6b0937d24596 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:56.506777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb232177-2de0-4348-b9bd-1e693e1835bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:56.507710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb232177-2de0-4348-b9bd-1e693e1835bc None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:56.508334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb232177-2de0-4348-b9bd-1e693e1835bc None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:56.508687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb232177-2de0-4348-b9bd-1e693e1835bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:56.521112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb232177-2de0-4348-b9bd-1e693e1835bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-eb232177-2de0-4348-b9bd-1e693e1835bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:56.530820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:56.532401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:56.533890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:56.533890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:56.533890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:56.533890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:56.533890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:56.533890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:56.533890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:56.533890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:56.533890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:56.533890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:56.533890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:12:56.533890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:56.533890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 210/407] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:12:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:12:56.539030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb232177-2de0-4348-b9bd-1e693e1835bc None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:56.544446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7465d77-4cef-49b3-9d2d-be97a2916da4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:56.609825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450ebae-469c-4e9f-a91a-fa893607d5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:56.611431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450ebae-469c-4e9f-a91a-fa893607d5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:56.612194 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450ebae-469c-4e9f-a91a-fa893607d5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:56.612946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450ebae-469c-4e9f-a91a-fa893607d5c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:56.614673 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450ebae-469c-4e9f-a91a-fa893607d5c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:56.615495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450ebae-469c-4e9f-a91a-fa893607d5c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:56.618329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450ebae-469c-4e9f-a91a-fa893607d5c7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:56.634764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 198/408] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:12:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:56.642476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450ebae-469c-4e9f-a91a-fa893607d5c7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:56.650294 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb232177-2de0-4348-b9bd-1e693e1835bc None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:56.720838 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a988e2-7230-4776-b44a-453e5514db6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:56.721523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a988e2-7230-4776-b44a-453e5514db6d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:56.721806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a988e2-7230-4776-b44a-453e5514db6d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:56.722081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a988e2-7230-4776-b44a-453e5514db6d None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:56.722864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a988e2-7230-4776-b44a-453e5514db6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:56.723167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a988e2-7230-4776-b44a-453e5514db6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:56.724592 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a988e2-7230-4776-b44a-453e5514db6d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:56.738362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 211/409] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:56.739724 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a988e2-7230-4776-b44a-453e5514db6d None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:56.841641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a988e2-7230-4776-b44a-453e5514db6d None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:56.875446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3375e-ee13-446d-a871-cce6e76d3e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:56.876315 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3375e-ee13-446d-a871-cce6e76d3e1b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:56.876598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3375e-ee13-446d-a871-cce6e76d3e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:56.876871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3375e-ee13-446d-a871-cce6e76d3e1b None admin] PATH_INFO: `/v3/groups/1ecd01eaf5724a05bc22c4af07f9f3c3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:56.878058 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3375e-ee13-446d-a871-cce6e76d3e1b None admin] RBAC: Authorizing `identity:get_group(group_id=1ecd01eaf5724a05bc22c4af07f9f3c3)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:56.879518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3375e-ee13-446d-a871-cce6e76d3e1b None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:56.884416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450ebae-469c-4e9f-a91a-fa893607d5c7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:56.885539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 212/410] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:12:56 2022] GET /identity/v3/groups/1ecd01eaf5724a05bc22c4af07f9f3c3 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:56.886747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3375e-ee13-446d-a871-cce6e76d3e1b None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:56.951734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5da98d-474e-4909-9b45-0085d70c2fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:56.952864 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5da98d-474e-4909-9b45-0085d70c2fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:56.953150 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5da98d-474e-4909-9b45-0085d70c2fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:56.953920 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5da98d-474e-4909-9b45-0085d70c2fc1 None admin] PATH_INFO: `/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:56.959030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5da98d-474e-4909-9b45-0085d70c2fc1 None admin] RBAC: Authorizing `identity:get_group(group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:56.960503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5da98d-474e-4909-9b45-0085d70c2fc1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:56.962539 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 199/411] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:12:56 2022] GET /identity/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5 => generated 226 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:12:56.967637 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5da98d-474e-4909-9b45-0085d70c2fc1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:56.997762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3375e-ee13-446d-a871-cce6e76d3e1b None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:57.058090 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e96604-550e-4810-892b-aa37e2b2705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:57.059572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96604-550e-4810-892b-aa37e2b2705f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:57.060352 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96604-550e-4810-892b-aa37e2b2705f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:57.061173 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96604-550e-4810-892b-aa37e2b2705f None admin] PATH_INFO: `/v3/projects/02855100ad2c4964b2978e96832f8664` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:57.067592 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e96604-550e-4810-892b-aa37e2b2705f None admin] RBAC: Authorizing `identity:get_project(project_id=02855100ad2c4964b2978e96832f8664)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:57.070556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e96604-550e-4810-892b-aa37e2b2705f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:57.071478 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5da98d-474e-4909-9b45-0085d70c2fc1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:57.074677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 213/412] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:56 2022] GET /identity/v3/projects/02855100ad2c4964b2978e96832f8664 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:57.089588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e96604-550e-4810-892b-aa37e2b2705f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:57.123979 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62895ff3-dfd6-4781-94ee-9a33553dd7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:57.124853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62895ff3-dfd6-4781-94ee-9a33553dd7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:57.125138 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62895ff3-dfd6-4781-94ee-9a33553dd7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:57.125411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62895ff3-dfd6-4781-94ee-9a33553dd7b5 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:57.126625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62895ff3-dfd6-4781-94ee-9a33553dd7b5 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:57.128061 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62895ff3-dfd6-4781-94ee-9a33553dd7b5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:57.130088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 200/413] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:56 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:57.135461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62895ff3-dfd6-4781-94ee-9a33553dd7b5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:57.306508 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62895ff3-dfd6-4781-94ee-9a33553dd7b5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:57.308016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e96604-550e-4810-892b-aa37e2b2705f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:57.357462 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fee84-c131-4dbf-8fd5-bca803131ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:57.359441 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fee84-c131-4dbf-8fd5-bca803131ddd None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:57.359992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fee84-c131-4dbf-8fd5-bca803131ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:57.360516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fee84-c131-4dbf-8fd5-bca803131ddd None admin] PATH_INFO: `/v3/projects/02855100ad2c4964b2978e96832f8664/groups/1ecd01eaf5724a05bc22c4af07f9f3c3/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:57.361478 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44198f-13e5-449f-aed7-31ba151a6f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:57.366306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44198f-13e5-449f-aed7-31ba151a6f6a None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:57.366306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44198f-13e5-449f-aed7-31ba151a6f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:57.366306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44198f-13e5-449f-aed7-31ba151a6f6a None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5/roles/44468cf4511643498cf7830993b8c9e5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:57.366306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44198f-13e5-449f-aed7-31ba151a6f6a None admin] RBAC: Authorizing `identity:create_grant(project_id=ab41116bb62b44b9bd7c18431c0286a3, group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5, role_id=44468cf4511643498cf7830993b8c9e5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:57.366809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44198f-13e5-449f-aed7-31ba151a6f6a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:57.367110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fee84-c131-4dbf-8fd5-bca803131ddd None admin] RBAC: Authorizing `identity:create_grant(project_id=02855100ad2c4964b2978e96832f8664, group_id=1ecd01eaf5724a05bc22c4af07f9f3c3, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:57.368561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fee84-c131-4dbf-8fd5-bca803131ddd None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:57.470134 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 201/414] 10.222.0.44 () {58 vars in 1442 bytes} [Thu May 5 15:12:57 2022] PUT /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5/roles/44468cf4511643498cf7830993b8c9e5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:12:57.495601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a37e2-37df-446b-a98d-1190e25137c3 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:57.496270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a37e2-37df-446b-a98d-1190e25137c3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:57.496754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a37e2-37df-446b-a98d-1190e25137c3 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:57.498205 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 214/415] 10.222.0.44 () {58 vars in 1442 bytes} [Thu May 5 15:12:57 2022] PUT /identity/v3/projects/02855100ad2c4964b2978e96832f8664/groups/1ecd01eaf5724a05bc22c4af07f9f3c3/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:12:57.499379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 202/416] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:57.505623 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d312b-bbe3-4931-94c8-751820115258 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:57.506237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d312b-bbe3-4931-94c8-751820115258 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:57.506806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d312b-bbe3-4931-94c8-751820115258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:57.525485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-274d312b-bbe3-4931-94c8-751820115258 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:57.527154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-274d312b-bbe3-4931-94c8-751820115258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:57.632400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 215/417] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:12:57.677723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a37e2-37df-446b-a98d-1190e25137c3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:57.849414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a37e2-37df-446b-a98d-1190e25137c3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:57.890017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f5b35-0be3-4943-bbe2-410e7dcf0072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:57.891528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f5b35-0be3-4943-bbe2-410e7dcf0072 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:57.891958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f5b35-0be3-4943-bbe2-410e7dcf0072 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:57.892497 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f5b35-0be3-4943-bbe2-410e7dcf0072 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:57.903586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f5b35-0be3-4943-bbe2-410e7dcf0072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-782f5b35-0be3-4943-bbe2-410e7dcf0072 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:57.912785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:57.913902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:57.915011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:57.915011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:57.915011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:57.915011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:57.915011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:57.915011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:57.915011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:57.915011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:57.915011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:57.915011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:57.915011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:57.915011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:57.917290 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 203/418] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:57.925366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d312b-bbe3-4931-94c8-751820115258 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:58.094413 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d312b-bbe3-4931-94c8-751820115258 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:58.134903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21506a-e74b-4761-95ef-aaaeeb98726d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:58.135996 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21506a-e74b-4761-95ef-aaaeeb98726d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:58.136503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21506a-e74b-4761-95ef-aaaeeb98726d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:58.136978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21506a-e74b-4761-95ef-aaaeeb98726d None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:58.137939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21506a-e74b-4761-95ef-aaaeeb98726d None admin] RBAC: Adding query filter params (name=member) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:58.138471 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21506a-e74b-4761-95ef-aaaeeb98726d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:58.140346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21506a-e74b-4761-95ef-aaaeeb98726d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:58.153847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 216/419] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:58.159419 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f5b35-0be3-4943-bbe2-410e7dcf0072 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:58.294909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f5b35-0be3-4943-bbe2-410e7dcf0072 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:58.344566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24124690-8a5c-4afe-aa04-a3942828f5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:58.345235 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24124690-8a5c-4afe-aa04-a3942828f5ba None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:58.345524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24124690-8a5c-4afe-aa04-a3942828f5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:58.345806 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24124690-8a5c-4afe-aa04-a3942828f5ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:58.445735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24124690-8a5c-4afe-aa04-a3942828f5ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:58.447144 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24124690-8a5c-4afe-aa04-a3942828f5ba None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:58.563091 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 204/420] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:58.569035 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21506a-e74b-4761-95ef-aaaeeb98726d None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:58.720234 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21506a-e74b-4761-95ef-aaaeeb98726d None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:58.769675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47066ca-7bd2-4ed0-a011-e9d9cf923e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:58.770614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47066ca-7bd2-4ed0-a011-e9d9cf923e40 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:58.770898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47066ca-7bd2-4ed0-a011-e9d9cf923e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:58.771176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47066ca-7bd2-4ed0-a011-e9d9cf923e40 None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:58.775851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47066ca-7bd2-4ed0-a011-e9d9cf923e40 None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:58.777391 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47066ca-7bd2-4ed0-a011-e9d9cf923e40 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:58.779709 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 217/421] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:58 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:58.787155 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24124690-8a5c-4afe-aa04-a3942828f5ba None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:58.900592 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24124690-8a5c-4afe-aa04-a3942828f5ba None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:58.938020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087deb4-7b70-4634-adff-ab1324c99ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:58.938912 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087deb4-7b70-4634-adff-ab1324c99ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:58.939192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087deb4-7b70-4634-adff-ab1324c99ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:58.939469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087deb4-7b70-4634-adff-ab1324c99ce4 None admin] PATH_INFO: `/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:58.940645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087deb4-7b70-4634-adff-ab1324c99ce4 None admin] RBAC: Authorizing `identity:get_group(group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:58.942091 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087deb4-7b70-4634-adff-ab1324c99ce4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:58.944046 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 205/422] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:12:58 2022] GET /identity/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:58.949611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47066ca-7bd2-4ed0-a011-e9d9cf923e40 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:58.976890 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a959a7-dd9d-46a8-8cd3-d913ca5a820f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:58.977182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a959a7-dd9d-46a8-8cd3-d913ca5a820f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:58.977808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a959a7-dd9d-46a8-8cd3-d913ca5a820f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:58.979585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 206/423] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:58.986589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38338a0-59c0-45a9-8923-658e1898d50c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:58.986879 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38338a0-59c0-45a9-8923-658e1898d50c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:58.987162 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38338a0-59c0-45a9-8923-658e1898d50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:59.007896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b38338a0-59c0-45a9-8923-658e1898d50c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:59.009124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b38338a0-59c0-45a9-8923-658e1898d50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:59.108890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47066ca-7bd2-4ed0-a011-e9d9cf923e40 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:59.117271 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 207/424] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:59.149700 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07093196-c4e7-4945-bbb7-783dc2f3cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:59.150376 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07093196-c4e7-4945-bbb7-783dc2f3cb03 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:59.150663 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07093196-c4e7-4945-bbb7-783dc2f3cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:59.150934 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07093196-c4e7-4945-bbb7-783dc2f3cb03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:59.151754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07093196-c4e7-4945-bbb7-783dc2f3cb03 None admin] RBAC: Adding query filter params (group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5, role.id=e2401a0c8c204431b0eff57c19186866, scope.project.id=7192d8f0799049abb47bcece952f59e6) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:59.152064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07093196-c4e7-4945-bbb7-783dc2f3cb03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:59.153502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07093196-c4e7-4945-bbb7-783dc2f3cb03 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:59.164908 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd12cb3-6644-4564-a89d-b3e9518011a0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:59.165235 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd12cb3-6644-4564-a89d-b3e9518011a0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:59.165479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd12cb3-6644-4564-a89d-b3e9518011a0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:59.166479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 218/425] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 5 15:12:58 2022] GET /identity/v3/role_assignments?group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5&scope.project.id=7192d8f0799049abb47bcece952f59e6&role.id=e2401a0c8c204431b0eff57c19186866 => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:59.167085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 208/426] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:12:59.171873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07093196-c4e7-4945-bbb7-783dc2f3cb03 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:59.176928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2da072-f7ce-402d-a1ff-f0468b81dbaf None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:59.177235 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2da072-f7ce-402d-a1ff-f0468b81dbaf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:59.177496 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2da072-f7ce-402d-a1ff-f0468b81dbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:59.212455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ef2da072-f7ce-402d-a1ff-f0468b81dbaf None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:12:59.213659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ef2da072-f7ce-402d-a1ff-f0468b81dbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:12:59.282649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07093196-c4e7-4945-bbb7-783dc2f3cb03 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:59.324163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 209/427] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:12:59.332680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6fb38-b204-4561-aabc-657de5fb1a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:59.333532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6fb38-b204-4561-aabc-657de5fb1a9d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:59.333814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6fb38-b204-4561-aabc-657de5fb1a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:59.334088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6fb38-b204-4561-aabc-657de5fb1a9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:59.350232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2da072-f7ce-402d-a1ff-f0468b81dbaf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:59.354733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6fb38-b204-4561-aabc-657de5fb1a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-d9a6fb38-b204-4561-aabc-657de5fb1a9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:59.363256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:59.365430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:59.368025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:59.368025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:59.368025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:59.368025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:59.368025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:59.368025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:59.368025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:59.368025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:59.368025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:59.368025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:59.368025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:12:59.368025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:12:59.368025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 219/428] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:12:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:59.392681 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6fb38-b204-4561-aabc-657de5fb1a9d None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:59.483847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2da072-f7ce-402d-a1ff-f0468b81dbaf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:59.529660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07e724-9d69-4754-b2d5-bdfa10ff627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:59.531173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e724-9d69-4754-b2d5-bdfa10ff627c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:59.531826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e724-9d69-4754-b2d5-bdfa10ff627c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:59.531826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e724-9d69-4754-b2d5-bdfa10ff627c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:59.538214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6fb38-b204-4561-aabc-657de5fb1a9d None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:59.542556 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07e724-9d69-4754-b2d5-bdfa10ff627c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-4b07e724-9d69-4754-b2d5-bdfa10ff627c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:12:59.552712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:12:59.554857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:12:59.556783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:12:59.556783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:12:59.556783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:12:59.556783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:12:59.556783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:12:59.556783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:12:59.556783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:12:59.556783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:12:59.556783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:12:59.556783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:12:59.556783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:12:59.556783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:12:59.556783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 210/429] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:12:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:12:59.565626 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07e724-9d69-4754-b2d5-bdfa10ff627c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:59.590248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5b3a8-6f97-40e5-a6be-4d3fa67dffc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:59.591069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5b3a8-6f97-40e5-a6be-4d3fa67dffc3 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:59.591354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5b3a8-6f97-40e5-a6be-4d3fa67dffc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:59.591630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5b3a8-6f97-40e5-a6be-4d3fa67dffc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:59.594253 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5b3a8-6f97-40e5-a6be-4d3fa67dffc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:59.594588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5b3a8-6f97-40e5-a6be-4d3fa67dffc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:59.595995 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5b3a8-6f97-40e5-a6be-4d3fa67dffc3 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:59.607472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 220/430] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:12:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:59.615178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5b3a8-6f97-40e5-a6be-4d3fa67dffc3 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:59.676107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07e724-9d69-4754-b2d5-bdfa10ff627c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:59.711212 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc0ca-e652-4ce4-a32b-332b582c33ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:59.711895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc0ca-e652-4ce4-a32b-332b582c33ed None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:59.712178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc0ca-e652-4ce4-a32b-332b582c33ed None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:59.712458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc0ca-e652-4ce4-a32b-332b582c33ed None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:59.713203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533dc0ca-e652-4ce4-a32b-332b582c33ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:12:59.713510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533dc0ca-e652-4ce4-a32b-332b582c33ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:59.714944 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533dc0ca-e652-4ce4-a32b-332b582c33ed None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:59.724760 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5b3a8-6f97-40e5-a6be-4d3fa67dffc3 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:59.725056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 211/431] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:12:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:12:59.730274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc0ca-e652-4ce4-a32b-332b582c33ed None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:12:59.766561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d3a8f-da70-4c79-810e-3ec2b75192db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:59.766561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d3a8f-da70-4c79-810e-3ec2b75192db None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:59.766561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d3a8f-da70-4c79-810e-3ec2b75192db None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:59.766561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d3a8f-da70-4c79-810e-3ec2b75192db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:59.856645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d3a8f-da70-4c79-810e-3ec2b75192db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:59.858885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d3a8f-da70-4c79-810e-3ec2b75192db None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:59.861450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc0ca-e652-4ce4-a32b-332b582c33ed None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:12:59.896787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6944d43-2eac-4999-94a0-bb3eebbd79f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:12:59.897453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6944d43-2eac-4999-94a0-bb3eebbd79f1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:12:59.897735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6944d43-2eac-4999-94a0-bb3eebbd79f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:12:59.898013 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6944d43-2eac-4999-94a0-bb3eebbd79f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:12:59.971206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6944d43-2eac-4999-94a0-bb3eebbd79f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:12:59.972685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6944d43-2eac-4999-94a0-bb3eebbd79f1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:12:59.988095 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 221/432] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:12:59.993545 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d3a8f-da70-4c79-810e-3ec2b75192db None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:00.080400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 212/433] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:13:00.086130 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6944d43-2eac-4999-94a0-bb3eebbd79f1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:00.097049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d3a8f-da70-4c79-810e-3ec2b75192db None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:00.134861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88cb09-b1b3-4d1e-a01e-9d0d68b9384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:00.135737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88cb09-b1b3-4d1e-a01e-9d0d68b9384a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:00.136019 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88cb09-b1b3-4d1e-a01e-9d0d68b9384a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:00.136293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88cb09-b1b3-4d1e-a01e-9d0d68b9384a None admin] PATH_INFO: `/v3/projects/7192d8f0799049abb47bcece952f59e6` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:00.137513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88cb09-b1b3-4d1e-a01e-9d0d68b9384a None admin] RBAC: Authorizing `identity:get_project(project_id=7192d8f0799049abb47bcece952f59e6)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:00.139554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88cb09-b1b3-4d1e-a01e-9d0d68b9384a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:00.142000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 222/434] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:12:59 2022] GET /identity/v3/projects/7192d8f0799049abb47bcece952f59e6 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:00.147274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88cb09-b1b3-4d1e-a01e-9d0d68b9384a None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:00.196370 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6944d43-2eac-4999-94a0-bb3eebbd79f1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:00.236119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa32b40-c0f7-4cf5-bb32-2a822f44bed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:00.237264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa32b40-c0f7-4cf5-bb32-2a822f44bed6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:00.237264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa32b40-c0f7-4cf5-bb32-2a822f44bed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:00.237619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa32b40-c0f7-4cf5-bb32-2a822f44bed6 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:00.239499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa32b40-c0f7-4cf5-bb32-2a822f44bed6 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:00.241193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa32b40-c0f7-4cf5-bb32-2a822f44bed6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:00.243200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 213/435] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:13:00 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:00.250130 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa32b40-c0f7-4cf5-bb32-2a822f44bed6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:00.273097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88cb09-b1b3-4d1e-a01e-9d0d68b9384a None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:00.312962 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cbd73-d1da-49fe-98c4-2ebd23aceff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:00.313869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cbd73-d1da-49fe-98c4-2ebd23aceff9 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:00.314155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cbd73-d1da-49fe-98c4-2ebd23aceff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:00.314468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cbd73-d1da-49fe-98c4-2ebd23aceff9 None admin] PATH_INFO: `/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:00.316826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cbd73-d1da-49fe-98c4-2ebd23aceff9 None admin] RBAC: Authorizing `identity:get_group(group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:00.318582 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cbd73-d1da-49fe-98c4-2ebd23aceff9 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:00.320286 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 223/436] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:13:00 2022] GET /identity/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:00.321445 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7833b-9f1c-4769-8a40-2d6d0a122864 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:00.321734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7833b-9f1c-4769-8a40-2d6d0a122864 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:00.322012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7833b-9f1c-4769-8a40-2d6d0a122864 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:00.326331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 224/437] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:00.329241 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7833b-9f1c-4769-8a40-2d6d0a122864 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:00.399807 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa32b40-c0f7-4cf5-bb32-2a822f44bed6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:00.441506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47308183-8d97-46cb-9d70-ff3b5394904d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:00.442399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47308183-8d97-46cb-9d70-ff3b5394904d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:00.442690 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47308183-8d97-46cb-9d70-ff3b5394904d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:00.442974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47308183-8d97-46cb-9d70-ff3b5394904d None admin] PATH_INFO: `/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:00.444214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47308183-8d97-46cb-9d70-ff3b5394904d None admin] RBAC: Authorizing `identity:get_group(group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:00.445660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47308183-8d97-46cb-9d70-ff3b5394904d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:00.450521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7833b-9f1c-4769-8a40-2d6d0a122864 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:00.456636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 214/438] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:13:00 2022] GET /identity/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:00.459055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ed478-7e7e-4762-bc40-1ded3bc61133 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:00.459348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ed478-7e7e-4762-bc40-1ded3bc61133 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:00.459634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ed478-7e7e-4762-bc40-1ded3bc61133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:00.478120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-163ed478-7e7e-4762-bc40-1ded3bc61133 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:00.479396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-163ed478-7e7e-4762-bc40-1ded3bc61133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:00.488387 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e018a-8759-4e2a-8a9e-52eda8bb6fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:00.489058 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e018a-8759-4e2a-8a9e-52eda8bb6fed None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:00.489349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e018a-8759-4e2a-8a9e-52eda8bb6fed None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:00.489629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e018a-8759-4e2a-8a9e-52eda8bb6fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:00.490482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e018a-8759-4e2a-8a9e-52eda8bb6fed None admin] RBAC: Adding query filter params (group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5, role.id=44468cf4511643498cf7830993b8c9e5, scope.project.id=7192d8f0799049abb47bcece952f59e6) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:00.490798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e018a-8759-4e2a-8a9e-52eda8bb6fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:00.492242 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e018a-8759-4e2a-8a9e-52eda8bb6fed None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:00.499018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 225/439] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 5 15:13:00 2022] GET /identity/v3/role_assignments?group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5&scope.project.id=7192d8f0799049abb47bcece952f59e6&role.id=44468cf4511643498cf7830993b8c9e5 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:00.499243 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e018a-8759-4e2a-8a9e-52eda8bb6fed None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:00.563202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 215/440] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:00.564717 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354ca79-d265-486b-81df-54e3315bbda6 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:00.565005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354ca79-d265-486b-81df-54e3315bbda6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:00.565281 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354ca79-d265-486b-81df-54e3315bbda6 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:00.567004 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 216/441] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:00.572610 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abce97-8090-4c36-821a-cf216e57745f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:00.572923 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abce97-8090-4c36-821a-cf216e57745f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:00.573209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abce97-8090-4c36-821a-cf216e57745f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:00.594264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-55abce97-8090-4c36-821a-cf216e57745f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:00.595515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-55abce97-8090-4c36-821a-cf216e57745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:00.627106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e018a-8759-4e2a-8a9e-52eda8bb6fed None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:00.665775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b164b53-e38a-43b3-962c-155311807e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:00.674571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b164b53-e38a-43b3-962c-155311807e82 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:00.674772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 217/442] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:13:00.674866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b164b53-e38a-43b3-962c-155311807e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:00.674866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b164b53-e38a-43b3-962c-155311807e82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:00.675039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abce97-8090-4c36-821a-cf216e57745f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:00.675137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b164b53-e38a-43b3-962c-155311807e82 None admin] RBAC: Adding query filter params (group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5, role.id=e2401a0c8c204431b0eff57c19186866, scope.project.id=ab41116bb62b44b9bd7c18431c0286a3) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:00.675137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b164b53-e38a-43b3-962c-155311807e82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:00.675137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b164b53-e38a-43b3-962c-155311807e82 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:00.685477 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 226/443] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 5 15:13:00 2022] GET /identity/v3/role_assignments?group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5&scope.project.id=ab41116bb62b44b9bd7c18431c0286a3&role.id=e2401a0c8c204431b0eff57c19186866 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:00.691942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b164b53-e38a-43b3-962c-155311807e82 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:00.813250 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abce97-8090-4c36-821a-cf216e57745f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:00.835401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b164b53-e38a-43b3-962c-155311807e82 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:00.855643 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3975634-7c21-4532-ba2b-7a862ee3e84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:00.856469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975634-7c21-4532-ba2b-7a862ee3e84c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:00.856751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975634-7c21-4532-ba2b-7a862ee3e84c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:00.857023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975634-7c21-4532-ba2b-7a862ee3e84c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:00.875983 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3975634-7c21-4532-ba2b-7a862ee3e84c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b3975634-7c21-4532-ba2b-7a862ee3e84c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:00.885787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:00.886793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:00.887602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:00.887602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:00.887602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:00.887602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:00.887602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:00.887602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:00.887602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:00.887602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:00.887602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:00.887602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:00.887602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:00.887602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:00.888200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 218/444] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:13:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:00.894557 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3975634-7c21-4532-ba2b-7a862ee3e84c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:00.896891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaff600-3238-4607-b97e-a6a6653ca5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:00.897721 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaff600-3238-4607-b97e-a6a6653ca5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:00.898003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaff600-3238-4607-b97e-a6a6653ca5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:00.898277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaff600-3238-4607-b97e-a6a6653ca5d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:00.913700 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaff600-3238-4607-b97e-a6a6653ca5d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-cbaff600-3238-4607-b97e-a6a6653ca5d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:00.922482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:00.923612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:00.924503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:00.924503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:00.924503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:00.924503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:00.924503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:00.924503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:00.924503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:00.924503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:00.924503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:00.924503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:00.924503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:13:00.924503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:00.924503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 227/445] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:13:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:00.930544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaff600-3238-4607-b97e-a6a6653ca5d5 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:01.014638 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3975634-7c21-4532-ba2b-7a862ee3e84c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:01.048038 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaff600-3238-4607-b97e-a6a6653ca5d5 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:01.060525 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827267d7-17a3-43c8-a38c-843b8b59a15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:01.061532 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827267d7-17a3-43c8-a38c-843b8b59a15d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:01.061865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827267d7-17a3-43c8-a38c-843b8b59a15d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:01.062089 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827267d7-17a3-43c8-a38c-843b8b59a15d None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:01.063561 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827267d7-17a3-43c8-a38c-843b8b59a15d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:01.063561 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827267d7-17a3-43c8-a38c-843b8b59a15d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:01.066342 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827267d7-17a3-43c8-a38c-843b8b59a15d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:01.073417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 219/446] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:13:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:01.079068 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827267d7-17a3-43c8-a38c-843b8b59a15d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:01.085941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a7ef-bdbb-4288-a62f-00e54ea06833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:01.087279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a7ef-bdbb-4288-a62f-00e54ea06833 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:01.087279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a7ef-bdbb-4288-a62f-00e54ea06833 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:01.087279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a7ef-bdbb-4288-a62f-00e54ea06833 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:01.088435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8a7ef-bdbb-4288-a62f-00e54ea06833 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:01.088435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8a7ef-bdbb-4288-a62f-00e54ea06833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:01.089564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8a7ef-bdbb-4288-a62f-00e54ea06833 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:01.099873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 228/447] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:01.105425 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a7ef-bdbb-4288-a62f-00e54ea06833 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:01.194869 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827267d7-17a3-43c8-a38c-843b8b59a15d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:01.218727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a7ef-bdbb-4288-a62f-00e54ea06833 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:01.227239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a326c-5c75-47a3-ac64-9ac6df2642d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:01.227886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a326c-5c75-47a3-ac64-9ac6df2642d7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:01.228169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a326c-5c75-47a3-ac64-9ac6df2642d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:01.228443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a326c-5c75-47a3-ac64-9ac6df2642d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:01.250203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316e806-543e-4065-b87c-1bb3d361c3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:01.250875 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316e806-543e-4065-b87c-1bb3d361c3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:01.251155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316e806-543e-4065-b87c-1bb3d361c3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:01.251430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316e806-543e-4065-b87c-1bb3d361c3b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:01.292435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a326c-5c75-47a3-ac64-9ac6df2642d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:01.293910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a326c-5c75-47a3-ac64-9ac6df2642d7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:01.316594 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316e806-543e-4065-b87c-1bb3d361c3b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:01.318031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316e806-543e-4065-b87c-1bb3d361c3b7 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:01.387512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 220/448] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:13:01.393384 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a326c-5c75-47a3-ac64-9ac6df2642d7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:01.441218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 229/449] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:13:01.447601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316e806-543e-4065-b87c-1bb3d361c3b7 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:01.488312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a326c-5c75-47a3-ac64-9ac6df2642d7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:01.521522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c218ad8-ae5b-45bf-b8a5-fc4b8413d326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:01.522396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c218ad8-ae5b-45bf-b8a5-fc4b8413d326 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:01.522676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c218ad8-ae5b-45bf-b8a5-fc4b8413d326 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:01.522948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c218ad8-ae5b-45bf-b8a5-fc4b8413d326 None admin] PATH_INFO: `/v3/projects/02855100ad2c4964b2978e96832f8664` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:01.524119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c218ad8-ae5b-45bf-b8a5-fc4b8413d326 None admin] RBAC: Authorizing `identity:get_project(project_id=02855100ad2c4964b2978e96832f8664)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:01.525544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c218ad8-ae5b-45bf-b8a5-fc4b8413d326 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:01.527250 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 221/450] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:13:01 2022] GET /identity/v3/projects/02855100ad2c4964b2978e96832f8664 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:01.533412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c218ad8-ae5b-45bf-b8a5-fc4b8413d326 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:01.550000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316e806-543e-4065-b87c-1bb3d361c3b7 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:01.582984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f79f5-c4cc-497a-8d47-fd3acfefd919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:01.583845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f79f5-c4cc-497a-8d47-fd3acfefd919 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:01.584130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f79f5-c4cc-497a-8d47-fd3acfefd919 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:01.584410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f79f5-c4cc-497a-8d47-fd3acfefd919 None admin] PATH_INFO: `/v3/projects/ab41116bb62b44b9bd7c18431c0286a3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:01.585584 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f79f5-c4cc-497a-8d47-fd3acfefd919 None admin] RBAC: Authorizing `identity:get_project(project_id=ab41116bb62b44b9bd7c18431c0286a3)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:01.587073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f79f5-c4cc-497a-8d47-fd3acfefd919 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:01.588751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 230/451] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:13:01 2022] GET /identity/v3/projects/ab41116bb62b44b9bd7c18431c0286a3 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:01.594742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f79f5-c4cc-497a-8d47-fd3acfefd919 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:01.631569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c218ad8-ae5b-45bf-b8a5-fc4b8413d326 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:01.664724 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab202a-5a22-4823-9960-660b9712c517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:01.665574 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab202a-5a22-4823-9960-660b9712c517 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:01.665856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab202a-5a22-4823-9960-660b9712c517 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:01.666128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab202a-5a22-4823-9960-660b9712c517 None admin] PATH_INFO: `/v3/groups/1ecd01eaf5724a05bc22c4af07f9f3c3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:01.667318 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab202a-5a22-4823-9960-660b9712c517 None admin] RBAC: Authorizing `identity:get_group(group_id=1ecd01eaf5724a05bc22c4af07f9f3c3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:01.668830 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab202a-5a22-4823-9960-660b9712c517 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:01.671527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 222/452] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:13:01 2022] GET /identity/v3/groups/1ecd01eaf5724a05bc22c4af07f9f3c3 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:01.676983 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab202a-5a22-4823-9960-660b9712c517 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:01.693883 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f79f5-c4cc-497a-8d47-fd3acfefd919 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:01.732386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44cbc1-78cd-4ff0-9843-7a22a7049293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:01.733826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44cbc1-78cd-4ff0-9843-7a22a7049293 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:01.734106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44cbc1-78cd-4ff0-9843-7a22a7049293 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:01.734414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44cbc1-78cd-4ff0-9843-7a22a7049293 None admin] PATH_INFO: `/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:01.735707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44cbc1-78cd-4ff0-9843-7a22a7049293 None admin] RBAC: Authorizing `identity:get_group(group_id=5a5caf00cdac4a5a8b26d8ff19f0d8d5)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:01.737226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44cbc1-78cd-4ff0-9843-7a22a7049293 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:01.739030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 231/453] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 5 15:13:01 2022] GET /identity/v3/groups/5a5caf00cdac4a5a8b26d8ff19f0d8d5 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:01.744495 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44cbc1-78cd-4ff0-9843-7a22a7049293 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:01.772752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab202a-5a22-4823-9960-660b9712c517 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:01.808368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c6516-815e-4a5a-83c5-02d6895f1c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:01.809030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c6516-815e-4a5a-83c5-02d6895f1c0a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:01.809316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c6516-815e-4a5a-83c5-02d6895f1c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:01.809599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c6516-815e-4a5a-83c5-02d6895f1c0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:01.810589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c6516-815e-4a5a-83c5-02d6895f1c0a None admin] RBAC: Adding query filter params (group.id=1ecd01eaf5724a05bc22c4af07f9f3c3, role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=02855100ad2c4964b2978e96832f8664) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:01.810962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c6516-815e-4a5a-83c5-02d6895f1c0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:01.812662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c6516-815e-4a5a-83c5-02d6895f1c0a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:01.818935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 223/454] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 5 15:13:01 2022] GET /identity/v3/role_assignments?group.id=1ecd01eaf5724a05bc22c4af07f9f3c3&scope.project.id=02855100ad2c4964b2978e96832f8664&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:01.846062 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44cbc1-78cd-4ff0-9843-7a22a7049293 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:01.883279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198f4a8-a8cf-48f0-8a51-0602b3302a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:01.883955 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f4a8-a8cf-48f0-8a51-0602b3302a93 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:01.884239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f4a8-a8cf-48f0-8a51-0602b3302a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:01.884522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f4a8-a8cf-48f0-8a51-0602b3302a93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:01.885370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198f4a8-a8cf-48f0-8a51-0602b3302a93 None admin] RBAC: Adding query filter params (group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5, role.id=44468cf4511643498cf7830993b8c9e5, scope.project.id=ab41116bb62b44b9bd7c18431c0286a3) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:01.885682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198f4a8-a8cf-48f0-8a51-0602b3302a93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:01.887222 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198f4a8-a8cf-48f0-8a51-0602b3302a93 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:01.894802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 232/455] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 5 15:13:01 2022] GET /identity/v3/role_assignments?group.id=5a5caf00cdac4a5a8b26d8ff19f0d8d5&scope.project.id=ab41116bb62b44b9bd7c18431c0286a3&role.id=44468cf4511643498cf7830993b8c9e5 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:04.827444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c9612-d098-4874-af41-3c2697c69f51 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:04.828487 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c9612-d098-4874-af41-3c2697c69f51 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:04.828985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c9612-d098-4874-af41-3c2697c69f51 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:04.830873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 224/456] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:04.836174 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfee6f5-ea7a-4f37-8801-e89e2ea63476 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:04.837047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfee6f5-ea7a-4f37-8801-e89e2ea63476 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:04.837531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfee6f5-ea7a-4f37-8801-e89e2ea63476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:04.862773 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-edfee6f5-ea7a-4f37-8801-e89e2ea63476 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:04.864395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-edfee6f5-ea7a-4f37-8801-e89e2ea63476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:04.947947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 233/457] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:04.984789 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c9612-d098-4874-af41-3c2697c69f51 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:05.145945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c9612-d098-4874-af41-3c2697c69f51 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:05.196173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc5234-c273-43b0-a844-0d6b06e1ace4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:05.197010 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc5234-c273-43b0-a844-0d6b06e1ace4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:05.197295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc5234-c273-43b0-a844-0d6b06e1ace4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:05.197578 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc5234-c273-43b0-a844-0d6b06e1ace4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:05.210128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc5234-c273-43b0-a844-0d6b06e1ace4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:05.212220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3987b-168c-41c5-b327-899b6ecdeb67 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:05.212593 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3987b-168c-41c5-b327-899b6ecdeb67 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:05.212841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3987b-168c-41c5-b327-899b6ecdeb67 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:05.214556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 234/458] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:13:05.215899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc5234-c273-43b0-a844-0d6b06e1ace4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:05.235137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139c4f-e9cc-4351-855c-4d12684a8ab2 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:05.235470 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139c4f-e9cc-4351-855c-4d12684a8ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:05.235702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139c4f-e9cc-4351-855c-4d12684a8ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-8dfc5234-c273-43b0-a844-0d6b06e1ace4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:05.236608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:05.237429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:05.238256 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:05.238256 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:05.238256 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:05.238256 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:05.238516 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 225/459] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:05.245154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc5234-c273-43b0-a844-0d6b06e1ace4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:05.271484 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-73139c4f-e9cc-4351-855c-4d12684a8ab2 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:05.272698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-73139c4f-e9cc-4351-855c-4d12684a8ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:05.396205 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc5234-c273-43b0-a844-0d6b06e1ace4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:05.428110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 235/460] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:05.444813 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c193f52-e1cf-490f-a948-8ad6f6638cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:05.445854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193f52-e1cf-490f-a948-8ad6f6638cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:05.446359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193f52-e1cf-490f-a948-8ad6f6638cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:05.446860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193f52-e1cf-490f-a948-8ad6f6638cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:05.447783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c193f52-e1cf-490f-a948-8ad6f6638cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:05.448285 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c193f52-e1cf-490f-a948-8ad6f6638cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:05.449909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c193f52-e1cf-490f-a948-8ad6f6638cf4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:05.456959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73139c4f-e9cc-4351-855c-4d12684a8ab2 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:05.463335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 226/461] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:05.469613 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c193f52-e1cf-490f-a948-8ad6f6638cf4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:05.603191 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c193f52-e1cf-490f-a948-8ad6f6638cf4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:05.610020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73139c4f-e9cc-4351-855c-4d12684a8ab2 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:05.638723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63457e1d-d9a8-41a3-9930-92067a852777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:05.640660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457e1d-d9a8-41a3-9930-92067a852777 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:05.640945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457e1d-d9a8-41a3-9930-92067a852777 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:05.641226 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457e1d-d9a8-41a3-9930-92067a852777 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:05.641987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63457e1d-d9a8-41a3-9930-92067a852777 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:05.643471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63457e1d-d9a8-41a3-9930-92067a852777 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:05.649108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c28545-4f16-4664-a8ed-a0bc6f2f1318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:05.649858 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c28545-4f16-4664-a8ed-a0bc6f2f1318 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:05.650146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c28545-4f16-4664-a8ed-a0bc6f2f1318 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:05.650537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c28545-4f16-4664-a8ed-a0bc6f2f1318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:05.661639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c28545-4f16-4664-a8ed-a0bc6f2f1318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:05.663163 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c28545-4f16-4664-a8ed-a0bc6f2f1318 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-51c28545-4f16-4664-a8ed-a0bc6f2f1318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:05.681784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:05.682742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:05.683942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:05.683942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:05.683942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:05.683942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:05.683942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 236/462] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:05.684568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ac8f-964e-4070-b358-375929fa4e10 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:05.684568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ac8f-964e-4070-b358-375929fa4e10 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:05.684822 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ac8f-964e-4070-b358-375929fa4e10 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:05.686908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 237/463] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:05.688042 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fb7b3-44f3-4833-abe9-0c6b0ecee171 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:05.688360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fb7b3-44f3-4833-abe9-0c6b0ecee171 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:05.688606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fb7b3-44f3-4833-abe9-0c6b0ecee171 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:05.690065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 238/464] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:05.690544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fb7b3-44f3-4833-abe9-0c6b0ecee171 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:05.739403 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 227/465] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:13:05 2022] POST /identity/v3/users => generated 246 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:05.741804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba78f9e-b8d6-43be-b611-c39262009f51 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:05.742549 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba78f9e-b8d6-43be-b611-c39262009f51 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:05.743703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba78f9e-b8d6-43be-b611-c39262009f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:05.770951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bba78f9e-b8d6-43be-b611-c39262009f51 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:05.773917 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bba78f9e-b8d6-43be-b611-c39262009f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:05.814524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fb7b3-44f3-4833-abe9-0c6b0ecee171 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:05.865874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95978a81-27f6-47bd-abc6-34a8f5ea5379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:05.866920 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 228/466] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:05.867511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978a81-27f6-47bd-abc6-34a8f5ea5379 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:05.867895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978a81-27f6-47bd-abc6-34a8f5ea5379 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:05.868374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978a81-27f6-47bd-abc6-34a8f5ea5379 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:05.869023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1befd87-22f8-4959-aa8a-991597b2524e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:05.869433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95978a81-27f6-47bd-abc6-34a8f5ea5379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:05.869610 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1befd87-22f8-4959-aa8a-991597b2524e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:05.869871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95978a81-27f6-47bd-abc6-34a8f5ea5379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:05.870099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1befd87-22f8-4959-aa8a-991597b2524e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:05.871621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95978a81-27f6-47bd-abc6-34a8f5ea5379 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:05.887544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 239/467] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:05.888646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e1befd87-22f8-4959-aa8a-991597b2524e None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:05.890885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e1befd87-22f8-4959-aa8a-991597b2524e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:05.894816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95978a81-27f6-47bd-abc6-34a8f5ea5379 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:05.969135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 229/468] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:05.970332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1befd87-22f8-4959-aa8a-991597b2524e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:06.033307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95978a81-27f6-47bd-abc6-34a8f5ea5379 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:06.082009 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff869a4d-27e7-4c65-ad4b-5eda6663a611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:06.083224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff869a4d-27e7-4c65-ad4b-5eda6663a611 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:06.083690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff869a4d-27e7-4c65-ad4b-5eda6663a611 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:06.083977 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff869a4d-27e7-4c65-ad4b-5eda6663a611 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:06.084706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff869a4d-27e7-4c65-ad4b-5eda6663a611 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:06.086370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff869a4d-27e7-4c65-ad4b-5eda6663a611 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:06.089738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1befd87-22f8-4959-aa8a-991597b2524e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:06.127902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac36e85-d491-45de-b9be-fa86e88cd560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:06.129053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac36e85-d491-45de-b9be-fa86e88cd560 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:06.129337 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac36e85-d491-45de-b9be-fa86e88cd560 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:06.129612 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac36e85-d491-45de-b9be-fa86e88cd560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:06.141079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac36e85-d491-45de-b9be-fa86e88cd560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:06.142586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac36e85-d491-45de-b9be-fa86e88cd560 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-0ac36e85-d491-45de-b9be-fa86e88cd560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:06.163429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:06.164453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:06.165290 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:06.165290 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:06.165290 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:06.165290 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:06.168879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 240/470] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:13:05 2022] POST /identity/v3/users => generated 248 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:06.169006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 230/470] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:06.174394 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac36e85-d491-45de-b9be-fa86e88cd560 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:06.175417 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff869a4d-27e7-4c65-ad4b-5eda6663a611 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:06.309694 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff869a4d-27e7-4c65-ad4b-5eda6663a611 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:06.353482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719032d-ab73-4c47-b2a6-6cb23d48f575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:06.354661 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719032d-ab73-4c47-b2a6-6cb23d48f575 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:06.355701 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719032d-ab73-4c47-b2a6-6cb23d48f575 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:06.356211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719032d-ab73-4c47-b2a6-6cb23d48f575 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:06.357315 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719032d-ab73-4c47-b2a6-6cb23d48f575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:06.358756 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719032d-ab73-4c47-b2a6-6cb23d48f575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:06.360507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719032d-ab73-4c47-b2a6-6cb23d48f575 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:06.375527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 241/471] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:06.381171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719032d-ab73-4c47-b2a6-6cb23d48f575 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:06.420084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac36e85-d491-45de-b9be-fa86e88cd560 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:06.467662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54a001-f798-4e5a-bdf2-f0ed60ff46fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:06.469173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54a001-f798-4e5a-bdf2-f0ed60ff46fb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:06.469464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54a001-f798-4e5a-bdf2-f0ed60ff46fb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:06.469745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54a001-f798-4e5a-bdf2-f0ed60ff46fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:06.483663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54a001-f798-4e5a-bdf2-f0ed60ff46fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:06.485991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54a001-f798-4e5a-bdf2-f0ed60ff46fb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:06.503313 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719032d-ab73-4c47-b2a6-6cb23d48f575 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9d54a001-f798-4e5a-bdf2-f0ed60ff46fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:06.509788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:06.510689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:06.512356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:06.512356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:06.512356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:06.512356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:06.512356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 231/472] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:06.518259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54a001-f798-4e5a-bdf2-f0ed60ff46fb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:06.545590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fabade-99b3-46d5-8be5-34b15c08abb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:06.546586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fabade-99b3-46d5-8be5-34b15c08abb7 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:06.546935 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fabade-99b3-46d5-8be5-34b15c08abb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:06.547330 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fabade-99b3-46d5-8be5-34b15c08abb7 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:06.548113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fabade-99b3-46d5-8be5-34b15c08abb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:06.549558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fabade-99b3-46d5-8be5-34b15c08abb7 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:06.624905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 242/473] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:13:06 2022] POST /identity/v3/users => generated 249 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:06.626499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18d343-c5f3-4984-a270-2c7d6dadbde1 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:06.626788 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18d343-c5f3-4984-a270-2c7d6dadbde1 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:06.627062 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18d343-c5f3-4984-a270-2c7d6dadbde1 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:06.629250 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 243/474] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:06.629588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54a001-f798-4e5a-bdf2-f0ed60ff46fb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:06.635727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d84e-4698-4a68-b785-c552fde7ec5b None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:06.635727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d84e-4698-4a68-b785-c552fde7ec5b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:06.635727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d84e-4698-4a68-b785-c552fde7ec5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:06.653334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-2803d84e-4698-4a68-b785-c552fde7ec5b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:06.654825 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2803d84e-4698-4a68-b785-c552fde7ec5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:06.678877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c744389-9af9-40a7-b0f9-424b45d815b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:06.679946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c744389-9af9-40a7-b0f9-424b45d815b4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:06.680238 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c744389-9af9-40a7-b0f9-424b45d815b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:06.680519 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c744389-9af9-40a7-b0f9-424b45d815b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:06.681276 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c744389-9af9-40a7-b0f9-424b45d815b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:06.681589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c744389-9af9-40a7-b0f9-424b45d815b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:06.685201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c744389-9af9-40a7-b0f9-424b45d815b4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:06.702461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 232/475] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:06.709167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c744389-9af9-40a7-b0f9-424b45d815b4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:06.737415 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 244/476] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:13:06.766867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803d84e-4698-4a68-b785-c552fde7ec5b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:06.825601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c744389-9af9-40a7-b0f9-424b45d815b4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:06.864234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717bc04-0430-4e8c-9d31-46acba46c56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:06.864935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717bc04-0430-4e8c-9d31-46acba46c56d None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:06.865292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717bc04-0430-4e8c-9d31-46acba46c56d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:06.865469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717bc04-0430-4e8c-9d31-46acba46c56d None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:06.866178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717bc04-0430-4e8c-9d31-46acba46c56d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:06.867777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717bc04-0430-4e8c-9d31-46acba46c56d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:06.878653 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803d84e-4698-4a68-b785-c552fde7ec5b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:06.920535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cac6b-2067-4458-af2c-2e35fc1729f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:06.921477 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cac6b-2067-4458-af2c-2e35fc1729f1 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:06.921802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cac6b-2067-4458-af2c-2e35fc1729f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:06.922077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cac6b-2067-4458-af2c-2e35fc1729f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:06.922972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cac6b-2067-4458-af2c-2e35fc1729f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:06.924477 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cac6b-2067-4458-af2c-2e35fc1729f1 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:06.949632 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 233/477] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:13:06 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:13:06.970997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.sql.core [None req-828cac6b-2067-4458-af2c-2e35fc1729f1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 15:13:06.970997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 05 15:13:06.970997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [parameters: {'id': '4427c87ec5d3428d8a8350dd6ba53eb1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 05 15:13:06.970997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80060) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-828cac6b-2067-4458-af2c-2e35fc1729f1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application conn.query(q) May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application result.read() May 05 15:13:06.989556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return ref.to_dict() May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:13:06.990508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application next(self.gen) May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application yield resource May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application next(self.gen) May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self.session.rollback() May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self.force_reraise() May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise self.value May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application session.commit() May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 15:13:06.991410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._prepare_impl() May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self.session.flush() May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._flush(objects) May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application compat.raise_( May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application flush_context.execute() May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rec.execute(self) May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 15:13:06.992961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application c = connection._execute_20( May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:13:06.994047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application conn.query(q) May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application result.read() May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:13:06.995077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [parameters: {'id': '4427c87ec5d3428d8a8350dd6ba53eb1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:06.997107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 05 15:13:07.003536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:07.005553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 245/478] 10.222.0.44 () {60 vars in 1131 bytes} [Thu May 5 15:13:06 2022] POST /identity/v3/roles => generated 144 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:07.005691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717bc04-0430-4e8c-9d31-46acba46c56d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:07.117273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717bc04-0430-4e8c-9d31-46acba46c56d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:07.156207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83650483-a51f-4bf4-a9f1-02568148abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:07.157027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83650483-a51f-4bf4-a9f1-02568148abce None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:07.157308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83650483-a51f-4bf4-a9f1-02568148abce None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:07.157605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83650483-a51f-4bf4-a9f1-02568148abce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:07.169764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83650483-a51f-4bf4-a9f1-02568148abce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-83650483-a51f-4bf4-a9f1-02568148abce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:07.178684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:07.180783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:07.182341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:07.182341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:07.182341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:07.182341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:07.182341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:07.182341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:07.182341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:07.182341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:07.182341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:07.182341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:07.182341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:13:07.182341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:07.182341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 234/479] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:13:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:07.185477 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cac6b-2067-4458-af2c-2e35fc1729f1 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:07.298093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cac6b-2067-4458-af2c-2e35fc1729f1 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:07.334352 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33e3b7-28f4-4d24-9edc-a4378a5e9a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:07.335037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33e3b7-28f4-4d24-9edc-a4378a5e9a19 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:07.335318 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33e3b7-28f4-4d24-9edc-a4378a5e9a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:07.335591 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33e3b7-28f4-4d24-9edc-a4378a5e9a19 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:07.336338 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33e3b7-28f4-4d24-9edc-a4378a5e9a19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:07.336636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33e3b7-28f4-4d24-9edc-a4378a5e9a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:07.337993 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33e3b7-28f4-4d24-9edc-a4378a5e9a19 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:07.346970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 246/480] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:08.675500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2680-5c06-49a1-9429-67eeda333729 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:08.676024 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2680-5c06-49a1-9429-67eeda333729 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:08.676024 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2680-5c06-49a1-9429-67eeda333729 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:08.678105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 235/481] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:08.683193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7b27b-e577-4ff8-8989-edb81824f615 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:08.683614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7b27b-e577-4ff8-8989-edb81824f615 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:08.683741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7b27b-e577-4ff8-8989-edb81824f615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:08.714681 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-0dc7b27b-e577-4ff8-8989-edb81824f615 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:08.715882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-0dc7b27b-e577-4ff8-8989-edb81824f615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:08.832005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 247/482] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:13:08.874198 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb2680-5c06-49a1-9429-67eeda333729 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:09.000704 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb2680-5c06-49a1-9429-67eeda333729 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:09.041632 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb21274-9dcb-49e0-97de-0307396b2223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:09.042898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb21274-9dcb-49e0-97de-0307396b2223 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:09.042898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb21274-9dcb-49e0-97de-0307396b2223 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:09.042898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb21274-9dcb-49e0-97de-0307396b2223 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:09.070500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb21274-9dcb-49e0-97de-0307396b2223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-aeb21274-9dcb-49e0-97de-0307396b2223 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:09.078410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:09.079266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:09.080052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:09.080052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:09.080052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:09.080052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:09.080052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:09.080052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:09.080052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:09.080052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:09.080052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:09.080052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:09.080052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:09.080052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:09.080052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 236/483] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:09.085722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7b27b-e577-4ff8-8989-edb81824f615 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:09.108772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f21a5-4baa-47f5-8c28-11870c689328 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:09.109079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f21a5-4baa-47f5-8c28-11870c689328 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:09.109308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f21a5-4baa-47f5-8c28-11870c689328 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:09.110936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 237/484] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:13:09.124343 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f443c-bb56-48dc-8cea-f826b76bc662 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:09.124632 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f443c-bb56-48dc-8cea-f826b76bc662 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:09.124913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f443c-bb56-48dc-8cea-f826b76bc662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:09.147585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f55f443c-bb56-48dc-8cea-f826b76bc662 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:09.148852 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f55f443c-bb56-48dc-8cea-f826b76bc662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:09.220005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 238/485] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:13:09.262363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f443c-bb56-48dc-8cea-f826b76bc662 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:09.399762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7b27b-e577-4ff8-8989-edb81824f615 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:09.435418 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222bc3c-a89e-44e0-9bf9-9d5a1cd8feb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:09.436822 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222bc3c-a89e-44e0-9bf9-9d5a1cd8feb4 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:09.437103 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222bc3c-a89e-44e0-9bf9-9d5a1cd8feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:09.437381 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222bc3c-a89e-44e0-9bf9-9d5a1cd8feb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:09.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222bc3c-a89e-44e0-9bf9-9d5a1cd8feb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:09.438482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222bc3c-a89e-44e0-9bf9-9d5a1cd8feb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:09.439917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222bc3c-a89e-44e0-9bf9-9d5a1cd8feb4 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:09.441559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f443c-bb56-48dc-8cea-f826b76bc662 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:09.448438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 248/486] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:09.466316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222bc3c-a89e-44e0-9bf9-9d5a1cd8feb4 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:09.538872 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b4d29-f1ec-4738-b4cc-b88bd5744105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:09.539598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4d29-f1ec-4738-b4cc-b88bd5744105 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:09.539883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4d29-f1ec-4738-b4cc-b88bd5744105 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:09.540158 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4d29-f1ec-4738-b4cc-b88bd5744105 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:09.569592 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b4d29-f1ec-4738-b4cc-b88bd5744105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a80b4d29-f1ec-4738-b4cc-b88bd5744105 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:09.591170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:09.592764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:09.593725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:09.593725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:09.593725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:09.593725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:09.593725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:09.593725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:09.593725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:09.593725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:09.593725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:09.593725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:09.593725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:09.593725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:09.593725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 239/487] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:09.605676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b4d29-f1ec-4738-b4cc-b88bd5744105 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:09.820580 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222bc3c-a89e-44e0-9bf9-9d5a1cd8feb4 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:09.850855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b4d29-f1ec-4738-b4cc-b88bd5744105 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:09.860618 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6d541-518a-4fd2-8802-aeff79535e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:09.861691 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6d541-518a-4fd2-8802-aeff79535e56 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:09.862129 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6d541-518a-4fd2-8802-aeff79535e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:09.862628 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6d541-518a-4fd2-8802-aeff79535e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:09.874763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6d541-518a-4fd2-8802-aeff79535e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:09.876493 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6d541-518a-4fd2-8802-aeff79535e56 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:09.887206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0694b4-5962-4f4f-84ae-3c5f8dee4821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:09.888172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0694b4-5962-4f4f-84ae-3c5f8dee4821 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:09.888594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0694b4-5962-4f4f-84ae-3c5f8dee4821 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:09.889600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0694b4-5962-4f4f-84ae-3c5f8dee4821 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:09.890666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0694b4-5962-4f4f-84ae-3c5f8dee4821 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:09.891136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0694b4-5962-4f4f-84ae-3c5f8dee4821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:09.892655 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0694b4-5962-4f4f-84ae-3c5f8dee4821 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-48e6d541-518a-4fd2-8802-aeff79535e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:09.895794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:09.896650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:09.897472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:09.897472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:09.897472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:09.897472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:09.897472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 249/488] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:09.903264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b4d0f-9c38-4274-a172-61f47435c643 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:09.903624 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b4d0f-9c38-4274-a172-61f47435c643 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:09.903977 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b4d0f-9c38-4274-a172-61f47435c643 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:09.905113 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 240/489] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:09.906406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0694b4-5962-4f4f-84ae-3c5f8dee4821 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:09.910355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 250/490] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:09.910355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b4d0f-9c38-4274-a172-61f47435c643 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:10.027890 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0694b4-5962-4f4f-84ae-3c5f8dee4821 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:10.035447 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b4d0f-9c38-4274-a172-61f47435c643 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:10.063346 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055c3b7-b928-44b8-b83b-0732923f5781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:10.064008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055c3b7-b928-44b8-b83b-0732923f5781 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.064278 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055c3b7-b928-44b8-b83b-0732923f5781 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.064558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055c3b7-b928-44b8-b83b-0732923f5781 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.065264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055c3b7-b928-44b8-b83b-0732923f5781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:10.065569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055c3b7-b928-44b8-b83b-0732923f5781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:10.067000 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055c3b7-b928-44b8-b83b-0732923f5781 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:10.070538 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eacfa-d426-40f6-bfa5-b3dab46eb268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:10.071390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eacfa-d426-40f6-bfa5-b3dab46eb268 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.071619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eacfa-d426-40f6-bfa5-b3dab46eb268 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.071888 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eacfa-d426-40f6-bfa5-b3dab46eb268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.083512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 241/491] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:10.083512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f756500-4c8a-48c3-988d-82eb7d4533c6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.083512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f756500-4c8a-48c3-988d-82eb7d4533c6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.083512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f756500-4c8a-48c3-988d-82eb7d4533c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.089065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19eacfa-d426-40f6-bfa5-b3dab46eb268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:10.090621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19eacfa-d426-40f6-bfa5-b3dab46eb268 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:10.099553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1f756500-4c8a-48c3-988d-82eb7d4533c6 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:10.100782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1f756500-4c8a-48c3-988d-82eb7d4533c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-e19eacfa-d426-40f6-bfa5-b3dab46eb268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:10.111034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:10.111965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:10.112804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:10.112804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:10.112804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:10.112804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:10.112804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 251/492] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:10.113646 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74e67-2d3f-4e50-9e8f-8b3332259c65 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.113938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74e67-2d3f-4e50-9e8f-8b3332259c65 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.114221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74e67-2d3f-4e50-9e8f-8b3332259c65 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.117220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 252/493] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:10.117220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74e67-2d3f-4e50-9e8f-8b3332259c65 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:10.181427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 242/494] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:10.182634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f756500-4c8a-48c3-988d-82eb7d4533c6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:10.232053 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74e67-2d3f-4e50-9e8f-8b3332259c65 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:10.265651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98adcd6-9606-41a9-b949-59d13876bb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:10.266791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98adcd6-9606-41a9-b949-59d13876bb0e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.267076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98adcd6-9606-41a9-b949-59d13876bb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.267363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98adcd6-9606-41a9-b949-59d13876bb0e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.274540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98adcd6-9606-41a9-b949-59d13876bb0e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:10.275983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98adcd6-9606-41a9-b949-59d13876bb0e None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:10.288289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f756500-4c8a-48c3-988d-82eb7d4533c6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-c98adcd6-9606-41a9-b949-59d13876bb0e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:10.292422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:10.293306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:10.294186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:10.294186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:10.294186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:10.294186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:10.294186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:10.294186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:10.294186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:10.294186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:10.294186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:13:10.294186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:10.294186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 253/495] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 5 15:13:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:10.300187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221ba62-979e-4706-91b6-e13b6cfaaea2 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.300187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221ba62-979e-4706-91b6-e13b6cfaaea2 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.300187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221ba62-979e-4706-91b6-e13b6cfaaea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.312708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b221ba62-979e-4706-91b6-e13b6cfaaea2 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:10.314004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b221ba62-979e-4706-91b6-e13b6cfaaea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:10.327115 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ce79-fb13-4b69-9724-927b81862286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:10.327718 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ce79-fb13-4b69-9724-927b81862286 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.328003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ce79-fb13-4b69-9724-927b81862286 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.328281 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ce79-fb13-4b69-9724-927b81862286 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.329000 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03ce79-fb13-4b69-9724-927b81862286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:10.329328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03ce79-fb13-4b69-9724-927b81862286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:10.330702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03ce79-fb13-4b69-9724-927b81862286 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:10.341642 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 243/496] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:10.343049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ce79-fb13-4b69-9724-927b81862286 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:10.378098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 254/497] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:10.379290 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348de6c7-9951-444f-8039-46e76edee974 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.379577 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348de6c7-9951-444f-8039-46e76edee974 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.379851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348de6c7-9951-444f-8039-46e76edee974 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.381212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 255/498] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:10.381774 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348de6c7-9951-444f-8039-46e76edee974 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:10.442110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ce79-fb13-4b69-9724-927b81862286 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:10.473780 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008c2e1-cbaf-49e8-af7d-b9235d246990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:10.474596 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008c2e1-cbaf-49e8-af7d-b9235d246990 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.474878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008c2e1-cbaf-49e8-af7d-b9235d246990 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.475153 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008c2e1-cbaf-49e8-af7d-b9235d246990 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.481263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348de6c7-9951-444f-8039-46e76edee974 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:10.485525 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008c2e1-cbaf-49e8-af7d-b9235d246990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-0008c2e1-cbaf-49e8-af7d-b9235d246990 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:10.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:10.494035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:10.495009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:10.495009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:10.495009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:10.495009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:10.495009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:10.495009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:10.495009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:10.495009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:10.495009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:10.495009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:10.495009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:10.495009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:10.495009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 244/499] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:10.495645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008c2e1-cbaf-49e8-af7d-b9235d246990 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:10.518033 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab5b87-b0e5-44d1-903c-e70b8e38a94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:10.518727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab5b87-b0e5-44d1-903c-e70b8e38a94a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.519006 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab5b87-b0e5-44d1-903c-e70b8e38a94a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.519286 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab5b87-b0e5-44d1-903c-e70b8e38a94a None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.520111 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab5b87-b0e5-44d1-903c-e70b8e38a94a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:10.520418 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab5b87-b0e5-44d1-903c-e70b8e38a94a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:10.521841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab5b87-b0e5-44d1-903c-e70b8e38a94a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:10.558771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 256/500] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 5 15:13:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:10.560010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead93e11-eb8f-4af8-b5ac-2af05060ac73 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.560299 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead93e11-eb8f-4af8-b5ac-2af05060ac73 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.560606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead93e11-eb8f-4af8-b5ac-2af05060ac73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.578454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ead93e11-eb8f-4af8-b5ac-2af05060ac73 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:10.579579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ead93e11-eb8f-4af8-b5ac-2af05060ac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:10.591569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008c2e1-cbaf-49e8-af7d-b9235d246990 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:10.626030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57937a24-72ba-4e26-bd52-6870d026e98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:10.626850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57937a24-72ba-4e26-bd52-6870d026e98b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.627133 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57937a24-72ba-4e26-bd52-6870d026e98b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.627409 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57937a24-72ba-4e26-bd52-6870d026e98b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.634657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57937a24-72ba-4e26-bd52-6870d026e98b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:10.636096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57937a24-72ba-4e26-bd52-6870d026e98b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:10.644884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 257/501] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:10.645873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead93e11-eb8f-4af8-b5ac-2af05060ac73 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-57937a24-72ba-4e26-bd52-6870d026e98b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:10.651098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:10.652014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:10.652885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:10.652885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:10.652885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:10.652885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:10.652885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:10.652885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:10.652885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:10.652885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:10.652885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 15:13:10.652885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:10.652885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 245/502] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:13:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:10.653441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57937a24-72ba-4e26-bd52-6870d026e98b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:10.745235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead93e11-eb8f-4af8-b5ac-2af05060ac73 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:10.751247 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57937a24-72ba-4e26-bd52-6870d026e98b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:10.778471 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611038ec-d668-444a-b688-af76266b5ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:10.780069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611038ec-d668-444a-b688-af76266b5ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.780413 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611038ec-d668-444a-b688-af76266b5ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.780688 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611038ec-d668-444a-b688-af76266b5ed1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.785245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a33a30-63f4-49db-a0e7-f6118fba4267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:10.785906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a33a30-63f4-49db-a0e7-f6118fba4267 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.786480 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a33a30-63f4-49db-a0e7-f6118fba4267 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.786755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a33a30-63f4-49db-a0e7-f6118fba4267 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.787487 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a33a30-63f4-49db-a0e7-f6118fba4267 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:10.787792 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a33a30-63f4-49db-a0e7-f6118fba4267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:10.789163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a33a30-63f4-49db-a0e7-f6118fba4267 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:10.791064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611038ec-d668-444a-b688-af76266b5ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:10.797303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 246/503] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:10.798084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a33a30-63f4-49db-a0e7-f6118fba4267 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-611038ec-d668-444a-b688-af76266b5ed1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:10.799167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:10.800049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:10.800846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:10.800846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:10.800846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:10.800846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:10.800846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:10.800846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:10.800846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:10.800846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:10.800846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:10.800846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:10.800846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:10.800846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:10.800846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 258/504] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:10.802191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611038ec-d668-444a-b688-af76266b5ed1 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:10.895840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a33a30-63f4-49db-a0e7-f6118fba4267 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:10.900649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611038ec-d668-444a-b688-af76266b5ed1 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:10.927917 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e3bcf-1fff-4dab-ad8d-760e7244b035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:10.928552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e3bcf-1fff-4dab-ad8d-760e7244b035 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.928833 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e3bcf-1fff-4dab-ad8d-760e7244b035 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.929126 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e3bcf-1fff-4dab-ad8d-760e7244b035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.933111 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e36e7f-f0b3-4be7-9e76-2f0b50ed3b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:10.933771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36e7f-f0b3-4be7-9e76-2f0b50ed3b87 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:10.934054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36e7f-f0b3-4be7-9e76-2f0b50ed3b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:10.934363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36e7f-f0b3-4be7-9e76-2f0b50ed3b87 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:10.935192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e36e7f-f0b3-4be7-9e76-2f0b50ed3b87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:10.935560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e36e7f-f0b3-4be7-9e76-2f0b50ed3b87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:10.937492 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e36e7f-f0b3-4be7-9e76-2f0b50ed3b87 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:10.954166 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 259/505] 10.222.0.44 () {56 vars in 1137 bytes} [Thu May 5 15:13:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:10.954995 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e36e7f-f0b3-4be7-9e76-2f0b50ed3b87 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:10.993265 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e3bcf-1fff-4dab-ad8d-760e7244b035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:10.994797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e3bcf-1fff-4dab-ad8d-760e7244b035 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:11.049228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e36e7f-f0b3-4be7-9e76-2f0b50ed3b87 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:11.081657 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e7b9a-3ee3-4b89-949b-5efc54cc9e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:11.082466 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e7b9a-3ee3-4b89-949b-5efc54cc9e50 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:11.082750 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e7b9a-3ee3-4b89-949b-5efc54cc9e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:11.083020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e7b9a-3ee3-4b89-949b-5efc54cc9e50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:11.087981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 247/506] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:13:11.088815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e3bcf-1fff-4dab-ad8d-760e7244b035 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:11.093343 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e7b9a-3ee3-4b89-949b-5efc54cc9e50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:11.094833 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e7b9a-3ee3-4b89-949b-5efc54cc9e50 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-268e7b9a-3ee3-4b89-949b-5efc54cc9e50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:11.112660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:11.113572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:11.114532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:11.114532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:11.114532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:11.114532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:11.114532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 260/507] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:11.114859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e7b9a-3ee3-4b89-949b-5efc54cc9e50 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:11.191237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e3bcf-1fff-4dab-ad8d-760e7244b035 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:11.208969 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e7b9a-3ee3-4b89-949b-5efc54cc9e50 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:11.223645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a2d06-3a7a-4cbb-8f06-cd253de264e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:11.224436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a2d06-3a7a-4cbb-8f06-cd253de264e4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:11.224716 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a2d06-3a7a-4cbb-8f06-cd253de264e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:11.224992 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a2d06-3a7a-4cbb-8f06-cd253de264e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:11.234553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a2d06-3a7a-4cbb-8f06-cd253de264e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:11.235987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a2d06-3a7a-4cbb-8f06-cd253de264e4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:11.241620 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5df17-be1e-4e07-be46-b2b9e489f23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:11.242300 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5df17-be1e-4e07-be46-b2b9e489f23b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:11.242596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5df17-be1e-4e07-be46-b2b9e489f23b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:11.242877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5df17-be1e-4e07-be46-b2b9e489f23b None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:11.243621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5df17-be1e-4e07-be46-b2b9e489f23b None admin] RBAC: Adding query filter params (name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:11.243930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5df17-be1e-4e07-be46-b2b9e489f23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:11.245302 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5df17-be1e-4e07-be46-b2b9e489f23b None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:11.253448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 261/508] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-548a2d06-3a7a-4cbb-8f06-cd253de264e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:11.253591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:11.254414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:11.255945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:11.255945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:11.255945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:11.255945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:11.256155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5df17-be1e-4e07-be46-b2b9e489f23b None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:11.256233 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 248/509] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:11.256233 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a2d06-3a7a-4cbb-8f06-cd253de264e4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:11.350491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a2d06-3a7a-4cbb-8f06-cd253de264e4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:11.351073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5df17-be1e-4e07-be46-b2b9e489f23b None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:11.383351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7610b-93bb-443d-9e77-4030376efec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:11.384138 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7610b-93bb-443d-9e77-4030376efec1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:11.384263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131c637-da98-4f02-b5bf-8c84539033f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:11.384417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7610b-93bb-443d-9e77-4030376efec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:11.384687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7610b-93bb-443d-9e77-4030376efec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:11.384862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131c637-da98-4f02-b5bf-8c84539033f2 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:11.385143 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131c637-da98-4f02-b5bf-8c84539033f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:11.385416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131c637-da98-4f02-b5bf-8c84539033f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:11.394540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7610b-93bb-443d-9e77-4030376efec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:11.395987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7610b-93bb-443d-9e77-4030376efec1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-d7b7610b-93bb-443d-9e77-4030376efec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:11.413683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:11.414735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:11.415619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:11.415619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:11.415619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:11.415619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:11.415619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 249/510] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:11.415619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7610b-93bb-443d-9e77-4030376efec1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:11.452882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131c637-da98-4f02-b5bf-8c84539033f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:11.454240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131c637-da98-4f02-b5bf-8c84539033f2 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:11.511364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7610b-93bb-443d-9e77-4030376efec1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:11.544320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df018a5-d0bb-4a13-be7d-9a4d2ce2cfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:11.544997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df018a5-d0bb-4a13-be7d-9a4d2ce2cfdc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:11.545276 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df018a5-d0bb-4a13-be7d-9a4d2ce2cfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:11.545549 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df018a5-d0bb-4a13-be7d-9a4d2ce2cfdc None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:11.546251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df018a5-d0bb-4a13-be7d-9a4d2ce2cfdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:11.546580 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df018a5-d0bb-4a13-be7d-9a4d2ce2cfdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:11.547472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 262/511] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:13:11.547972 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df018a5-d0bb-4a13-be7d-9a4d2ce2cfdc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:11.548298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131c637-da98-4f02-b5bf-8c84539033f2 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:11.559051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 250/512] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:11.559857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df018a5-d0bb-4a13-be7d-9a4d2ce2cfdc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:11.642200 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131c637-da98-4f02-b5bf-8c84539033f2 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:11.654021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df018a5-d0bb-4a13-be7d-9a4d2ce2cfdc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:11.674303 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f713ed3-b283-4c80-afb8-244088f0275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:11.675100 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f713ed3-b283-4c80-afb8-244088f0275f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:11.675378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f713ed3-b283-4c80-afb8-244088f0275f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:11.675649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f713ed3-b283-4c80-afb8-244088f0275f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:11.685047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f713ed3-b283-4c80-afb8-244088f0275f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:11.686323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b2395-c3d8-4830-b252-deb6830492b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:11.686673 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f713ed3-b283-4c80-afb8-244088f0275f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:11.686975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b2395-c3d8-4830-b252-deb6830492b9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:11.687307 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b2395-c3d8-4830-b252-deb6830492b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:11.687626 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b2395-c3d8-4830-b252-deb6830492b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:11.688367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b2395-c3d8-4830-b252-deb6830492b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:11.688672 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b2395-c3d8-4830-b252-deb6830492b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:11.690027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b2395-c3d8-4830-b252-deb6830492b9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:11.702509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 251/513] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:11.702650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b2395-c3d8-4830-b252-deb6830492b9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-6f713ed3-b283-4c80-afb8-244088f0275f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:11.704189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:11.704990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:11.705893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:11.705893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:11.705893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:11.705893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:11.705893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 263/514] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:11.709355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f713ed3-b283-4c80-afb8-244088f0275f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:11.797484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b2395-c3d8-4830-b252-deb6830492b9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:11.806252 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f713ed3-b283-4c80-afb8-244088f0275f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:11.829532 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dfed3-a25b-4744-8bc5-b6e25164f6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:11.830186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dfed3-a25b-4744-8bc5-b6e25164f6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:11.830497 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dfed3-a25b-4744-8bc5-b6e25164f6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:11.830791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dfed3-a25b-4744-8bc5-b6e25164f6e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:11.831611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dfed3-a25b-4744-8bc5-b6e25164f6e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:11.831974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dfed3-a25b-4744-8bc5-b6e25164f6e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:11.833375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dfed3-a25b-4744-8bc5-b6e25164f6e9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:11.838719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25684a1a-fa94-4af9-a483-51042b24b3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:11.839515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25684a1a-fa94-4af9-a483-51042b24b3ef None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:11.839797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25684a1a-fa94-4af9-a483-51042b24b3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:11.840071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25684a1a-fa94-4af9-a483-51042b24b3ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:11.844767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 252/515] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:11.845538 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dfed3-a25b-4744-8bc5-b6e25164f6e9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:11.852059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25684a1a-fa94-4af9-a483-51042b24b3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:11.853597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25684a1a-fa94-4af9-a483-51042b24b3ef None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-25684a1a-fa94-4af9-a483-51042b24b3ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:11.871249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:11.872121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:11.873523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:11.873523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:11.873523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:11.873523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:11.873523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 264/516] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:11.873800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25684a1a-fa94-4af9-a483-51042b24b3ef None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:11.944120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dfed3-a25b-4744-8bc5-b6e25164f6e9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:11.968319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25684a1a-fa94-4af9-a483-51042b24b3ef None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:11.976467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeccd38-d925-4522-82e7-d6c06001b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:11.977134 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeccd38-d925-4522-82e7-d6c06001b042 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:11.977418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeccd38-d925-4522-82e7-d6c06001b042 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:11.977692 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeccd38-d925-4522-82e7-d6c06001b042 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:11.978416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeccd38-d925-4522-82e7-d6c06001b042 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:11.979850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeccd38-d925-4522-82e7-d6c06001b042 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:12.000015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4c93a-7247-45ca-8aef-e6d69f6cb11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:12.000669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4c93a-7247-45ca-8aef-e6d69f6cb11f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:12.010008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4c93a-7247-45ca-8aef-e6d69f6cb11f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:12.010008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4c93a-7247-45ca-8aef-e6d69f6cb11f None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:12.010008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4c93a-7247-45ca-8aef-e6d69f6cb11f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:12.010008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4c93a-7247-45ca-8aef-e6d69f6cb11f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:12.010008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4c93a-7247-45ca-8aef-e6d69f6cb11f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:12.015383 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 265/517] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:12.016160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4c93a-7247-45ca-8aef-e6d69f6cb11f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:12.080183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 253/518] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:13:11 2022] POST /identity/v3/users => generated 247 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:12.081042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeccd38-d925-4522-82e7-d6c06001b042 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:12.115420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4c93a-7247-45ca-8aef-e6d69f6cb11f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:12.153515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63b250-5f35-4255-bba8-144388648a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:12.156239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63b250-5f35-4255-bba8-144388648a9c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:12.156538 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63b250-5f35-4255-bba8-144388648a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:12.156823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63b250-5f35-4255-bba8-144388648a9c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:12.166540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63b250-5f35-4255-bba8-144388648a9c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:12.168374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63b250-5f35-4255-bba8-144388648a9c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-9a63b250-5f35-4255-bba8-144388648a9c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:12.183986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:12.184972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:12.187598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:12.187598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:12.187598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:12.187598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:12.187598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:12.187598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:12.187598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:12.187598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:12.187598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:13:12.187598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:12.187598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 266/519] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:12.187598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63b250-5f35-4255-bba8-144388648a9c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:12.193947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeccd38-d925-4522-82e7-d6c06001b042 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:12.233289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d91fa-f0c6-4e9b-bf7d-b147a47f6af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:12.234417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d91fa-f0c6-4e9b-bf7d-b147a47f6af1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:12.234706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d91fa-f0c6-4e9b-bf7d-b147a47f6af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:12.234984 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d91fa-f0c6-4e9b-bf7d-b147a47f6af1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:12.242410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d91fa-f0c6-4e9b-bf7d-b147a47f6af1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:12.243896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d91fa-f0c6-4e9b-bf7d-b147a47f6af1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f77d91fa-f0c6-4e9b-bf7d-b147a47f6af1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:12.260320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:12.261208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:12.262041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:12.262041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:12.262041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:12.262041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:12.262041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:12.262041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:12.262041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:12.262041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:12.262041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 254/520] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:12.262547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d91fa-f0c6-4e9b-bf7d-b147a47f6af1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:12.293789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63b250-5f35-4255-bba8-144388648a9c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:12.332069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160add8-ce43-4b36-848f-f98d40f0a0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:12.332738 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160add8-ce43-4b36-848f-f98d40f0a0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:12.333021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160add8-ce43-4b36-848f-f98d40f0a0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:12.333300 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160add8-ce43-4b36-848f-f98d40f0a0c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:12.334016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160add8-ce43-4b36-848f-f98d40f0a0c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:12.334349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160add8-ce43-4b36-848f-f98d40f0a0c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:12.335717 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160add8-ce43-4b36-848f-f98d40f0a0c3 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:12.347358 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 267/521] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:12.352182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160add8-ce43-4b36-848f-f98d40f0a0c3 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:12.372452 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d91fa-f0c6-4e9b-bf7d-b147a47f6af1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:12.406731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c666be-c667-40b2-8553-215d9480dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:12.407555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c666be-c667-40b2-8553-215d9480dd3d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:12.407835 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c666be-c667-40b2-8553-215d9480dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:12.408105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c666be-c667-40b2-8553-215d9480dd3d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:12.415516 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c666be-c667-40b2-8553-215d9480dd3d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:12.416971 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c666be-c667-40b2-8553-215d9480dd3d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-d8c666be-c667-40b2-8553-215d9480dd3d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:12.432697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:12.433865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:12.434991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:12.434991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:12.434991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:12.434991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:12.434991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:12.434991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:12.434991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:12.434991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:12.434991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:13:12.434991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:12.440686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 255/522] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:13:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:12.440686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c666be-c667-40b2-8553-215d9480dd3d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:12.460495 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160add8-ce43-4b36-848f-f98d40f0a0c3 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:12.494201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7b79c-0d67-4f66-91ce-baa80e5363e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:12.494827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7b79c-0d67-4f66-91ce-baa80e5363e0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:12.495107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7b79c-0d67-4f66-91ce-baa80e5363e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:12.495381 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7b79c-0d67-4f66-91ce-baa80e5363e0 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:12.496211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7b79c-0d67-4f66-91ce-baa80e5363e0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:12.496523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7b79c-0d67-4f66-91ce-baa80e5363e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:12.498201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7b79c-0d67-4f66-91ce-baa80e5363e0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:12.520099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 268/523] 10.222.0.44 () {56 vars in 1139 bytes} [Thu May 5 15:13:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:12.520099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7b79c-0d67-4f66-91ce-baa80e5363e0 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:12.543597 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c666be-c667-40b2-8553-215d9480dd3d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:12.579075 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05148ba3-184d-4bde-a158-351a456c7b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:12.579738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05148ba3-184d-4bde-a158-351a456c7b79 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:12.580020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05148ba3-184d-4bde-a158-351a456c7b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:12.580453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05148ba3-184d-4bde-a158-351a456c7b79 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:12.581080 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05148ba3-184d-4bde-a158-351a456c7b79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:12.581380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05148ba3-184d-4bde-a158-351a456c7b79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:12.582853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05148ba3-184d-4bde-a158-351a456c7b79 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:12.605936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 256/524] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:12.605936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05148ba3-184d-4bde-a158-351a456c7b79 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:12.621516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7b79c-0d67-4f66-91ce-baa80e5363e0 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:12.655242 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58b05d-ba3b-4683-9086-4da852e43de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:12.656031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58b05d-ba3b-4683-9086-4da852e43de2 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:12.656321 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58b05d-ba3b-4683-9086-4da852e43de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:12.656596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58b05d-ba3b-4683-9086-4da852e43de2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:12.663377 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58b05d-ba3b-4683-9086-4da852e43de2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:12.664933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58b05d-ba3b-4683-9086-4da852e43de2 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-0e58b05d-ba3b-4683-9086-4da852e43de2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:12.679246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:12.680277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:12.686527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:12.686527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:12.686527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:12.686527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:12.686527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:12.686527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:12.686527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:12.686527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:12.686527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 269/525] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:12.686527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58b05d-ba3b-4683-9086-4da852e43de2 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:12.730524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05148ba3-184d-4bde-a158-351a456c7b79 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:12.769069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2137f1-a630-45d5-92a3-11cd2dcb90ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:12.769752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2137f1-a630-45d5-92a3-11cd2dcb90ca None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:12.770032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2137f1-a630-45d5-92a3-11cd2dcb90ca None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:12.770331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2137f1-a630-45d5-92a3-11cd2dcb90ca None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:12.771169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2137f1-a630-45d5-92a3-11cd2dcb90ca None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:12.771473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2137f1-a630-45d5-92a3-11cd2dcb90ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:12.772885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2137f1-a630-45d5-92a3-11cd2dcb90ca None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:12.798988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58b05d-ba3b-4683-9086-4da852e43de2 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:12.808947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 257/526] 10.222.0.44 () {56 vars in 1137 bytes} [Thu May 5 15:13:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:12.809783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2137f1-a630-45d5-92a3-11cd2dcb90ca None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:12.837931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11cb81-9307-4653-866e-b4c814371232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:12.838580 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11cb81-9307-4653-866e-b4c814371232 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:12.838855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11cb81-9307-4653-866e-b4c814371232 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:12.839126 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11cb81-9307-4653-866e-b4c814371232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:12.905120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11cb81-9307-4653-866e-b4c814371232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:12.906629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11cb81-9307-4653-866e-b4c814371232 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:12.911886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2137f1-a630-45d5-92a3-11cd2dcb90ca None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:12.946128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bf679-ce0f-445e-8c42-751b45bf0c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:12.946951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bf679-ce0f-445e-8c42-751b45bf0c0d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:12.947178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bf679-ce0f-445e-8c42-751b45bf0c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:12.947463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bf679-ce0f-445e-8c42-751b45bf0c0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:12.948352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bf679-ce0f-445e-8c42-751b45bf0c0d None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=eb4ff6ba4e17477d8787eaf1955bd1da) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:12.948672 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bf679-ce0f-445e-8c42-751b45bf0c0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:12.950116 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bf679-ce0f-445e-8c42-751b45bf0c0d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:12.956410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 258/527] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:12 2022] GET /identity/v3/role_assignments?user.id=eb4ff6ba4e17477d8787eaf1955bd1da&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:12.957369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bf679-ce0f-445e-8c42-751b45bf0c0d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:13.017650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 270/528] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:13:13.019227 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11cb81-9307-4653-866e-b4c814371232 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:13.070211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bf679-ce0f-445e-8c42-751b45bf0c0d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:13.107140 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde64402-0eab-40d7-a33b-bb93f7e32238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:13.109138 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde64402-0eab-40d7-a33b-bb93f7e32238 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:13.109138 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde64402-0eab-40d7-a33b-bb93f7e32238 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:13.109347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde64402-0eab-40d7-a33b-bb93f7e32238 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:13.110092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde64402-0eab-40d7-a33b-bb93f7e32238 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:13.110518 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde64402-0eab-40d7-a33b-bb93f7e32238 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:13.112077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde64402-0eab-40d7-a33b-bb93f7e32238 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:13.133094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 259/529] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:13.134325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde64402-0eab-40d7-a33b-bb93f7e32238 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:13.137343 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11cb81-9307-4653-866e-b4c814371232 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:13.176086 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb09a4-d3ef-4da8-b911-17f68a6cde80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:13.177050 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb09a4-d3ef-4da8-b911-17f68a6cde80 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:13.177535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb09a4-d3ef-4da8-b911-17f68a6cde80 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:13.178012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb09a4-d3ef-4da8-b911-17f68a6cde80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:13.240104 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde64402-0eab-40d7-a33b-bb93f7e32238 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:13.250640 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb09a4-d3ef-4da8-b911-17f68a6cde80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:13.252435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb09a4-d3ef-4da8-b911-17f68a6cde80 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:13.276855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f71d09-c6aa-4ac4-bbaf-25901970390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:13.277591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f71d09-c6aa-4ac4-bbaf-25901970390d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:13.277882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f71d09-c6aa-4ac4-bbaf-25901970390d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:13.278185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f71d09-c6aa-4ac4-bbaf-25901970390d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:13.289737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f71d09-c6aa-4ac4-bbaf-25901970390d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:13.291928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f71d09-c6aa-4ac4-bbaf-25901970390d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c7f71d09-c6aa-4ac4-bbaf-25901970390d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:13.312195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:13.313121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:13.314593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:13.314593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:13.314593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:13.314593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:13.314593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 260/530] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:13.314891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f71d09-c6aa-4ac4-bbaf-25901970390d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:13.364229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 271/531] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:13:13.365565 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb09a4-d3ef-4da8-b911-17f68a6cde80 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:13.416427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f71d09-c6aa-4ac4-bbaf-25901970390d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:13.450274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48e379-5cb2-4284-87e8-088d13f1e60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:13.450990 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48e379-5cb2-4284-87e8-088d13f1e60c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:13.451652 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48e379-5cb2-4284-87e8-088d13f1e60c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:13.451762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48e379-5cb2-4284-87e8-088d13f1e60c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:13.452604 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48e379-5cb2-4284-87e8-088d13f1e60c None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=34f973b13dd44e609110f9a967ae1fed) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:13.452917 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48e379-5cb2-4284-87e8-088d13f1e60c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:13.454424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48e379-5cb2-4284-87e8-088d13f1e60c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:13.460122 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 261/532] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:13 2022] GET /identity/v3/role_assignments?user.id=34f973b13dd44e609110f9a967ae1fed&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:13.468230 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48e379-5cb2-4284-87e8-088d13f1e60c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:13.470562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb09a4-d3ef-4da8-b911-17f68a6cde80 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:13.518726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8b099-f611-446c-96a5-f768f9a1d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:13.520577 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8b099-f611-446c-96a5-f768f9a1d8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:13.521804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8b099-f611-446c-96a5-f768f9a1d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:13.522309 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8b099-f611-446c-96a5-f768f9a1d8f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:13.523556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8b099-f611-446c-96a5-f768f9a1d8f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:13.525361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8b099-f611-446c-96a5-f768f9a1d8f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:13.527122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8b099-f611-446c-96a5-f768f9a1d8f2 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:13.555017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 272/533] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:13.564211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8b099-f611-446c-96a5-f768f9a1d8f2 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:13.692513 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48e379-5cb2-4284-87e8-088d13f1e60c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:13.722107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8b099-f611-446c-96a5-f768f9a1d8f2 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:13.737183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee4343-7827-4d02-a99b-ae0cb2d95660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:13.737993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee4343-7827-4d02-a99b-ae0cb2d95660 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:13.738307 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee4343-7827-4d02-a99b-ae0cb2d95660 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:13.739716 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee4343-7827-4d02-a99b-ae0cb2d95660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:13.755896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee4343-7827-4d02-a99b-ae0cb2d95660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:13.761065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fb1fa-809a-4607-b301-fc761140d9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:13.761930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fb1fa-809a-4607-b301-fc761140d9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:13.762219 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fb1fa-809a-4607-b301-fc761140d9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:13.762529 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fb1fa-809a-4607-b301-fc761140d9e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:13.763058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee4343-7827-4d02-a99b-ae0cb2d95660 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:13.771611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fb1fa-809a-4607-b301-fc761140d9e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:13.772983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fb1fa-809a-4607-b301-fc761140d9e5 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-3d7fb1fa-809a-4607-b301-fc761140d9e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:13.789520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:13.790603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:13.791677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:13.791677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:13.791677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:13.791677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:13.791677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:13.791677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:13.791677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:13.791677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:13.793038 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 273/534] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:13.798613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fb1fa-809a-4607-b301-fc761140d9e5 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-daee4343-7827-4d02-a99b-ae0cb2d95660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:13.800875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:13.801905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:13.807280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:13.807280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:13.807280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:13.807280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:13.809276 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 262/535] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:13.819843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee4343-7827-4d02-a99b-ae0cb2d95660 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:13.917051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fb1fa-809a-4607-b301-fc761140d9e5 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:13.955115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea3868-fd90-4cdb-bcb1-9d16c311289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:13.955897 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea3868-fd90-4cdb-bcb1-9d16c311289c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:13.956258 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea3868-fd90-4cdb-bcb1-9d16c311289c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:13.956609 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea3868-fd90-4cdb-bcb1-9d16c311289c None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:13.957485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea3868-fd90-4cdb-bcb1-9d16c311289c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:13.957872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea3868-fd90-4cdb-bcb1-9d16c311289c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:13.962320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea3868-fd90-4cdb-bcb1-9d16c311289c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:13.997257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 274/536] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:14.019330 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea3868-fd90-4cdb-bcb1-9d16c311289c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:14.048503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee4343-7827-4d02-a99b-ae0cb2d95660 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:14.129989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea3868-fd90-4cdb-bcb1-9d16c311289c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:14.142496 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfe586-f799-4954-8ee3-a428eb7ba596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:14.143546 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfe586-f799-4954-8ee3-a428eb7ba596 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:14.144037 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfe586-f799-4954-8ee3-a428eb7ba596 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:14.144516 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfe586-f799-4954-8ee3-a428eb7ba596 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:14.145489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfe586-f799-4954-8ee3-a428eb7ba596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:14.145999 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfe586-f799-4954-8ee3-a428eb7ba596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:14.147668 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfe586-f799-4954-8ee3-a428eb7ba596 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:14.168501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e390db-23c8-414d-b0ba-21badf0b84c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:14.169174 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e390db-23c8-414d-b0ba-21badf0b84c2 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:14.169460 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e390db-23c8-414d-b0ba-21badf0b84c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:14.169900 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e390db-23c8-414d-b0ba-21badf0b84c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:14.171247 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e390db-23c8-414d-b0ba-21badf0b84c2 None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=c5efb606fb1b422182ab91576088c85f) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:14.171598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e390db-23c8-414d-b0ba-21badf0b84c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:14.173170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e390db-23c8-414d-b0ba-21badf0b84c2 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:14.173349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 263/537] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:14.180079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfe586-f799-4954-8ee3-a428eb7ba596 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:14.183502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 275/538] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:14 2022] GET /identity/v3/role_assignments?user.id=c5efb606fb1b422182ab91576088c85f&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:14.364030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfe586-f799-4954-8ee3-a428eb7ba596 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:14.428080 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb884644-2ddb-4a55-b5ab-a4533f639657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:14.429274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb884644-2ddb-4a55-b5ab-a4533f639657 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:14.429784 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb884644-2ddb-4a55-b5ab-a4533f639657 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:14.430304 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb884644-2ddb-4a55-b5ab-a4533f639657 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:14.443411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb884644-2ddb-4a55-b5ab-a4533f639657 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:14.444893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb884644-2ddb-4a55-b5ab-a4533f639657 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-fb884644-2ddb-4a55-b5ab-a4533f639657 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:14.461361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:14.462246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:14.463142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:14.463142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:14.463142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:14.463142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:14.463142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:14.463142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:14.463142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:14.463142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:14.463142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 264/539] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:14.463606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1d425-24b0-4169-a028-afc789beef09 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:14.463844 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1d425-24b0-4169-a028-afc789beef09 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:14.464060 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1d425-24b0-4169-a028-afc789beef09 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:14.465415 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 276/540] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:14.470788 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1d425-24b0-4169-a028-afc789beef09 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:14.470920 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a93bf2-8fda-4623-b4d5-6b4983fd6b36 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:14.471219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a93bf2-8fda-4623-b4d5-6b4983fd6b36 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:14.471463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a93bf2-8fda-4623-b4d5-6b4983fd6b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:14.489705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e0a93bf2-8fda-4623-b4d5-6b4983fd6b36 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:14.490930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e0a93bf2-8fda-4623-b4d5-6b4983fd6b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:14.571827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 265/541] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:14.596766 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a93bf2-8fda-4623-b4d5-6b4983fd6b36 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:14.624742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1d425-24b0-4169-a028-afc789beef09 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:14.697910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a93bf2-8fda-4623-b4d5-6b4983fd6b36 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:14.703506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150f77b-0b74-4225-b908-b3a1408d6438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:14.704405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150f77b-0b74-4225-b908-b3a1408d6438 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:14.704690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150f77b-0b74-4225-b908-b3a1408d6438 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:14.704965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150f77b-0b74-4225-b908-b3a1408d6438 None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:14.705754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150f77b-0b74-4225-b908-b3a1408d6438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:14.706062 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150f77b-0b74-4225-b908-b3a1408d6438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:14.707906 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150f77b-0b74-4225-b908-b3a1408d6438 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:14.721705 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 277/542] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:14.736869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150f77b-0b74-4225-b908-b3a1408d6438 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:14.772599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38192394-2afd-4e54-bd60-85a16db0973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:14.773682 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38192394-2afd-4e54-bd60-85a16db0973f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:14.774431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38192394-2afd-4e54-bd60-85a16db0973f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:14.774988 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38192394-2afd-4e54-bd60-85a16db0973f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:14.786812 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38192394-2afd-4e54-bd60-85a16db0973f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-38192394-2afd-4e54-bd60-85a16db0973f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:14.795021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:14.795900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:14.796712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:14.796712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:14.796712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:14.796712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:14.796712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:14.796712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:14.796712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:14.796712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:14.796712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:14.796712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:14.796712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:14.796712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:14.799363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 266/543] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:14.805151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38192394-2afd-4e54-bd60-85a16db0973f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:14.915568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38192394-2afd-4e54-bd60-85a16db0973f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:14.950780 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629f6ea-fb13-4f20-a858-ecef7a9832d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:14.951902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629f6ea-fb13-4f20-a858-ecef7a9832d2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:14.952411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629f6ea-fb13-4f20-a858-ecef7a9832d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:14.952891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629f6ea-fb13-4f20-a858-ecef7a9832d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:14.953070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150f77b-0b74-4225-b908-b3a1408d6438 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:14.954072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629f6ea-fb13-4f20-a858-ecef7a9832d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:14.954655 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629f6ea-fb13-4f20-a858-ecef7a9832d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:14.956245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629f6ea-fb13-4f20-a858-ecef7a9832d2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:14.965244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 267/544] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:14.971722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629f6ea-fb13-4f20-a858-ecef7a9832d2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:15.004132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df7208-fe90-4bc6-b25b-677717b78feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:15.004807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df7208-fe90-4bc6-b25b-677717b78feb None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:15.005091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df7208-fe90-4bc6-b25b-677717b78feb None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:15.005366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df7208-fe90-4bc6-b25b-677717b78feb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:15.006207 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df7208-fe90-4bc6-b25b-677717b78feb None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=7fe051e3e2084f89a95a95aa4fd857df) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:15.006561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df7208-fe90-4bc6-b25b-677717b78feb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:15.007996 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df7208-fe90-4bc6-b25b-677717b78feb None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:15.021557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 278/545] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:14 2022] GET /identity/v3/role_assignments?user.id=7fe051e3e2084f89a95a95aa4fd857df&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:15.125534 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629f6ea-fb13-4f20-a858-ecef7a9832d2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:15.171605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f078ea-18a6-4a7d-bc92-483902dd0ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:15.172820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f078ea-18a6-4a7d-bc92-483902dd0ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:15.173331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f078ea-18a6-4a7d-bc92-483902dd0ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:15.173816 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f078ea-18a6-4a7d-bc92-483902dd0ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:15.186982 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f078ea-18a6-4a7d-bc92-483902dd0ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:15.188889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f078ea-18a6-4a7d-bc92-483902dd0ca9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-05f078ea-18a6-4a7d-bc92-483902dd0ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:15.208585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:15.209664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:15.210584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:15.210584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:15.210584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:15.210584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:15.212550 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 268/546] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:15.218610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df7208-fe90-4bc6-b25b-677717b78feb None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:15.369148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df7208-fe90-4bc6-b25b-677717b78feb None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:15.434895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e76e0e-5c60-48f6-b2a6-177d42c1a92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:15.435560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e76e0e-5c60-48f6-b2a6-177d42c1a92a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:15.435851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e76e0e-5c60-48f6-b2a6-177d42c1a92a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:15.436130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e76e0e-5c60-48f6-b2a6-177d42c1a92a None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:15.436871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e76e0e-5c60-48f6-b2a6-177d42c1a92a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:15.437181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e76e0e-5c60-48f6-b2a6-177d42c1a92a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:15.438591 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e76e0e-5c60-48f6-b2a6-177d42c1a92a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:15.456604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 279/547] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:15.461894 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f078ea-18a6-4a7d-bc92-483902dd0ca9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:15.599493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f078ea-18a6-4a7d-bc92-483902dd0ca9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:15.642511 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9221db0-08ee-4439-974b-d560664d11dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:15.643335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9221db0-08ee-4439-974b-d560664d11dc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:15.643623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9221db0-08ee-4439-974b-d560664d11dc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:15.643904 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9221db0-08ee-4439-974b-d560664d11dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:15.652267 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9221db0-08ee-4439-974b-d560664d11dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:15.653773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9221db0-08ee-4439-974b-d560664d11dc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e9221db0-08ee-4439-974b-d560664d11dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:15.673131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:15.679675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:15.680575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:15.680575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:15.680575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:15.680575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:15.680575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:15.680575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:15.680575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:15.680575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:15.680575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:13:15.680575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:15.680575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 269/548] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:13:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:15.681160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e76e0e-5c60-48f6-b2a6-177d42c1a92a None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:15.731735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd5e35-a17e-4243-9667-cca4f989de48 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:15.732043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd5e35-a17e-4243-9667-cca4f989de48 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:15.732253 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd5e35-a17e-4243-9667-cca4f989de48 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:15.734012 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 270/549] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:13:15.739026 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16780-fb74-4ee4-8955-3c1edb6c5d65 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:15.739314 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16780-fb74-4ee4-8955-3c1edb6c5d65 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:15.739598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16780-fb74-4ee4-8955-3c1edb6c5d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:15.771333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9ee16780-fb74-4ee4-8955-3c1edb6c5d65 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:15.772540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9ee16780-fb74-4ee4-8955-3c1edb6c5d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:15.815226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e76e0e-5c60-48f6-b2a6-177d42c1a92a None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:15.849684 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbedf95-ea1f-4f47-bf9a-65a840df13a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:15.850401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbedf95-ea1f-4f47-bf9a-65a840df13a1 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:15.850692 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbedf95-ea1f-4f47-bf9a-65a840df13a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:15.851031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbedf95-ea1f-4f47-bf9a-65a840df13a1 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:15.851921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbedf95-ea1f-4f47-bf9a-65a840df13a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:15.852237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbedf95-ea1f-4f47-bf9a-65a840df13a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:15.853665 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbedf95-ea1f-4f47-bf9a-65a840df13a1 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:15.871795 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 280/550] 10.222.0.44 () {56 vars in 1135 bytes} [Thu May 5 15:13:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:15.879510 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbedf95-ea1f-4f47-bf9a-65a840df13a1 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:15.899214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 271/551] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:15.931186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee16780-fb74-4ee4-8955-3c1edb6c5d65 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:16.007187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbedf95-ea1f-4f47-bf9a-65a840df13a1 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:16.044533 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ef827-de94-43be-ba3d-38e859bf5691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:16.045992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ef827-de94-43be-ba3d-38e859bf5691 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:16.046367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ef827-de94-43be-ba3d-38e859bf5691 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:16.047187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ef827-de94-43be-ba3d-38e859bf5691 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:16.123898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ef827-de94-43be-ba3d-38e859bf5691 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:16.125718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ef827-de94-43be-ba3d-38e859bf5691 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:16.193641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee16780-fb74-4ee4-8955-3c1edb6c5d65 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:16.240443 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 281/552] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:13:16.246130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ef827-de94-43be-ba3d-38e859bf5691 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:16.285677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb2ff-b27c-4ea9-9cad-c8e2a81c0a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:16.286693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb2ff-b27c-4ea9-9cad-c8e2a81c0a4f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:16.286971 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb2ff-b27c-4ea9-9cad-c8e2a81c0a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:16.287239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb2ff-b27c-4ea9-9cad-c8e2a81c0a4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:16.306049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cb2ff-b27c-4ea9-9cad-c8e2a81c0a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-730cb2ff-b27c-4ea9-9cad-c8e2a81c0a4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:16.315119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:16.316989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:16.318959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:16.318959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:16.318959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:16.318959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:16.318959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:16.318959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:16.318959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:16.318959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:16.318959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:16.318959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:16.318959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:16.318959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:16.318959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 272/553] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:16.327220 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb2ff-b27c-4ea9-9cad-c8e2a81c0a4f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:16.401723 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ef827-de94-43be-ba3d-38e859bf5691 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:16.437106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9ab83-241b-48af-a798-849e70ca67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:16.437908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9ab83-241b-48af-a798-849e70ca67d5 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:16.438186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9ab83-241b-48af-a798-849e70ca67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:16.438487 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9ab83-241b-48af-a798-849e70ca67d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:16.448710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9ab83-241b-48af-a798-849e70ca67d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:16.450166 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9ab83-241b-48af-a798-849e70ca67d5 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:16.459623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb2ff-b27c-4ea9-9cad-c8e2a81c0a4f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-57f9ab83-241b-48af-a798-849e70ca67d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:16.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:16.469847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:16.470729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:16.470729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:16.470729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:16.470729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:16.470729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 282/554] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:16.474318 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96263f8-49e1-4320-a32e-971c7022de3a None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:16.474318 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96263f8-49e1-4320-a32e-971c7022de3a None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:16.474318 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96263f8-49e1-4320-a32e-971c7022de3a None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:16.474318 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 283/555] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:16.478961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96263f8-49e1-4320-a32e-971c7022de3a None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:16.499020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffa63e-c5bf-4b4c-aa6c-443c91f59125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:16.499696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa63e-c5bf-4b4c-aa6c-443c91f59125 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:16.500180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa63e-c5bf-4b4c-aa6c-443c91f59125 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:16.500286 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa63e-c5bf-4b4c-aa6c-443c91f59125 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:16.500973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffa63e-c5bf-4b4c-aa6c-443c91f59125 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:16.501275 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffa63e-c5bf-4b4c-aa6c-443c91f59125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:16.502668 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffa63e-c5bf-4b4c-aa6c-443c91f59125 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:16.515777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 273/556] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:16.515777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1ba55-5603-4850-9d5b-5366f3a075b9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:16.515777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1ba55-5603-4850-9d5b-5366f3a075b9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:16.515777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1ba55-5603-4850-9d5b-5366f3a075b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:16.532125 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1eb1ba55-5603-4850-9d5b-5366f3a075b9 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:16.533301 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1eb1ba55-5603-4850-9d5b-5366f3a075b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:16.594968 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96263f8-49e1-4320-a32e-971c7022de3a None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:16.603768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 274/557] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:16.604622 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1ba55-5603-4850-9d5b-5366f3a075b9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:16.631632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adfedb-20f2-4825-8465-58f417996fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:16.632696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adfedb-20f2-4825-8465-58f417996fef None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:16.633178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adfedb-20f2-4825-8465-58f417996fef None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:16.633659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adfedb-20f2-4825-8465-58f417996fef None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:16.634664 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adfedb-20f2-4825-8465-58f417996fef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:16.635232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adfedb-20f2-4825-8465-58f417996fef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:16.636804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adfedb-20f2-4825-8465-58f417996fef None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:16.649947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 284/558] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:16.655832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adfedb-20f2-4825-8465-58f417996fef None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:16.729940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1ba55-5603-4850-9d5b-5366f3a075b9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:16.764404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4458a-fc6b-4429-900b-cc1a4157d77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:16.765382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4458a-fc6b-4429-900b-cc1a4157d77f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:16.765660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4458a-fc6b-4429-900b-cc1a4157d77f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:16.765935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4458a-fc6b-4429-900b-cc1a4157d77f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:16.768390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adfedb-20f2-4825-8465-58f417996fef None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:16.776413 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4458a-fc6b-4429-900b-cc1a4157d77f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:16.777875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4458a-fc6b-4429-900b-cc1a4157d77f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6de4458a-fc6b-4429-900b-cc1a4157d77f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:16.796922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:16.797790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:16.798664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:16.798664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:16.798664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:16.798664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:16.802559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 275/559] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:16.803398 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4458a-fc6b-4429-900b-cc1a4157d77f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:16.807745 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2be730-3baf-4983-bc6c-4f6d01bd2708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:16.808805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be730-3baf-4983-bc6c-4f6d01bd2708 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:16.809323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be730-3baf-4983-bc6c-4f6d01bd2708 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:16.809814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be730-3baf-4983-bc6c-4f6d01bd2708 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:16.821184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2be730-3baf-4983-bc6c-4f6d01bd2708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-cf2be730-3baf-4983-bc6c-4f6d01bd2708 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:16.830276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:16.831209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:16.832011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:16.832011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:16.832011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:16.832011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:16.832011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:16.832011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:16.832011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:16.832011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:16.832011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:16.832011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:16.832011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:16.832011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:16.834771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 285/560] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:16.835822 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2be730-3baf-4983-bc6c-4f6d01bd2708 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:16.916639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4458a-fc6b-4429-900b-cc1a4157d77f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:16.945777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2be730-3baf-4983-bc6c-4f6d01bd2708 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:16.951691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbce846-ef47-435b-8e0e-0aa0d723db0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:16.952504 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbce846-ef47-435b-8e0e-0aa0d723db0c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:16.952786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbce846-ef47-435b-8e0e-0aa0d723db0c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:16.953062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbce846-ef47-435b-8e0e-0aa0d723db0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:16.959798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbce846-ef47-435b-8e0e-0aa0d723db0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:16.961235 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbce846-ef47-435b-8e0e-0aa0d723db0c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-8fbce846-ef47-435b-8e0e-0aa0d723db0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:16.975270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:16.976326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:16.977204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:16.977204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:16.977204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:16.977204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:16.977204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:16.977204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:16.977204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:16.977204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:16.977204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 276/561] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:16.977204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbce846-ef47-435b-8e0e-0aa0d723db0c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:16.986066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9709fa-68b0-4674-a1b3-22fdda68b23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:16.986825 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9709fa-68b0-4674-a1b3-22fdda68b23e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:16.987105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9709fa-68b0-4674-a1b3-22fdda68b23e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:16.987378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9709fa-68b0-4674-a1b3-22fdda68b23e None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:16.988095 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9709fa-68b0-4674-a1b3-22fdda68b23e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:16.988400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9709fa-68b0-4674-a1b3-22fdda68b23e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:16.989774 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9709fa-68b0-4674-a1b3-22fdda68b23e None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:17.004072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 286/562] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:17.005736 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e0c03-cf6a-4741-8dbb-63c5e8f3d815 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:17.006023 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e0c03-cf6a-4741-8dbb-63c5e8f3d815 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:17.006316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e0c03-cf6a-4741-8dbb-63c5e8f3d815 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:17.008898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 287/563] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:17.009751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e0c03-cf6a-4741-8dbb-63c5e8f3d815 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:17.083139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbce846-ef47-435b-8e0e-0aa0d723db0c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:17.110789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e0c03-cf6a-4741-8dbb-63c5e8f3d815 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:17.118295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace356a7-e417-43fb-9b45-0ebdcc08e92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:17.119119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace356a7-e417-43fb-9b45-0ebdcc08e92e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:17.119409 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace356a7-e417-43fb-9b45-0ebdcc08e92e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:17.119688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace356a7-e417-43fb-9b45-0ebdcc08e92e None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:17.120427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace356a7-e417-43fb-9b45-0ebdcc08e92e None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:17.120732 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace356a7-e417-43fb-9b45-0ebdcc08e92e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:17.122094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace356a7-e417-43fb-9b45-0ebdcc08e92e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:17.131535 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 277/564] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:17.132348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace356a7-e417-43fb-9b45-0ebdcc08e92e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:17.149602 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc10fc-9f4c-445a-a6f0-f3d13a2bb7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:17.150269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc10fc-9f4c-445a-a6f0-f3d13a2bb7fd None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:17.150585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc10fc-9f4c-445a-a6f0-f3d13a2bb7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:17.150861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc10fc-9f4c-445a-a6f0-f3d13a2bb7fd None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:17.151653 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc10fc-9f4c-445a-a6f0-f3d13a2bb7fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:17.151965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc10fc-9f4c-445a-a6f0-f3d13a2bb7fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:17.153407 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc10fc-9f4c-445a-a6f0-f3d13a2bb7fd None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:17.170246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 288/565] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:17.170246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85098649-cadc-48cd-bcc8-348270d54fdc None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:17.170246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85098649-cadc-48cd-bcc8-348270d54fdc None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:17.170246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85098649-cadc-48cd-bcc8-348270d54fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:17.186604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-85098649-cadc-48cd-bcc8-348270d54fdc None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:17.187797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-85098649-cadc-48cd-bcc8-348270d54fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:17.239333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace356a7-e417-43fb-9b45-0ebdcc08e92e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:17.262695 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 289/566] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:17.263558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85098649-cadc-48cd-bcc8-348270d54fdc None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:17.274981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cf089-24e3-4bdf-8d92-35e0d3b563f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:17.275800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf089-24e3-4bdf-8d92-35e0d3b563f6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:17.276089 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf089-24e3-4bdf-8d92-35e0d3b563f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:17.276423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf089-24e3-4bdf-8d92-35e0d3b563f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:17.285020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cf089-24e3-4bdf-8d92-35e0d3b563f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:17.286786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cf089-24e3-4bdf-8d92-35e0d3b563f6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-1e4cf089-24e3-4bdf-8d92-35e0d3b563f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:17.301438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:17.302412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:17.303336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:17.303336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:17.303336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:17.303336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:17.303336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:17.303336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:17.303336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:17.303336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:17.303336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:13:17.303336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:17.303336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 278/567] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 5 15:13:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:17.303981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cf089-24e3-4bdf-8d92-35e0d3b563f6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:17.372754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85098649-cadc-48cd-bcc8-348270d54fdc None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:17.402647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cf089-24e3-4bdf-8d92-35e0d3b563f6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:17.406912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf7c41-8d06-47e7-8ab2-43c135a91350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:17.407710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf7c41-8d06-47e7-8ab2-43c135a91350 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:17.407989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf7c41-8d06-47e7-8ab2-43c135a91350 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:17.408261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf7c41-8d06-47e7-8ab2-43c135a91350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:17.418693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf7c41-8d06-47e7-8ab2-43c135a91350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:17.420383 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf7c41-8d06-47e7-8ab2-43c135a91350 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:17.437171 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52e79b-7570-4e46-81e2-bc893cd43bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:17.437832 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52e79b-7570-4e46-81e2-bc893cd43bcb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-d4bf7c41-8d06-47e7-8ab2-43c135a91350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:17.437936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:17.438777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:17.439635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:17.439635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:17.439635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:17.439635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:17.439846 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52e79b-7570-4e46-81e2-bc893cd43bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:17.439846 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52e79b-7570-4e46-81e2-bc893cd43bcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:17.439972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 290/568] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:17.440472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf7c41-8d06-47e7-8ab2-43c135a91350 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:17.443677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52e79b-7570-4e46-81e2-bc893cd43bcb None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=27e0b470f6b84df38565abf006dd8ba1) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:17.444048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52e79b-7570-4e46-81e2-bc893cd43bcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:17.445517 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52e79b-7570-4e46-81e2-bc893cd43bcb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:17.462312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 279/569] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:17 2022] GET /identity/v3/role_assignments?user.id=27e0b470f6b84df38565abf006dd8ba1&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:17.462312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52e79b-7570-4e46-81e2-bc893cd43bcb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:17.584023 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf7c41-8d06-47e7-8ab2-43c135a91350 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:17.584273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52e79b-7570-4e46-81e2-bc893cd43bcb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:17.621967 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69afbb-3907-4e6c-babf-20215729f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:17.622981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69afbb-3907-4e6c-babf-20215729f896 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:17.623756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69afbb-3907-4e6c-babf-20215729f896 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:17.624030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69afbb-3907-4e6c-babf-20215729f896 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:17.625178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69afbb-3907-4e6c-babf-20215729f896 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:17.625489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69afbb-3907-4e6c-babf-20215729f896 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:17.627202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69afbb-3907-4e6c-babf-20215729f896 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:17.628217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc4070-c288-4adb-9a1c-f650cff3e46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:17.629150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc4070-c288-4adb-9a1c-f650cff3e46e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:17.629533 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc4070-c288-4adb-9a1c-f650cff3e46e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:17.629907 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc4070-c288-4adb-9a1c-f650cff3e46e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:17.643146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc4070-c288-4adb-9a1c-f650cff3e46e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:17.648503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 280/570] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 5 15:13:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:17.649499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69afbb-3907-4e6c-babf-20215729f896 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-72dc4070-c288-4adb-9a1c-f650cff3e46e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:17.651992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:17.653115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:17.655231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:17.655231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:17.655231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:17.655231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:17.655231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:17.655231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:17.655231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:17.655231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:17.655231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:17.655231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:17.655231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:17.655231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:17.661911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 291/571] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:17.663608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc4070-c288-4adb-9a1c-f650cff3e46e None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:17.760438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69afbb-3907-4e6c-babf-20215729f896 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:17.791598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc4070-c288-4adb-9a1c-f650cff3e46e None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:17.793765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234e382-f2f3-4647-9b36-dddad57b4450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:17.794459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e382-f2f3-4647-9b36-dddad57b4450 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:17.795271 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e382-f2f3-4647-9b36-dddad57b4450 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:17.795546 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e382-f2f3-4647-9b36-dddad57b4450 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:17.796267 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234e382-f2f3-4647-9b36-dddad57b4450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:17.796573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234e382-f2f3-4647-9b36-dddad57b4450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:17.798019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234e382-f2f3-4647-9b36-dddad57b4450 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:17.810110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 281/572] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:17.810321 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234e382-f2f3-4647-9b36-dddad57b4450 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:17.832549 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa945920-6e1f-4111-99ba-b89748d6f259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:17.833359 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa945920-6e1f-4111-99ba-b89748d6f259 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:17.833647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa945920-6e1f-4111-99ba-b89748d6f259 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:17.833926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa945920-6e1f-4111-99ba-b89748d6f259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:17.846022 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa945920-6e1f-4111-99ba-b89748d6f259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:17.847516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa945920-6e1f-4111-99ba-b89748d6f259 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-aa945920-6e1f-4111-99ba-b89748d6f259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:17.867039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:17.868115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:17.869370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:17.869370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:17.869370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:17.869370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:17.872865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 292/573] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:17.874263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72887974-1962-4f59-adef-a31af3093a64 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:17.874578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72887974-1962-4f59-adef-a31af3093a64 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:17.874861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72887974-1962-4f59-adef-a31af3093a64 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:17.880319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 293/574] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:17.880319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72887974-1962-4f59-adef-a31af3093a64 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:17.914631 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234e382-f2f3-4647-9b36-dddad57b4450 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:17.947083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8cbec-171a-4b01-8122-7a0d606d9bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:17.947753 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8cbec-171a-4b01-8122-7a0d606d9bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:17.948035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8cbec-171a-4b01-8122-7a0d606d9bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:17.948311 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8cbec-171a-4b01-8122-7a0d606d9bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:17.949071 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8cbec-171a-4b01-8122-7a0d606d9bb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:17.949381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8cbec-171a-4b01-8122-7a0d606d9bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:17.950783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8cbec-171a-4b01-8122-7a0d606d9bb4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:17.959198 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 282/575] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:17.964505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8cbec-171a-4b01-8122-7a0d606d9bb4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:17.981607 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72887974-1962-4f59-adef-a31af3093a64 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:18.017716 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58ecb0-19db-4658-ad97-5d8520999dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:18.018501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58ecb0-19db-4658-ad97-5d8520999dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:18.018766 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58ecb0-19db-4658-ad97-5d8520999dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:18.019038 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58ecb0-19db-4658-ad97-5d8520999dd1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:18.026112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58ecb0-19db-4658-ad97-5d8520999dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:18.027646 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58ecb0-19db-4658-ad97-5d8520999dd1 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-9f58ecb0-19db-4658-ad97-5d8520999dd1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:18.043162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:18.044098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:18.045164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:18.045164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:18.045164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:18.045164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:18.045164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:18.045164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:18.045164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:18.045164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:18.045164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 15:13:18.045164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:18.049890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 294/576] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:13:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:18.049890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eebf5-ae32-4283-803e-5964ca3e0ecf None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:18.049890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eebf5-ae32-4283-803e-5964ca3e0ecf None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:18.049890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eebf5-ae32-4283-803e-5964ca3e0ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:18.065322 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-664eebf5-ae32-4283-803e-5964ca3e0ecf None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:18.066522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-664eebf5-ae32-4283-803e-5964ca3e0ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:18.067114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8cbec-171a-4b01-8122-7a0d606d9bb4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:18.104663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a861310-bd2b-4590-ad00-0ff22b6c8f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:18.105437 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a861310-bd2b-4590-ad00-0ff22b6c8f5d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:18.105810 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a861310-bd2b-4590-ad00-0ff22b6c8f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:18.106165 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a861310-bd2b-4590-ad00-0ff22b6c8f5d None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:18.106986 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a861310-bd2b-4590-ad00-0ff22b6c8f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:18.107512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a861310-bd2b-4590-ad00-0ff22b6c8f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:18.108938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a861310-bd2b-4590-ad00-0ff22b6c8f5d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:18.125348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 283/577] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:18.125348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a861310-bd2b-4590-ad00-0ff22b6c8f5d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:18.137019 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 295/578] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:18.143240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664eebf5-ae32-4283-803e-5964ca3e0ecf None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:18.225895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a861310-bd2b-4590-ad00-0ff22b6c8f5d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:18.246704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664eebf5-ae32-4283-803e-5964ca3e0ecf None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:18.263735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac73a70-5775-424d-8406-16e7436cf06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:18.264610 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac73a70-5775-424d-8406-16e7436cf06c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:18.264893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac73a70-5775-424d-8406-16e7436cf06c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:18.265354 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac73a70-5775-424d-8406-16e7436cf06c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:18.275884 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac73a70-5775-424d-8406-16e7436cf06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:18.277268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac73a70-5775-424d-8406-16e7436cf06c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:18.281307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae211714-e3d4-4c08-9239-73ff6ecf75b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:18.281915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae211714-e3d4-4c08-9239-73ff6ecf75b8 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:18.282195 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae211714-e3d4-4c08-9239-73ff6ecf75b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:18.282501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae211714-e3d4-4c08-9239-73ff6ecf75b8 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:18.283339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae211714-e3d4-4c08-9239-73ff6ecf75b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:18.283647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae211714-e3d4-4c08-9239-73ff6ecf75b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:18.285057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae211714-e3d4-4c08-9239-73ff6ecf75b8 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-0ac73a70-5775-424d-8406-16e7436cf06c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:18.295856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:18.296907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:18.297798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:18.297798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:18.297798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:18.297798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:18.297798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 284/579] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:18.302704 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac73a70-5775-424d-8406-16e7436cf06c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:18.307721 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 296/580] 10.222.0.44 () {56 vars in 1137 bytes} [Thu May 5 15:13:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:18.307721 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae211714-e3d4-4c08-9239-73ff6ecf75b8 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:18.400883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac73a70-5775-424d-8406-16e7436cf06c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:18.401088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae211714-e3d4-4c08-9239-73ff6ecf75b8 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:18.435218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b6184-a3ed-4676-808c-16e144c113eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:18.436834 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b6184-a3ed-4676-808c-16e144c113eb None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:18.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b6184-a3ed-4676-808c-16e144c113eb None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:18.437394 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b6184-a3ed-4676-808c-16e144c113eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:18.441329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cee27-4d58-4003-bc42-d38a10e2d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:18.442396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cee27-4d58-4003-bc42-d38a10e2d519 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:18.442885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cee27-4d58-4003-bc42-d38a10e2d519 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:18.443379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cee27-4d58-4003-bc42-d38a10e2d519 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:18.447342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b6184-a3ed-4676-808c-16e144c113eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:18.450535 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cee27-4d58-4003-bc42-d38a10e2d519 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:18.453104 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cee27-4d58-4003-bc42-d38a10e2d519 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-0e1b6184-a3ed-4676-808c-16e144c113eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:18.456003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:18.456926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:18.457758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:18.457758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:18.457758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:18.457758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:18.457758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:18.457758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:18.457758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:18.457758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:18.457758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:18.457758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:18.457758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:18.457758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:18.457758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 297/581] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:18.458501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b6184-a3ed-4676-808c-16e144c113eb None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5a3cee27-4d58-4003-bc42-d38a10e2d519 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:18.471599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:18.472544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:18.473441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:18.473441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:18.473441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:18.473441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:18.473441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:18.473441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:18.473441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:18.473441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:18.473884 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 285/582] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:18.474692 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cee27-4d58-4003-bc42-d38a10e2d519 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:18.565498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b6184-a3ed-4676-808c-16e144c113eb None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:18.570087 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cee27-4d58-4003-bc42-d38a10e2d519 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:18.600860 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b0256-e79a-4664-9b0e-2fa77242d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:18.601542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b0256-e79a-4664-9b0e-2fa77242d845 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:18.601825 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b0256-e79a-4664-9b0e-2fa77242d845 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:18.602101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b0256-e79a-4664-9b0e-2fa77242d845 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:18.602874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b0256-e79a-4664-9b0e-2fa77242d845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:18.603179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b0256-e79a-4664-9b0e-2fa77242d845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:18.603821 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a19150-ea0c-4d89-9c20-f73f8c621a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:18.604619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b0256-e79a-4664-9b0e-2fa77242d845 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:18.604728 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a19150-ea0c-4d89-9c20-f73f8c621a8e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:18.604910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a19150-ea0c-4d89-9c20-f73f8c621a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:18.605171 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a19150-ea0c-4d89-9c20-f73f8c621a8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:18.617072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a19150-ea0c-4d89-9c20-f73f8c621a8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:18.622373 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 298/583] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:18.622373 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b0256-e79a-4664-9b0e-2fa77242d845 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:18.622625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a19150-ea0c-4d89-9c20-f73f8c621a8e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-57a19150-ea0c-4d89-9c20-f73f8c621a8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:18.640341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:18.641289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:18.642239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:18.642239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:18.642239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:18.642239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:18.646136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 286/584] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:18.647010 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a19150-ea0c-4d89-9c20-f73f8c621a8e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:18.716380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b0256-e79a-4664-9b0e-2fa77242d845 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:18.748932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a19150-ea0c-4d89-9c20-f73f8c621a8e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:18.750037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9162bae-a086-4376-98a6-1fda32ebaaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:18.753421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9162bae-a086-4376-98a6-1fda32ebaaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:18.753421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9162bae-a086-4376-98a6-1fda32ebaaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:18.753421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9162bae-a086-4376-98a6-1fda32ebaaf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:18.753421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9162bae-a086-4376-98a6-1fda32ebaaf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:18.753421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9162bae-a086-4376-98a6-1fda32ebaaf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:18.753809 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9162bae-a086-4376-98a6-1fda32ebaaf3 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:18.767182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 299/585] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:18.767182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9162bae-a086-4376-98a6-1fda32ebaaf3 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:18.783464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45566fd-3bad-4bdb-a94c-6842dabbcb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:18.784368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45566fd-3bad-4bdb-a94c-6842dabbcb05 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:18.784918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45566fd-3bad-4bdb-a94c-6842dabbcb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:18.785422 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45566fd-3bad-4bdb-a94c-6842dabbcb05 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:18.786749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45566fd-3bad-4bdb-a94c-6842dabbcb05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:18.787255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45566fd-3bad-4bdb-a94c-6842dabbcb05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:18.788695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45566fd-3bad-4bdb-a94c-6842dabbcb05 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:18.806312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 287/586] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:18.806312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45566fd-3bad-4bdb-a94c-6842dabbcb05 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:18.860012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9162bae-a086-4376-98a6-1fda32ebaaf3 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:18.894037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480552-aa58-454f-bd93-40ca0f65487a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:18.894877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480552-aa58-454f-bd93-40ca0f65487a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:18.895159 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480552-aa58-454f-bd93-40ca0f65487a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:18.895434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480552-aa58-454f-bd93-40ca0f65487a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:18.897923 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45566fd-3bad-4bdb-a94c-6842dabbcb05 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:18.902787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6480552-aa58-454f-bd93-40ca0f65487a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:18.904744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6480552-aa58-454f-bd93-40ca0f65487a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-f6480552-aa58-454f-bd93-40ca0f65487a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:18.921761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:18.922938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:18.923880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:18.923880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:18.923880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:18.923880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:18.923880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:18.923880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:18.923880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:18.923880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:18.923880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:13:18.923880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:18.926584 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 300/587] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:18.927612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480552-aa58-454f-bd93-40ca0f65487a None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:18.932555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133af273-0d7e-4258-8dc9-3ce04f3a372b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:18.933221 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af273-0d7e-4258-8dc9-3ce04f3a372b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:18.933505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af273-0d7e-4258-8dc9-3ce04f3a372b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:18.933781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af273-0d7e-4258-8dc9-3ce04f3a372b None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:18.934525 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133af273-0d7e-4258-8dc9-3ce04f3a372b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:18.934835 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133af273-0d7e-4258-8dc9-3ce04f3a372b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:18.936735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133af273-0d7e-4258-8dc9-3ce04f3a372b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:18.947957 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 288/588] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:18.948757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133af273-0d7e-4258-8dc9-3ce04f3a372b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:19.027298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480552-aa58-454f-bd93-40ca0f65487a None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:19.052939 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133af273-0d7e-4258-8dc9-3ce04f3a372b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:19.062583 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dca98-b498-4b89-bec7-30821342e3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:19.063382 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dca98-b498-4b89-bec7-30821342e3fa None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:19.063671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dca98-b498-4b89-bec7-30821342e3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:19.064162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dca98-b498-4b89-bec7-30821342e3fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:19.074634 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2dca98-b498-4b89-bec7-30821342e3fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:19.076178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2dca98-b498-4b89-bec7-30821342e3fa None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:19.086930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e213b89-197f-4c7e-90ac-5ab18eea3128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:19.087825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e213b89-197f-4c7e-90ac-5ab18eea3128 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:19.088111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e213b89-197f-4c7e-90ac-5ab18eea3128 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:19.088389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e213b89-197f-4c7e-90ac-5ab18eea3128 None admin] PATH_INFO: `/v3/projects/587280a3c4c54bffb4d769e406af3689/users/eb4ff6ba4e17477d8787eaf1955bd1da/roles/139847713c8a4df68a3d20babdbb75d5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-5c2dca98-b498-4b89-bec7-30821342e3fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:19.093307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:19.094171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:19.095109 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:19.095109 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:19.095109 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:19.095109 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:19.095109 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 301/589] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:19.095382 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dca98-b498-4b89-bec7-30821342e3fa None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:19.108857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e213b89-197f-4c7e-90ac-5ab18eea3128 None admin] RBAC: Authorizing `identity:create_grant(project_id=587280a3c4c54bffb4d769e406af3689, user_id=eb4ff6ba4e17477d8787eaf1955bd1da, role_id=139847713c8a4df68a3d20babdbb75d5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:19.110460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e213b89-197f-4c7e-90ac-5ab18eea3128 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:19.186319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 289/590] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:13:18 2022] PUT /identity/v3/projects/587280a3c4c54bffb4d769e406af3689/users/eb4ff6ba4e17477d8787eaf1955bd1da/roles/139847713c8a4df68a3d20babdbb75d5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:13:19.186319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e213b89-197f-4c7e-90ac-5ab18eea3128 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:19.209652 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dca98-b498-4b89-bec7-30821342e3fa None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:19.257537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4485-619d-4591-b733-9f3ee6c33c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:19.258238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4485-619d-4591-b733-9f3ee6c33c78 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:19.258548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4485-619d-4591-b733-9f3ee6c33c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:19.258825 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4485-619d-4591-b733-9f3ee6c33c78 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:19.259742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd4485-619d-4591-b733-9f3ee6c33c78 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:19.260061 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd4485-619d-4591-b733-9f3ee6c33c78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:19.262101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd4485-619d-4591-b733-9f3ee6c33c78 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:19.287542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 302/591] 10.222.0.44 () {56 vars in 1139 bytes} [Thu May 5 15:13:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:19.288504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4485-619d-4591-b733-9f3ee6c33c78 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:19.297260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e213b89-197f-4c7e-90ac-5ab18eea3128 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:19.335006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29253030-8e0e-4532-8184-ea47bbadf5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:19.335850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29253030-8e0e-4532-8184-ea47bbadf5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:19.336132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29253030-8e0e-4532-8184-ea47bbadf5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:19.336408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29253030-8e0e-4532-8184-ea47bbadf5f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:19.345247 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29253030-8e0e-4532-8184-ea47bbadf5f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:19.346775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29253030-8e0e-4532-8184-ea47bbadf5f6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-29253030-8e0e-4532-8184-ea47bbadf5f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:19.364490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:19.365406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:19.366399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:19.366399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:19.366399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:19.366399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:19.366399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:19.366399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:19.366399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:19.366399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:19.370466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 290/592] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:19.371403 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29253030-8e0e-4532-8184-ea47bbadf5f6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:19.423596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4485-619d-4591-b733-9f3ee6c33c78 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:19.464542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f5edd-3213-4742-b063-eb5386cd4218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:19.466066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f5edd-3213-4742-b063-eb5386cd4218 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:19.467284 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f5edd-3213-4742-b063-eb5386cd4218 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:19.467785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f5edd-3213-4742-b063-eb5386cd4218 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:19.469223 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f5edd-3213-4742-b063-eb5386cd4218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:19.469738 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f5edd-3213-4742-b063-eb5386cd4218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:19.471680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f5edd-3213-4742-b063-eb5386cd4218 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:19.486100 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 303/593] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:19.491146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29253030-8e0e-4532-8184-ea47bbadf5f6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:19.491553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f5edd-3213-4742-b063-eb5386cd4218 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:19.534169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce2055-6c72-460d-89e7-6d9ebc68889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:19.535494 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce2055-6c72-460d-89e7-6d9ebc68889c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:19.535922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce2055-6c72-460d-89e7-6d9ebc68889c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:19.536743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce2055-6c72-460d-89e7-6d9ebc68889c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:19.550002 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce2055-6c72-460d-89e7-6d9ebc68889c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:19.551702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce2055-6c72-460d-89e7-6d9ebc68889c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-0bce2055-6c72-460d-89e7-6d9ebc68889c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:19.569605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:19.570808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:19.571918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:19.571918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:19.571918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:19.571918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:19.573128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 291/594] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:19.574305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce2055-6c72-460d-89e7-6d9ebc68889c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:19.613693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f5edd-3213-4742-b063-eb5386cd4218 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:19.656790 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c123594-b016-4de1-89ea-3cc3e184311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:19.657815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c123594-b016-4de1-89ea-3cc3e184311f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:19.658103 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c123594-b016-4de1-89ea-3cc3e184311f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:19.658423 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c123594-b016-4de1-89ea-3cc3e184311f None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:19.659212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c123594-b016-4de1-89ea-3cc3e184311f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:19.659519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c123594-b016-4de1-89ea-3cc3e184311f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:19.662012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c123594-b016-4de1-89ea-3cc3e184311f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:19.682845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 304/595] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:19.682845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c123594-b016-4de1-89ea-3cc3e184311f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:19.690084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce2055-6c72-460d-89e7-6d9ebc68889c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:19.725259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4591138-2448-45be-ae65-3dacfbe50bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:19.726482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4591138-2448-45be-ae65-3dacfbe50bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:19.726976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4591138-2448-45be-ae65-3dacfbe50bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:19.727522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4591138-2448-45be-ae65-3dacfbe50bc1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:19.735626 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4591138-2448-45be-ae65-3dacfbe50bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:19.737479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4591138-2448-45be-ae65-3dacfbe50bc1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c4591138-2448-45be-ae65-3dacfbe50bc1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:19.762746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:19.764442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:19.765379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:19.765379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:19.765379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:19.765379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:19.765379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:19.765379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:19.765379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:19.765379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:19.765379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:13:19.765379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:19.772428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 292/596] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:13:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:19.772428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4591138-2448-45be-ae65-3dacfbe50bc1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:19.789191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c123594-b016-4de1-89ea-3cc3e184311f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:19.820988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756f205-b28d-47a5-9020-b7026089edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:19.821653 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756f205-b28d-47a5-9020-b7026089edfd None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:19.821933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756f205-b28d-47a5-9020-b7026089edfd None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:19.822207 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756f205-b28d-47a5-9020-b7026089edfd None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:19.822949 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756f205-b28d-47a5-9020-b7026089edfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:19.823251 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756f205-b28d-47a5-9020-b7026089edfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:19.824605 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756f205-b28d-47a5-9020-b7026089edfd None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:19.836522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 305/597] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:19.837601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829a208-7eee-4f96-b80b-1ce517399571 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:19.837895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829a208-7eee-4f96-b80b-1ce517399571 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:19.838169 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829a208-7eee-4f96-b80b-1ce517399571 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:19.839514 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 306/598] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:19.843180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829a208-7eee-4f96-b80b-1ce517399571 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:19.874128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4591138-2448-45be-ae65-3dacfbe50bc1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:19.907277 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff2fd8-e953-402a-9528-1e5a577b3f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:19.908083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff2fd8-e953-402a-9528-1e5a577b3f03 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:19.908357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff2fd8-e953-402a-9528-1e5a577b3f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:19.908626 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff2fd8-e953-402a-9528-1e5a577b3f03 None admin] PATH_INFO: `/v3/projects/587280a3c4c54bffb4d769e406af3689/users/34f973b13dd44e609110f9a967ae1fed/roles/139847713c8a4df68a3d20babdbb75d5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:19.926054 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff2fd8-e953-402a-9528-1e5a577b3f03 None admin] RBAC: Authorizing `identity:create_grant(project_id=587280a3c4c54bffb4d769e406af3689, user_id=34f973b13dd44e609110f9a967ae1fed, role_id=139847713c8a4df68a3d20babdbb75d5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:19.927529 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff2fd8-e953-402a-9528-1e5a577b3f03 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:19.946024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829a208-7eee-4f96-b80b-1ce517399571 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:19.980824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3e14a-fdd0-4f19-b31e-57b5e330b0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:19.981489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3e14a-fdd0-4f19-b31e-57b5e330b0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:19.981771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3e14a-fdd0-4f19-b31e-57b5e330b0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:19.982046 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3e14a-fdd0-4f19-b31e-57b5e330b0b9 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:19.983087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3e14a-fdd0-4f19-b31e-57b5e330b0b9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:19.983392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3e14a-fdd0-4f19-b31e-57b5e330b0b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:19.984819 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3e14a-fdd0-4f19-b31e-57b5e330b0b9 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:19.999125 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 293/599] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:13:19 2022] PUT /identity/v3/projects/587280a3c4c54bffb4d769e406af3689/users/34f973b13dd44e609110f9a967ae1fed/roles/139847713c8a4df68a3d20babdbb75d5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:13:20.000163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff2fd8-e953-402a-9528-1e5a577b3f03 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:20.011361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 307/600] 10.222.0.44 () {56 vars in 1137 bytes} [Thu May 5 15:13:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:20.015057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f84b64-a421-4c22-9870-6800b663e41c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:20.015642 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f84b64-a421-4c22-9870-6800b663e41c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:20.016102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f84b64-a421-4c22-9870-6800b663e41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:20.042081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a6f84b64-a421-4c22-9870-6800b663e41c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:20.043771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a6f84b64-a421-4c22-9870-6800b663e41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:20.118922 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 308/601] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:20.119860 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f84b64-a421-4c22-9870-6800b663e41c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:20.120037 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff2fd8-e953-402a-9528-1e5a577b3f03 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:20.160447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ef16b-5119-496b-b7aa-37def146aa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:20.161491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ef16b-5119-496b-b7aa-37def146aa66 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:20.161774 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ef16b-5119-496b-b7aa-37def146aa66 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:20.162051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ef16b-5119-496b-b7aa-37def146aa66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:20.173339 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ef16b-5119-496b-b7aa-37def146aa66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:20.175097 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ef16b-5119-496b-b7aa-37def146aa66 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-048ef16b-5119-496b-b7aa-37def146aa66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:20.196699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:20.197800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:20.198842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:20.198842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:20.198842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:20.198842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:20.198842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:20.198842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:20.198842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:20.198842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:20.198842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 294/602] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:20.202393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ef16b-5119-496b-b7aa-37def146aa66 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:20.242794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f84b64-a421-4c22-9870-6800b663e41c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:20.281138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a62d-bf32-45e0-ad29-97157e2385a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:20.282463 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a62d-bf32-45e0-ad29-97157e2385a5 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:20.283744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a62d-bf32-45e0-ad29-97157e2385a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:20.284226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a62d-bf32-45e0-ad29-97157e2385a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:20.298527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819a62d-bf32-45e0-ad29-97157e2385a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:20.300697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819a62d-bf32-45e0-ad29-97157e2385a5 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:20.317373 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ef16b-5119-496b-b7aa-37def146aa66 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-f819a62d-bf32-45e0-ad29-97157e2385a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:20.324815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:20.325686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:20.327870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:20.327870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:20.327870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:20.327870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:20.330611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 309/603] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:20.331813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a62d-bf32-45e0-ad29-97157e2385a5 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:20.359364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56666fd-b269-4d28-ae6c-26abb6d07c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:20.360814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56666fd-b269-4d28-ae6c-26abb6d07c73 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:20.361197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56666fd-b269-4d28-ae6c-26abb6d07c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:20.361571 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56666fd-b269-4d28-ae6c-26abb6d07c73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:20.374752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56666fd-b269-4d28-ae6c-26abb6d07c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-d56666fd-b269-4d28-ae6c-26abb6d07c73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:20.385136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:20.386328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:20.387385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:20.387385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:20.387385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:20.387385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:20.387385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:20.387385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:20.387385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:20.387385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:20.387385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:20.387385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:20.387385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:20.387385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:20.389536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 295/604] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:20.394436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56666fd-b269-4d28-ae6c-26abb6d07c73 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:20.451769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a62d-bf32-45e0-ad29-97157e2385a5 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:20.486251 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45a8de-afdd-4171-9c5d-e9f0ed1a16d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:20.487120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45a8de-afdd-4171-9c5d-e9f0ed1a16d0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:20.487403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45a8de-afdd-4171-9c5d-e9f0ed1a16d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:20.487677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45a8de-afdd-4171-9c5d-e9f0ed1a16d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:20.488495 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45a8de-afdd-4171-9c5d-e9f0ed1a16d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:20.488823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45a8de-afdd-4171-9c5d-e9f0ed1a16d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:20.490240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45a8de-afdd-4171-9c5d-e9f0ed1a16d0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:20.503762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56666fd-b269-4d28-ae6c-26abb6d07c73 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:20.506866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 310/605] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:20.507265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45a8de-afdd-4171-9c5d-e9f0ed1a16d0 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:20.539560 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6ae66-23b8-4b30-8328-1e0563e1fc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:20.540598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6ae66-23b8-4b30-8328-1e0563e1fc6d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:20.541084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6ae66-23b8-4b30-8328-1e0563e1fc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:20.541569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6ae66-23b8-4b30-8328-1e0563e1fc6d None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:20.542571 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6ae66-23b8-4b30-8328-1e0563e1fc6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:20.543199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6ae66-23b8-4b30-8328-1e0563e1fc6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:20.544823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6ae66-23b8-4b30-8328-1e0563e1fc6d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:20.557291 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 296/606] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:20.558351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6ae66-23b8-4b30-8328-1e0563e1fc6d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:20.608698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45a8de-afdd-4171-9c5d-e9f0ed1a16d0 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:20.643228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d879203-f548-4347-9f3e-3c9f1d900d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:20.643900 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d879203-f548-4347-9f3e-3c9f1d900d32 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:20.644179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d879203-f548-4347-9f3e-3c9f1d900d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:20.644474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d879203-f548-4347-9f3e-3c9f1d900d32 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:20.645197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d879203-f548-4347-9f3e-3c9f1d900d32 None admin] RBAC: Adding query filter params (name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:20.645498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d879203-f548-4347-9f3e-3c9f1d900d32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:20.646900 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d879203-f548-4347-9f3e-3c9f1d900d32 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:20.660379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 311/607] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:20.660379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d879203-f548-4347-9f3e-3c9f1d900d32 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:20.667471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6ae66-23b8-4b30-8328-1e0563e1fc6d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:20.705485 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a19c-4eed-43f0-bea4-e45695fd0c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:20.706489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a19c-4eed-43f0-bea4-e45695fd0c4a None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:20.706767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a19c-4eed-43f0-bea4-e45695fd0c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:20.707036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a19c-4eed-43f0-bea4-e45695fd0c4a None admin] PATH_INFO: `/v3/projects/587280a3c4c54bffb4d769e406af3689/users/c5efb606fb1b422182ab91576088c85f/roles/139847713c8a4df68a3d20babdbb75d5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:20.723072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939a19c-4eed-43f0-bea4-e45695fd0c4a None admin] RBAC: Authorizing `identity:create_grant(project_id=587280a3c4c54bffb4d769e406af3689, user_id=c5efb606fb1b422182ab91576088c85f, role_id=139847713c8a4df68a3d20babdbb75d5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:20.724858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939a19c-4eed-43f0-bea4-e45695fd0c4a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:20.780637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d879203-f548-4347-9f3e-3c9f1d900d32 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:20.811052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 297/608] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:13:20 2022] PUT /identity/v3/projects/587280a3c4c54bffb4d769e406af3689/users/c5efb606fb1b422182ab91576088c85f/roles/139847713c8a4df68a3d20babdbb75d5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:13:20.812090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a19c-4eed-43f0-bea4-e45695fd0c4a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:20.821025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f67b9-b048-40c5-8965-1cea215917e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:20.822335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f67b9-b048-40c5-8965-1cea215917e0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:20.823018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f67b9-b048-40c5-8965-1cea215917e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:20.823499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f67b9-b048-40c5-8965-1cea215917e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:20.833210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f67b9-b048-40c5-8965-1cea215917e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:20.835251 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f67b9-b048-40c5-8965-1cea215917e0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-9b9f67b9-b048-40c5-8965-1cea215917e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:20.855894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:20.858744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:20.859635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:20.859635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:20.859635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:20.859635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:20.859635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:20.859635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:20.859635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:20.859635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:20.859635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 312/609] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:20.866011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f67b9-b048-40c5-8965-1cea215917e0 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:21.037457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f67b9-b048-40c5-8965-1cea215917e0 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:21.062437 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a19c-4eed-43f0-bea4-e45695fd0c4a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:21.121177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe93aa-5285-468f-a4a8-c1d70e72c190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:21.121863 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe93aa-5285-468f-a4a8-c1d70e72c190 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:21.122143 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe93aa-5285-468f-a4a8-c1d70e72c190 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:21.122446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe93aa-5285-468f-a4a8-c1d70e72c190 None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:21.123908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe93aa-5285-468f-a4a8-c1d70e72c190 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:21.124314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe93aa-5285-468f-a4a8-c1d70e72c190 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:21.129758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39de363-ec4e-4064-8a44-6e5c2594241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:21.130709 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de363-ec4e-4064-8a44-6e5c2594241c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:21.130992 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de363-ec4e-4064-8a44-6e5c2594241c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:21.131270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de363-ec4e-4064-8a44-6e5c2594241c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:21.131474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe93aa-5285-468f-a4a8-c1d70e72c190 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:21.144704 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39de363-ec4e-4064-8a44-6e5c2594241c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:21.146530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39de363-ec4e-4064-8a44-6e5c2594241c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:21.149367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 313/610] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:21.155443 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe93aa-5285-468f-a4a8-c1d70e72c190 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-d39de363-ec4e-4064-8a44-6e5c2594241c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:21.167088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:21.168019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:21.168910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:21.168910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:21.168910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:21.168910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:21.168910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 298/611] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:21.178644 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39de363-ec4e-4064-8a44-6e5c2594241c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:21.329955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39de363-ec4e-4064-8a44-6e5c2594241c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:21.368405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5bcb4-749e-4dfe-82bd-ed1d1ea3c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:21.369442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5bcb4-749e-4dfe-82bd-ed1d1ea3c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:21.369930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5bcb4-749e-4dfe-82bd-ed1d1ea3c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:21.370453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5bcb4-749e-4dfe-82bd-ed1d1ea3c1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:21.371845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5bcb4-749e-4dfe-82bd-ed1d1ea3c1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:21.372543 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5bcb4-749e-4dfe-82bd-ed1d1ea3c1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:21.374211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5bcb4-749e-4dfe-82bd-ed1d1ea3c1a8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:21.387649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 299/612] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:21.391019 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe93aa-5285-468f-a4a8-c1d70e72c190 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:21.393538 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5bcb4-749e-4dfe-82bd-ed1d1ea3c1a8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:21.444881 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26349b9-84b0-4996-abaa-ddcd76b7c888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:21.446341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26349b9-84b0-4996-abaa-ddcd76b7c888 None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:21.446845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26349b9-84b0-4996-abaa-ddcd76b7c888 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:21.447336 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26349b9-84b0-4996-abaa-ddcd76b7c888 None admin] PATH_INFO: `/v3/projects/587280a3c4c54bffb4d769e406af3689/users/7fe051e3e2084f89a95a95aa4fd857df/roles/139847713c8a4df68a3d20babdbb75d5` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:21.466013 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26349b9-84b0-4996-abaa-ddcd76b7c888 None admin] RBAC: Authorizing `identity:create_grant(project_id=587280a3c4c54bffb4d769e406af3689, user_id=7fe051e3e2084f89a95a95aa4fd857df, role_id=139847713c8a4df68a3d20babdbb75d5)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:21.468440 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26349b9-84b0-4996-abaa-ddcd76b7c888 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:21.543636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5bcb4-749e-4dfe-82bd-ed1d1ea3c1a8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:21.579216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada813a-6660-448a-89ee-170badc469c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:21.580576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada813a-6660-448a-89ee-170badc469c3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:21.581075 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada813a-6660-448a-89ee-170badc469c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:21.581549 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada813a-6660-448a-89ee-170badc469c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:21.593820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 314/613] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:13:21 2022] PUT /identity/v3/projects/587280a3c4c54bffb4d769e406af3689/users/7fe051e3e2084f89a95a95aa4fd857df/roles/139847713c8a4df68a3d20babdbb75d5 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:13:21.597228 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada813a-6660-448a-89ee-170badc469c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:21.599152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada813a-6660-448a-89ee-170badc469c3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-bada813a-6660-448a-89ee-170badc469c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:21.615581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:21.616566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:21.617514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:21.617514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:21.617514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:21.617514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:21.617514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:21.617514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:21.617514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:21.617514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:21.617514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:13:21.617514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:21.620266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 300/614] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:13:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:21.626498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26349b9-84b0-4996-abaa-ddcd76b7c888 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:21.650251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ff1ee-bfac-43d5-9ecd-b50a77acf60a None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:21.650610 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ff1ee-bfac-43d5-9ecd-b50a77acf60a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:21.650891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ff1ee-bfac-43d5-9ecd-b50a77acf60a None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:21.652466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 301/615] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:21.659887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b21dcd-506a-4dbb-8873-9717f1d3dbdb None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:21.660499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b21dcd-506a-4dbb-8873-9717f1d3dbdb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:21.661001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b21dcd-506a-4dbb-8873-9717f1d3dbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:21.683129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-10b21dcd-506a-4dbb-8873-9717f1d3dbdb None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:21.684652 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-10b21dcd-506a-4dbb-8873-9717f1d3dbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:21.810133 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 302/616] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:13:21.831628 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26349b9-84b0-4996-abaa-ddcd76b7c888 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:21.845420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b21dcd-506a-4dbb-8873-9717f1d3dbdb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:21.868079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39659-d1bb-4daf-af9f-af23bbd17473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:21.869142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39659-d1bb-4daf-af9f-af23bbd17473 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:21.869638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39659-d1bb-4daf-af9f-af23bbd17473 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:21.870130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39659-d1bb-4daf-af9f-af23bbd17473 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:21.871256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde39659-d1bb-4daf-af9f-af23bbd17473 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:21.871763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde39659-d1bb-4daf-af9f-af23bbd17473 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:21.873713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde39659-d1bb-4daf-af9f-af23bbd17473 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:21.896632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 315/617] 10.222.0.44 () {56 vars in 1135 bytes} [Thu May 5 15:13:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:21.898156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39659-d1bb-4daf-af9f-af23bbd17473 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:21.999397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b21dcd-506a-4dbb-8873-9717f1d3dbdb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:22.027971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39659-d1bb-4daf-af9f-af23bbd17473 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:22.059500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12511b-0290-48aa-953e-574fba450095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:22.061193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12511b-0290-48aa-953e-574fba450095 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:22.061554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12511b-0290-48aa-953e-574fba450095 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:22.061867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12511b-0290-48aa-953e-574fba450095 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:22.071006 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79065f-a652-4ff8-af60-edb511d9afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:22.071816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79065f-a652-4ff8-af60-edb511d9afa1 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:22.072099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79065f-a652-4ff8-af60-edb511d9afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:22.072373 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79065f-a652-4ff8-af60-edb511d9afa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:22.073324 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12511b-0290-48aa-953e-574fba450095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ec12511b-0290-48aa-953e-574fba450095 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:22.081392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:22.082399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:22.083646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:22.083646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:22.083646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:22.083646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:22.083646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:22.083646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:22.083646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:22.083646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:22.083646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:22.083646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:22.083646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:22.083646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:22.083646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 303/618] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:22.088458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12511b-0290-48aa-953e-574fba450095 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:22.088858 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79065f-a652-4ff8-af60-edb511d9afa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:22.090549 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79065f-a652-4ff8-af60-edb511d9afa1 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-6f79065f-a652-4ff8-af60-edb511d9afa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:22.124385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:22.126731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:22.128807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:22.128807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:22.128807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:22.128807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:22.128807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 316/619] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:22.134916 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79065f-a652-4ff8-af60-edb511d9afa1 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:22.192164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12511b-0290-48aa-953e-574fba450095 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:22.225578 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8c020-81a3-421e-948d-e5cc7b85c595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:22.226255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8c020-81a3-421e-948d-e5cc7b85c595 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:22.226565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8c020-81a3-421e-948d-e5cc7b85c595 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:22.226843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8c020-81a3-421e-948d-e5cc7b85c595 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:22.227590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8c020-81a3-421e-948d-e5cc7b85c595 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:22.227897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8c020-81a3-421e-948d-e5cc7b85c595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:22.229282 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8c020-81a3-421e-948d-e5cc7b85c595 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:22.242477 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 304/620] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:22.243720 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8c020-81a3-421e-948d-e5cc7b85c595 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:22.291665 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79065f-a652-4ff8-af60-edb511d9afa1 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:22.352881 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30348591-3419-4e93-9e6f-2064199c4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:22.353463 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30348591-3419-4e93-9e6f-2064199c4d66 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:22.353741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30348591-3419-4e93-9e6f-2064199c4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:22.355238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30348591-3419-4e93-9e6f-2064199c4d66 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:22.356526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30348591-3419-4e93-9e6f-2064199c4d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:22.356833 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30348591-3419-4e93-9e6f-2064199c4d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:22.358324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30348591-3419-4e93-9e6f-2064199c4d66 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:22.369888 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 317/621] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:22.377275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30348591-3419-4e93-9e6f-2064199c4d66 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:22.441153 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8c020-81a3-421e-948d-e5cc7b85c595 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:22.483809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e17b3f-2edc-4d90-9a3c-a1e0552d78dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:22.485007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e17b3f-2edc-4d90-9a3c-a1e0552d78dc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:22.485488 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e17b3f-2edc-4d90-9a3c-a1e0552d78dc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:22.485958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e17b3f-2edc-4d90-9a3c-a1e0552d78dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:22.497093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e17b3f-2edc-4d90-9a3c-a1e0552d78dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:22.499011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e17b3f-2edc-4d90-9a3c-a1e0552d78dc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b2e17b3f-2edc-4d90-9a3c-a1e0552d78dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:22.517129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:22.518190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:22.519099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:22.519099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:22.519099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:22.519099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:22.521336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 305/622] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:22.527369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e17b3f-2edc-4d90-9a3c-a1e0552d78dc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:22.606112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30348591-3419-4e93-9e6f-2064199c4d66 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:22.663685 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000bd27-b4dd-4100-b9d4-d9ee30535cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:22.664481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000bd27-b4dd-4100-b9d4-d9ee30535cdc None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:22.664757 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000bd27-b4dd-4100-b9d4-d9ee30535cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:22.665029 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000bd27-b4dd-4100-b9d4-d9ee30535cdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:22.670699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e17b3f-2edc-4d90-9a3c-a1e0552d78dc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:22.681977 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000bd27-b4dd-4100-b9d4-d9ee30535cdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:22.681977 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000bd27-b4dd-4100-b9d4-d9ee30535cdc None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-0000bd27-b4dd-4100-b9d4-d9ee30535cdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:22.688674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:22.689697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:22.690841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:22.690841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:22.690841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:22.690841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:22.690841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:22.690841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:22.690841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:22.690841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:22.690841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 318/623] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:22.691434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8968cd2-9c1b-4d84-8bd1-c73a594aee36 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:22.691720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8968cd2-9c1b-4d84-8bd1-c73a594aee36 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:22.691997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8968cd2-9c1b-4d84-8bd1-c73a594aee36 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:22.698248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 319/624] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:22.699066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8968cd2-9c1b-4d84-8bd1-c73a594aee36 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:22.716031 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbf7cf-43c8-4af5-b2c1-2ec1c3fbec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:22.718417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbf7cf-43c8-4af5-b2c1-2ec1c3fbec51 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:22.719208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbf7cf-43c8-4af5-b2c1-2ec1c3fbec51 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:22.719695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbf7cf-43c8-4af5-b2c1-2ec1c3fbec51 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:22.720625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbf7cf-43c8-4af5-b2c1-2ec1c3fbec51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:22.721169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbf7cf-43c8-4af5-b2c1-2ec1c3fbec51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:22.723610 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbf7cf-43c8-4af5-b2c1-2ec1c3fbec51 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:22.740916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 306/625] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:22.742960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021d9d8-4a4b-493b-bf0c-f6d239e0542d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:22.743855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021d9d8-4a4b-493b-bf0c-f6d239e0542d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:22.744470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021d9d8-4a4b-493b-bf0c-f6d239e0542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:22.769276 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4021d9d8-4a4b-493b-bf0c-f6d239e0542d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:22.770310 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4021d9d8-4a4b-493b-bf0c-f6d239e0542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:22.830871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8968cd2-9c1b-4d84-8bd1-c73a594aee36 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:22.838260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 307/626] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:22.839215 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021d9d8-4a4b-493b-bf0c-f6d239e0542d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:22.876667 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34fc64-447a-4084-933f-9fa2527c700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:22.877578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34fc64-447a-4084-933f-9fa2527c700d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:22.878009 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34fc64-447a-4084-933f-9fa2527c700d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:22.878461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34fc64-447a-4084-933f-9fa2527c700d None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:22.879423 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34fc64-447a-4084-933f-9fa2527c700d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:22.879876 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34fc64-447a-4084-933f-9fa2527c700d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:22.881457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34fc64-447a-4084-933f-9fa2527c700d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:22.897622 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 320/627] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:22.898777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34fc64-447a-4084-933f-9fa2527c700d None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:22.957227 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021d9d8-4a4b-493b-bf0c-f6d239e0542d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:22.996219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78d484-a661-4124-bc7c-103aa7c12200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:22.997410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78d484-a661-4124-bc7c-103aa7c12200 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:22.997884 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78d484-a661-4124-bc7c-103aa7c12200 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:22.998762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78d484-a661-4124-bc7c-103aa7c12200 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:23.009032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78d484-a661-4124-bc7c-103aa7c12200 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:23.010875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78d484-a661-4124-bc7c-103aa7c12200 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:23.021988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34fc64-447a-4084-933f-9fa2527c700d None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9f78d484-a661-4124-bc7c-103aa7c12200 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:23.030700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:23.031867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:23.033006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:23.033006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:23.033006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:23.033006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:23.033006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:23.033006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:23.033006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:23.033006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:23.033006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:13:23.033006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:23.033006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 308/628] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 5 15:13:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:23.033738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78d484-a661-4124-bc7c-103aa7c12200 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:23.070516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f4079-b49d-425e-9ee9-a53bd46438e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:23.071736 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f4079-b49d-425e-9ee9-a53bd46438e6 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:23.072474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f4079-b49d-425e-9ee9-a53bd46438e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:23.073175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f4079-b49d-425e-9ee9-a53bd46438e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:23.085188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f4079-b49d-425e-9ee9-a53bd46438e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-d20f4079-b49d-425e-9ee9-a53bd46438e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:23.096348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:23.097671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:23.098722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:23.098722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:23.098722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:23.098722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:23.098722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:23.098722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:23.098722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:23.098722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:23.098722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:23.098722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:23.098722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:23.098722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:23.101178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 321/629] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:23.102801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f4079-b49d-425e-9ee9-a53bd46438e6 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:23.152533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78d484-a661-4124-bc7c-103aa7c12200 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:23.192926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da799928-9124-4712-b572-cdaecf009e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:23.193961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da799928-9124-4712-b572-cdaecf009e2e None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:23.194369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da799928-9124-4712-b572-cdaecf009e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:23.194741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da799928-9124-4712-b572-cdaecf009e2e None admin] PATH_INFO: `/v3/projects/587280a3c4c54bffb4d769e406af3689/users/27e0b470f6b84df38565abf006dd8ba1/roles/139847713c8a4df68a3d20babdbb75d5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:23.214018 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da799928-9124-4712-b572-cdaecf009e2e None admin] RBAC: Authorizing `identity:create_grant(project_id=587280a3c4c54bffb4d769e406af3689, user_id=27e0b470f6b84df38565abf006dd8ba1, role_id=139847713c8a4df68a3d20babdbb75d5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:23.215957 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da799928-9124-4712-b572-cdaecf009e2e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:23.226800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f4079-b49d-425e-9ee9-a53bd46438e6 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:23.260585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec82ba6-99c5-478e-94ca-6bd273d523d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:23.261493 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec82ba6-99c5-478e-94ca-6bd273d523d7 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:23.261945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec82ba6-99c5-478e-94ca-6bd273d523d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:23.262396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec82ba6-99c5-478e-94ca-6bd273d523d7 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:23.263406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec82ba6-99c5-478e-94ca-6bd273d523d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:23.263916 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec82ba6-99c5-478e-94ca-6bd273d523d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:23.265539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec82ba6-99c5-478e-94ca-6bd273d523d7 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:23.288754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 322/630] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 5 15:13:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:23.289904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec82ba6-99c5-478e-94ca-6bd273d523d7 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:23.291333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 309/631] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:13:23 2022] PUT /identity/v3/projects/587280a3c4c54bffb4d769e406af3689/users/27e0b470f6b84df38565abf006dd8ba1/roles/139847713c8a4df68a3d20babdbb75d5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:13:23.299228 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da799928-9124-4712-b572-cdaecf009e2e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:23.492891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da799928-9124-4712-b572-cdaecf009e2e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:23.495482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec82ba6-99c5-478e-94ca-6bd273d523d7 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:23.537824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca095ad6-a071-4b46-968c-7eaefa4ca2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:23.538520 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3638669-3e9c-46ff-bbc7-78a7e384039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:23.538666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca095ad6-a071-4b46-968c-7eaefa4ca2ee None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:23.538858 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca095ad6-a071-4b46-968c-7eaefa4ca2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:23.539130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca095ad6-a071-4b46-968c-7eaefa4ca2ee None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:23.539230 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3638669-3e9c-46ff-bbc7-78a7e384039b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:23.539443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3638669-3e9c-46ff-bbc7-78a7e384039b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:23.539719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3638669-3e9c-46ff-bbc7-78a7e384039b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:23.539937 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca095ad6-a071-4b46-968c-7eaefa4ca2ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:23.540252 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca095ad6-a071-4b46-968c-7eaefa4ca2ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:23.541849 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca095ad6-a071-4b46-968c-7eaefa4ca2ee None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:23.550782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 323/632] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:23.552113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18801db7-7a08-43c8-a3a9-bd0137bab80d None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:23.552402 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18801db7-7a08-43c8-a3a9-bd0137bab80d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:23.552679 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18801db7-7a08-43c8-a3a9-bd0137bab80d None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:23.554435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 324/633] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:23.556469 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18801db7-7a08-43c8-a3a9-bd0137bab80d None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:23.632605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3638669-3e9c-46ff-bbc7-78a7e384039b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:23.634133 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3638669-3e9c-46ff-bbc7-78a7e384039b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:23.663145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18801db7-7a08-43c8-a3a9-bd0137bab80d None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:23.699866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed070d-034b-4a2d-9891-8d3daac6ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:23.701661 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed070d-034b-4a2d-9891-8d3daac6ddfc None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:23.702205 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed070d-034b-4a2d-9891-8d3daac6ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:23.703000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed070d-034b-4a2d-9891-8d3daac6ddfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:23.714317 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed070d-034b-4a2d-9891-8d3daac6ddfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:23.716098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed070d-034b-4a2d-9891-8d3daac6ddfc None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-40ed070d-034b-4a2d-9891-8d3daac6ddfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:23.736420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:23.737456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:23.738392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:23.738392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:23.738392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:23.738392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:23.740702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 325/634] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:23.742186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f85de-87a5-47b1-acb3-8cd752af83d7 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:23.742700 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f85de-87a5-47b1-acb3-8cd752af83d7 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:23.743255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f85de-87a5-47b1-acb3-8cd752af83d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:23.760785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-fd6f85de-87a5-47b1-acb3-8cd752af83d7 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:23.762577 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-fd6f85de-87a5-47b1-acb3-8cd752af83d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:23.767793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 310/635] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:13:23.767793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3638669-3e9c-46ff-bbc7-78a7e384039b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:23.836848 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 326/636] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:23.838139 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f85de-87a5-47b1-acb3-8cd752af83d7 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:23.891945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3638669-3e9c-46ff-bbc7-78a7e384039b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:23.929332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bbd89-0c58-4a7e-bbd5-32cbc2a67de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:23.931191 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bbd89-0c58-4a7e-bbd5-32cbc2a67de0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:23.931688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bbd89-0c58-4a7e-bbd5-32cbc2a67de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:23.932166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bbd89-0c58-4a7e-bbd5-32cbc2a67de0 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:23.933109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bbd89-0c58-4a7e-bbd5-32cbc2a67de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:23.933617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bbd89-0c58-4a7e-bbd5-32cbc2a67de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:23.935928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bbd89-0c58-4a7e-bbd5-32cbc2a67de0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:23.951347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 311/637] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:23.953461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bbd89-0c58-4a7e-bbd5-32cbc2a67de0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:23.960051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f85de-87a5-47b1-acb3-8cd752af83d7 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:23.996544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fbbfa-b9b1-4310-95b5-0152b656ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:23.997454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fbbfa-b9b1-4310-95b5-0152b656ab10 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:23.998404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fbbfa-b9b1-4310-95b5-0152b656ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:23.998779 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fbbfa-b9b1-4310-95b5-0152b656ab10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:24.010560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fbbfa-b9b1-4310-95b5-0152b656ab10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:24.014025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fbbfa-b9b1-4310-95b5-0152b656ab10 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-8f4fbbfa-b9b1-4310-95b5-0152b656ab10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:24.036479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:24.037638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:24.038759 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:24.038759 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:24.038759 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:24.038759 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:24.046398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 327/638] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:24.046398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fbbfa-b9b1-4310-95b5-0152b656ab10 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:24.092613 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bbd89-0c58-4a7e-bbd5-32cbc2a67de0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:24.136572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b3ccc-d077-4ed5-913b-55c1ea6d283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:24.138381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b3ccc-d077-4ed5-913b-55c1ea6d283a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:24.138900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b3ccc-d077-4ed5-913b-55c1ea6d283a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:24.139652 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b3ccc-d077-4ed5-913b-55c1ea6d283a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:24.145716 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fbbfa-b9b1-4310-95b5-0152b656ab10 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:24.153017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b3ccc-d077-4ed5-913b-55c1ea6d283a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-811b3ccc-d077-4ed5-913b-55c1ea6d283a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:24.164312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:24.165942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:24.166948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:24.166948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:24.166948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:24.166948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:24.166948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:24.166948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:24.166948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:24.166948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:24.166948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:24.166948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:24.166948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:24.166948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:24.170364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 312/639] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:24.171450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b3ccc-d077-4ed5-913b-55c1ea6d283a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:24.199313 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978cb06-a027-4741-8862-67c1ecfd2d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:24.200123 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978cb06-a027-4741-8862-67c1ecfd2d11 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:24.200406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978cb06-a027-4741-8862-67c1ecfd2d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:24.200703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978cb06-a027-4741-8862-67c1ecfd2d11 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:24.210564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978cb06-a027-4741-8862-67c1ecfd2d11 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:24.212033 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978cb06-a027-4741-8862-67c1ecfd2d11 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-6978cb06-a027-4741-8862-67c1ecfd2d11 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:24.227997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:24.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:24.230043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:24.230043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:24.230043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:24.230043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:24.230043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:24.230043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:24.230043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:24.230043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:24.230043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 15:13:24.230043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:24.230043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 328/640] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:13:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:24.230043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978cb06-a027-4741-8862-67c1ecfd2d11 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:24.291499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b3ccc-d077-4ed5-913b-55c1ea6d283a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:24.334048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406c115-cdb0-4256-ae3c-54e2aec1a96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:24.334746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c115-cdb0-4256-ae3c-54e2aec1a96b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:24.335051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c115-cdb0-4256-ae3c-54e2aec1a96b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:24.335321 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c115-cdb0-4256-ae3c-54e2aec1a96b None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:24.336042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406c115-cdb0-4256-ae3c-54e2aec1a96b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:24.336353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406c115-cdb0-4256-ae3c-54e2aec1a96b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:24.337513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978cb06-a027-4741-8862-67c1ecfd2d11 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:24.337729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406c115-cdb0-4256-ae3c-54e2aec1a96b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:24.352514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 313/641] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:24.354155 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a0a4d-0a8d-4e6c-a99d-ef62729429c0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:24.354484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a0a4d-0a8d-4e6c-a99d-ef62729429c0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:24.354783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a0a4d-0a8d-4e6c-a99d-ef62729429c0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:24.356189 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 314/642] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:24.359602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a0a4d-0a8d-4e6c-a99d-ef62729429c0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:24.382619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb14d9b-1bd5-4da4-8009-5042c6362dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:24.383547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb14d9b-1bd5-4da4-8009-5042c6362dcc None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:24.384003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb14d9b-1bd5-4da4-8009-5042c6362dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:24.384417 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb14d9b-1bd5-4da4-8009-5042c6362dcc None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:24.385308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb14d9b-1bd5-4da4-8009-5042c6362dcc None admin] RBAC: Adding query filter params (name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:24.385754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb14d9b-1bd5-4da4-8009-5042c6362dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:24.387618 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb14d9b-1bd5-4da4-8009-5042c6362dcc None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:24.401716 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 329/643] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:24.402641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb14d9b-1bd5-4da4-8009-5042c6362dcc None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:24.485315 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a0a4d-0a8d-4e6c-a99d-ef62729429c0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:24.520361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb14d9b-1bd5-4da4-8009-5042c6362dcc None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:24.525050 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6b285-a1d8-4bf6-a3b4-394a0033091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:24.525926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6b285-a1d8-4bf6-a3b4-394a0033091a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:24.527028 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6b285-a1d8-4bf6-a3b4-394a0033091a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:24.527028 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6b285-a1d8-4bf6-a3b4-394a0033091a None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:24.527193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6b285-a1d8-4bf6-a3b4-394a0033091a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:24.527482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6b285-a1d8-4bf6-a3b4-394a0033091a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:24.529002 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6b285-a1d8-4bf6-a3b4-394a0033091a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:24.552426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 315/644] 10.222.0.44 () {56 vars in 1137 bytes} [Thu May 5 15:13:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:24.552426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589c4f9-7deb-461a-aa2a-c2d883ae4387 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:24.552426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589c4f9-7deb-461a-aa2a-c2d883ae4387 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:24.552426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589c4f9-7deb-461a-aa2a-c2d883ae4387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:24.566544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aae07-3697-4872-bcf1-be099f025aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:24.567224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7589c4f9-7deb-461a-aa2a-c2d883ae4387 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:24.567804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aae07-3697-4872-bcf1-be099f025aee None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:24.568262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aae07-3697-4872-bcf1-be099f025aee None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:24.568449 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7589c4f9-7deb-461a-aa2a-c2d883ae4387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:24.568727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aae07-3697-4872-bcf1-be099f025aee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:24.579663 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3aae07-3697-4872-bcf1-be099f025aee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:24.581118 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3aae07-3697-4872-bcf1-be099f025aee None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-cd3aae07-3697-4872-bcf1-be099f025aee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:24.601726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:24.602715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:24.603720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:24.603720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:24.603720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:24.603720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:24.603720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:24.603720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:24.603720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:24.603720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:24.603720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 330/645] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:24.607421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aae07-3697-4872-bcf1-be099f025aee None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:24.659183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 316/646] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:24.660042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589c4f9-7deb-461a-aa2a-c2d883ae4387 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:24.743942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aae07-3697-4872-bcf1-be099f025aee None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:24.778872 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589c4f9-7deb-461a-aa2a-c2d883ae4387 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:24.783079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fced3-2f1c-4247-bc04-19a05932fcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:24.784419 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fced3-2f1c-4247-bc04-19a05932fcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:24.784892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fced3-2f1c-4247-bc04-19a05932fcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:24.785356 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fced3-2f1c-4247-bc04-19a05932fcf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:24.801648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fced3-2f1c-4247-bc04-19a05932fcf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:24.804411 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fced3-2f1c-4247-bc04-19a05932fcf5 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:24.814767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d23b86-4302-48c6-a81a-f824b4e73dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:24.815472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d23b86-4302-48c6-a81a-f824b4e73dcd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:24.815760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d23b86-4302-48c6-a81a-f824b4e73dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:24.816066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d23b86-4302-48c6-a81a-f824b4e73dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-aa7fced3-2f1c-4247-bc04-19a05932fcf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:24.830573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:24.831536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:24.832401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:24.832401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:24.832401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:24.832401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:24.833171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 331/647] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:24.833495 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fced3-2f1c-4247-bc04-19a05932fcf5 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:24.901170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d23b86-4302-48c6-a81a-f824b4e73dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:24.902838 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d23b86-4302-48c6-a81a-f824b4e73dcd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:24.940341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fced3-2f1c-4247-bc04-19a05932fcf5 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:24.975506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b6513-0904-4c24-ab8f-553536002170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:24.976188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b6513-0904-4c24-ab8f-553536002170 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:24.976474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b6513-0904-4c24-ab8f-553536002170 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:24.976862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b6513-0904-4c24-ab8f-553536002170 None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:24.977549 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b6513-0904-4c24-ab8f-553536002170 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:24.977861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b6513-0904-4c24-ab8f-553536002170 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:24.979359 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b6513-0904-4c24-ab8f-553536002170 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:24.997217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 332/648] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:24.997217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b6513-0904-4c24-ab8f-553536002170 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:25.021382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 317/649] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:13:25.022651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d23b86-4302-48c6-a81a-f824b4e73dcd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:25.105151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b6513-0904-4c24-ab8f-553536002170 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:25.131391 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d23b86-4302-48c6-a81a-f824b4e73dcd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:25.139291 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e75e7-3bc2-41c9-aeec-6e0d893d6f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:25.140111 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e75e7-3bc2-41c9-aeec-6e0d893d6f0e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:25.140390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e75e7-3bc2-41c9-aeec-6e0d893d6f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:25.141244 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e75e7-3bc2-41c9-aeec-6e0d893d6f0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:25.151310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e75e7-3bc2-41c9-aeec-6e0d893d6f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-d11e75e7-3bc2-41c9-aeec-6e0d893d6f0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:25.159429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:25.160459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 333/650] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:25.161792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e75e7-3bc2-41c9-aeec-6e0d893d6f0e None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:25.175711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5906f-fa58-4bad-91ba-e79750ce3450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:25.176408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5906f-fa58-4bad-91ba-e79750ce3450 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:25.176691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5906f-fa58-4bad-91ba-e79750ce3450 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:25.176964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5906f-fa58-4bad-91ba-e79750ce3450 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:25.177678 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5906f-fa58-4bad-91ba-e79750ce3450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:25.178055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5906f-fa58-4bad-91ba-e79750ce3450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:25.179576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5906f-fa58-4bad-91ba-e79750ce3450 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:25.196326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 318/651] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:25.196326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5906f-fa58-4bad-91ba-e79750ce3450 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:25.266822 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e75e7-3bc2-41c9-aeec-6e0d893d6f0e None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:25.298048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5906f-fa58-4bad-91ba-e79750ce3450 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:25.300992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7d983-8223-4b3f-baf7-73cb16dbc3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:25.301689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7d983-8223-4b3f-baf7-73cb16dbc3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:25.301975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7d983-8223-4b3f-baf7-73cb16dbc3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:25.302335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7d983-8223-4b3f-baf7-73cb16dbc3a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:25.303143 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7d983-8223-4b3f-baf7-73cb16dbc3a8 None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=eb4ff6ba4e17477d8787eaf1955bd1da) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:25.303456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7d983-8223-4b3f-baf7-73cb16dbc3a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:25.304889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7d983-8223-4b3f-baf7-73cb16dbc3a8 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:25.311814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 334/652] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:25 2022] GET /identity/v3/role_assignments?user.id=eb4ff6ba4e17477d8787eaf1955bd1da&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:25.312911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7d983-8223-4b3f-baf7-73cb16dbc3a8 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:25.358247 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7f5ec-6db9-4988-bda5-6188356b81b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:25.358990 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7f5ec-6db9-4988-bda5-6188356b81b0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:25.359274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7f5ec-6db9-4988-bda5-6188356b81b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:25.359552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7f5ec-6db9-4988-bda5-6188356b81b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:25.376814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7f5ec-6db9-4988-bda5-6188356b81b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:25.379328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7f5ec-6db9-4988-bda5-6188356b81b0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-fbd7f5ec-6db9-4988-bda5-6188356b81b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:25.403593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:25.405302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:25.406214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:25.406214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:25.406214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:25.406214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:25.413095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 319/653] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:25.413095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7f5ec-6db9-4988-bda5-6188356b81b0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:25.447631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7d983-8223-4b3f-baf7-73cb16dbc3a8 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:25.496671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b236120-46cd-4887-87a7-25f3a36c570d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:25.498358 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b236120-46cd-4887-87a7-25f3a36c570d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:25.498855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b236120-46cd-4887-87a7-25f3a36c570d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:25.499330 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b236120-46cd-4887-87a7-25f3a36c570d None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:25.500350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b236120-46cd-4887-87a7-25f3a36c570d None admin] RBAC: Adding query filter params (name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:25.500908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b236120-46cd-4887-87a7-25f3a36c570d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:25.502611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b236120-46cd-4887-87a7-25f3a36c570d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:25.517757 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 335/654] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:25.519287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b236120-46cd-4887-87a7-25f3a36c570d None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:25.531381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7f5ec-6db9-4988-bda5-6188356b81b0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:25.574593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90992d6-662f-411d-bb22-34cf67969a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:25.575396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90992d6-662f-411d-bb22-34cf67969a38 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:25.575673 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90992d6-662f-411d-bb22-34cf67969a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:25.576571 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90992d6-662f-411d-bb22-34cf67969a38 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:25.584763 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90992d6-662f-411d-bb22-34cf67969a38 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:25.586196 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90992d6-662f-411d-bb22-34cf67969a38 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b90992d6-662f-411d-bb22-34cf67969a38 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:25.600458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:25.601675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:25.602834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:25.602834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:25.602834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:25.602834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:25.602834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:25.602834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:25.602834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:25.602834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:25.602834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:13:25.602834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:25.602834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 320/655] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:25.602834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90992d6-662f-411d-bb22-34cf67969a38 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:25.644699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b236120-46cd-4887-87a7-25f3a36c570d None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:25.686818 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394394a-a034-4d7f-85e6-3536b5dcb1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:25.687610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394394a-a034-4d7f-85e6-3536b5dcb1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:25.688006 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394394a-a034-4d7f-85e6-3536b5dcb1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:25.688432 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394394a-a034-4d7f-85e6-3536b5dcb1d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:25.689324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394394a-a034-4d7f-85e6-3536b5dcb1d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:25.689714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394394a-a034-4d7f-85e6-3536b5dcb1d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:25.691345 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394394a-a034-4d7f-85e6-3536b5dcb1d6 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:25.704492 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 336/656] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:25.705497 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394394a-a034-4d7f-85e6-3536b5dcb1d6 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:25.724347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90992d6-662f-411d-bb22-34cf67969a38 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:25.762585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c8e3d-2820-43cf-bbaa-8270f3ca0187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:25.763923 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c8e3d-2820-43cf-bbaa-8270f3ca0187 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:25.764527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c8e3d-2820-43cf-bbaa-8270f3ca0187 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:25.764808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c8e3d-2820-43cf-bbaa-8270f3ca0187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:25.775828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c8e3d-2820-43cf-bbaa-8270f3ca0187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:25.777271 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c8e3d-2820-43cf-bbaa-8270f3ca0187 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b40c8e3d-2820-43cf-bbaa-8270f3ca0187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:25.795623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:25.796737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:25.797819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:25.797819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:25.797819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:25.797819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:25.801225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 321/657] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:25.802078 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c8e3d-2820-43cf-bbaa-8270f3ca0187 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:25.814821 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394394a-a034-4d7f-85e6-3536b5dcb1d6 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:25.849697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569f42f-5bc5-43a6-b37e-6196f8057812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:25.850417 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f42f-5bc5-43a6-b37e-6196f8057812 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:25.850711 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f42f-5bc5-43a6-b37e-6196f8057812 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:25.850991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f42f-5bc5-43a6-b37e-6196f8057812 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:25.851827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569f42f-5bc5-43a6-b37e-6196f8057812 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:25.852136 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569f42f-5bc5-43a6-b37e-6196f8057812 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:25.853564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569f42f-5bc5-43a6-b37e-6196f8057812 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:25.871026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 337/658] 10.222.0.44 () {56 vars in 1139 bytes} [Thu May 5 15:13:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:25.873270 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847003b-3435-4ce9-85be-87e2624c3849 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:25.873930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847003b-3435-4ce9-85be-87e2624c3849 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:25.874500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847003b-3435-4ce9-85be-87e2624c3849 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:25.876386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 338/659] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:25.877291 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847003b-3435-4ce9-85be-87e2624c3849 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:25.902587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c8e3d-2820-43cf-bbaa-8270f3ca0187 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:25.936915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbf1f0-6509-4409-a95a-071c515aed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:25.937853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbf1f0-6509-4409-a95a-071c515aed61 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:25.938217 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbf1f0-6509-4409-a95a-071c515aed61 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:25.938604 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbf1f0-6509-4409-a95a-071c515aed61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:25.945224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbf1f0-6509-4409-a95a-071c515aed61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:25.946693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbf1f0-6509-4409-a95a-071c515aed61 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e0dbf1f0-6509-4409-a95a-071c515aed61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:25.962019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:25.962943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:25.963820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:25.963820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:25.963820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:25.963820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:25.963820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:25.963820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:25.963820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:25.963820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:25.968574 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 322/660] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:25.969625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbf1f0-6509-4409-a95a-071c515aed61 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:25.979176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847003b-3435-4ce9-85be-87e2624c3849 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:26.014648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc0c63-a030-4ee9-8b67-1b4f52da5d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:26.015312 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc0c63-a030-4ee9-8b67-1b4f52da5d33 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:26.015595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc0c63-a030-4ee9-8b67-1b4f52da5d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:26.015873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc0c63-a030-4ee9-8b67-1b4f52da5d33 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:26.016622 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc0c63-a030-4ee9-8b67-1b4f52da5d33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:26.016928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc0c63-a030-4ee9-8b67-1b4f52da5d33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:26.018307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc0c63-a030-4ee9-8b67-1b4f52da5d33 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:26.034006 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 339/661] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:26.035452 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab86ec5-fc31-4e25-bb6d-1dcbd6b5170f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:26.035739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab86ec5-fc31-4e25-bb6d-1dcbd6b5170f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:26.036017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab86ec5-fc31-4e25-bb6d-1dcbd6b5170f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:26.053091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6ab86ec5-fc31-4e25-bb6d-1dcbd6b5170f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:26.054300 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6ab86ec5-fc31-4e25-bb6d-1dcbd6b5170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:26.073470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbf1f0-6509-4409-a95a-071c515aed61 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:26.107266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58682a0d-1a89-4a99-a36a-57cd9c6a2376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:26.108085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58682a0d-1a89-4a99-a36a-57cd9c6a2376 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:26.108372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58682a0d-1a89-4a99-a36a-57cd9c6a2376 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:26.108656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58682a0d-1a89-4a99-a36a-57cd9c6a2376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:26.130313 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 340/662] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:26.130313 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab86ec5-fc31-4e25-bb6d-1dcbd6b5170f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:26.175840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58682a0d-1a89-4a99-a36a-57cd9c6a2376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:26.177237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58682a0d-1a89-4a99-a36a-57cd9c6a2376 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:26.230215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab86ec5-fc31-4e25-bb6d-1dcbd6b5170f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:26.266226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49828892-548f-4bc8-a8d1-799fad99e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:26.266943 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49828892-548f-4bc8-a8d1-799fad99e25d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:26.267229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49828892-548f-4bc8-a8d1-799fad99e25d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:26.267507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49828892-548f-4bc8-a8d1-799fad99e25d None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:26.268302 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49828892-548f-4bc8-a8d1-799fad99e25d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:26.268611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49828892-548f-4bc8-a8d1-799fad99e25d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:26.270045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49828892-548f-4bc8-a8d1-799fad99e25d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:26.279599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 323/663] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:13:26.279599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58682a0d-1a89-4a99-a36a-57cd9c6a2376 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:26.282476 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 341/664] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:26.283301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49828892-548f-4bc8-a8d1-799fad99e25d None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:26.377444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58682a0d-1a89-4a99-a36a-57cd9c6a2376 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:26.382985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49828892-548f-4bc8-a8d1-799fad99e25d None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:26.412034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c62ac9-5061-44f2-8de1-c19a164d9854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:26.412828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c62ac9-5061-44f2-8de1-c19a164d9854 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:26.413143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c62ac9-5061-44f2-8de1-c19a164d9854 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:26.413376 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c62ac9-5061-44f2-8de1-c19a164d9854 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:26.416617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870c3f5-6b54-4ff9-bfb4-e5f07d8bfcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:26.417414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870c3f5-6b54-4ff9-bfb4-e5f07d8bfcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:26.417701 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870c3f5-6b54-4ff9-bfb4-e5f07d8bfcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:26.417980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870c3f5-6b54-4ff9-bfb4-e5f07d8bfcf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:26.421279 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c62ac9-5061-44f2-8de1-c19a164d9854 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:26.422750 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c62ac9-5061-44f2-8de1-c19a164d9854 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:26.429059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870c3f5-6b54-4ff9-bfb4-e5f07d8bfcf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-a870c3f5-6b54-4ff9-bfb4-e5f07d8bfcf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:26.437248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:26.438132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:26.439267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:26.439267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:26.439267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:26.439267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:26.439267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:26.439267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:26.439267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:26.439267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:26.439267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:26.439267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:26.439267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:26.439267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c2c62ac9-5061-44f2-8de1-c19a164d9854 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:26.439928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:26.440755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:26.441674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:26.441674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:26.441674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:26.441674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:26.441674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:26.441674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:26.441674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:26.441674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:26.441674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:13:26.441674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:26.442226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 342/665] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:26.442226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870c3f5-6b54-4ff9-bfb4-e5f07d8bfcf8 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:26.448224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 324/666] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:13:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:26.448224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c62ac9-5061-44f2-8de1-c19a164d9854 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:26.546131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870c3f5-6b54-4ff9-bfb4-e5f07d8bfcf8 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:26.553326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c62ac9-5061-44f2-8de1-c19a164d9854 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:26.579268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97182102-5536-48b8-a512-19e92d680661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:26.580098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182102-5536-48b8-a512-19e92d680661 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:26.580385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182102-5536-48b8-a512-19e92d680661 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:26.580664 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182102-5536-48b8-a512-19e92d680661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:26.588774 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8298fa-b405-46c7-941e-486c8945d625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:26.589442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8298fa-b405-46c7-941e-486c8945d625 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:26.589723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8298fa-b405-46c7-941e-486c8945d625 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:26.589997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8298fa-b405-46c7-941e-486c8945d625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:26.590868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8298fa-b405-46c7-941e-486c8945d625 None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=34f973b13dd44e609110f9a967ae1fed) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:26.591176 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8298fa-b405-46c7-941e-486c8945d625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:26.593222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8298fa-b405-46c7-941e-486c8945d625 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:26.593344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97182102-5536-48b8-a512-19e92d680661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:26.594753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97182102-5536-48b8-a512-19e92d680661 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:26.610313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 325/667] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:26 2022] GET /identity/v3/role_assignments?user.id=34f973b13dd44e609110f9a967ae1fed&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:26.610313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8298fa-b405-46c7-941e-486c8945d625 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-97182102-5536-48b8-a512-19e92d680661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:26.623892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:26.624855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:26.625867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:26.625867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:26.625867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:26.625867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:26.625867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 343/668] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:26.626144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97182102-5536-48b8-a512-19e92d680661 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:26.747445 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97182102-5536-48b8-a512-19e92d680661 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:26.748269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8298fa-b405-46c7-941e-486c8945d625 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:26.785115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acff00-6c27-4dab-a117-89c078f481bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:26.785800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acff00-6c27-4dab-a117-89c078f481bc None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:26.786078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acff00-6c27-4dab-a117-89c078f481bc None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:26.786650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acff00-6c27-4dab-a117-89c078f481bc None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:26.787492 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acff00-6c27-4dab-a117-89c078f481bc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:26.787799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acff00-6c27-4dab-a117-89c078f481bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:26.789392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acff00-6c27-4dab-a117-89c078f481bc None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:26.792505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57a1cd-9244-4183-8f71-9fe136eecf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:26.793197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57a1cd-9244-4183-8f71-9fe136eecf07 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:26.793481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57a1cd-9244-4183-8f71-9fe136eecf07 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:26.793760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57a1cd-9244-4183-8f71-9fe136eecf07 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:26.794647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57a1cd-9244-4183-8f71-9fe136eecf07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:26.794959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57a1cd-9244-4183-8f71-9fe136eecf07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:26.796358 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57a1cd-9244-4183-8f71-9fe136eecf07 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:26.806330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 326/669] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:26.807241 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57a1cd-9244-4183-8f71-9fe136eecf07 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:26.813341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 344/670] 10.222.0.44 () {56 vars in 1137 bytes} [Thu May 5 15:13:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:26.814438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acff00-6c27-4dab-a117-89c078f481bc None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:26.912830 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57a1cd-9244-4183-8f71-9fe136eecf07 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:26.917816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acff00-6c27-4dab-a117-89c078f481bc None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:26.948229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc8084-7b0b-4091-93ea-79e9d8ab05d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:26.948900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8084-7b0b-4091-93ea-79e9d8ab05d1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:26.949245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8084-7b0b-4091-93ea-79e9d8ab05d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:26.949528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8084-7b0b-4091-93ea-79e9d8ab05d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:26.950251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc8084-7b0b-4091-93ea-79e9d8ab05d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:26.950589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc8084-7b0b-4091-93ea-79e9d8ab05d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:26.952702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc8084-7b0b-4091-93ea-79e9d8ab05d1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:26.955274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dfc73-ad2a-47cd-8d66-d77c0500c976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:26.956083 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dfc73-ad2a-47cd-8d66-d77c0500c976 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:26.956369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dfc73-ad2a-47cd-8d66-d77c0500c976 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:26.956649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dfc73-ad2a-47cd-8d66-d77c0500c976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:26.965375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 327/671] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:26.966226 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc8084-7b0b-4091-93ea-79e9d8ab05d1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:26.971967 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dfc73-ad2a-47cd-8d66-d77c0500c976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:26.973454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dfc73-ad2a-47cd-8d66-d77c0500c976 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-543dfc73-ad2a-47cd-8d66-d77c0500c976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:26.992956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:26.993898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:26.994813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:26.994813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:26.994813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:26.994813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:26.994813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 345/672] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:26.995530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dfc73-ad2a-47cd-8d66-d77c0500c976 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:27.077770 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc8084-7b0b-4091-93ea-79e9d8ab05d1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:27.097845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dfc73-ad2a-47cd-8d66-d77c0500c976 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:27.124330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f5c35-ec41-4235-9c72-4a2758be5e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:27.125616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f5c35-ec41-4235-9c72-4a2758be5e97 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:27.126145 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f5c35-ec41-4235-9c72-4a2758be5e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:27.126490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f5c35-ec41-4235-9c72-4a2758be5e97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:27.132335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d9aa-92b2-4c5a-b819-3fcfa32a29a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:27.133137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d9aa-92b2-4c5a-b819-3fcfa32a29a6 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:27.133425 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d9aa-92b2-4c5a-b819-3fcfa32a29a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:27.133706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d9aa-92b2-4c5a-b819-3fcfa32a29a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:27.141513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664d9aa-92b2-4c5a-b819-3fcfa32a29a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:27.142993 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664d9aa-92b2-4c5a-b819-3fcfa32a29a6 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-4664d9aa-92b2-4c5a-b819-3fcfa32a29a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:27.158028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:27.160141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:27.162519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:27.162519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:27.162519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:27.162519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:27.162519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:27.162519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:27.162519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:27.162519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:27.170696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 346/673] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:27.170696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d9aa-92b2-4c5a-b819-3fcfa32a29a6 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:27.208229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f5c35-ec41-4235-9c72-4a2758be5e97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:27.210347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f5c35-ec41-4235-9c72-4a2758be5e97 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:27.267963 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d9aa-92b2-4c5a-b819-3fcfa32a29a6 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:27.311554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb86e0-eb18-42e7-9403-1079bdf87939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:27.312230 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb86e0-eb18-42e7-9403-1079bdf87939 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:27.312512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb86e0-eb18-42e7-9403-1079bdf87939 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:27.312932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb86e0-eb18-42e7-9403-1079bdf87939 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:27.313950 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb86e0-eb18-42e7-9403-1079bdf87939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:27.314257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb86e0-eb18-42e7-9403-1079bdf87939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:27.315648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb86e0-eb18-42e7-9403-1079bdf87939 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:27.329449 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 328/674] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:13:27.330246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f5c35-ec41-4235-9c72-4a2758be5e97 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:27.334364 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 347/675] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:27.335255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb86e0-eb18-42e7-9403-1079bdf87939 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:27.447696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f5c35-ec41-4235-9c72-4a2758be5e97 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:27.489429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac95d3-5474-4955-9389-abfd2504ebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:27.490411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac95d3-5474-4955-9389-abfd2504ebb0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:27.490698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac95d3-5474-4955-9389-abfd2504ebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:27.491221 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac95d3-5474-4955-9389-abfd2504ebb0 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:27.492471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac95d3-5474-4955-9389-abfd2504ebb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:27.493037 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac95d3-5474-4955-9389-abfd2504ebb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:27.494495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac95d3-5474-4955-9389-abfd2504ebb0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:27.509567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 329/676] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:27.510581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac95d3-5474-4955-9389-abfd2504ebb0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:27.576316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb86e0-eb18-42e7-9403-1079bdf87939 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:27.612325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e50944-8f70-46e8-ae6b-6ebed87ff1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:27.613404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e50944-8f70-46e8-ae6b-6ebed87ff1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:27.613762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e50944-8f70-46e8-ae6b-6ebed87ff1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:27.614104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e50944-8f70-46e8-ae6b-6ebed87ff1a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:27.625212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e50944-8f70-46e8-ae6b-6ebed87ff1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:27.626821 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e50944-8f70-46e8-ae6b-6ebed87ff1a3 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:27.640790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac95d3-5474-4955-9389-abfd2504ebb0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-71e50944-8f70-46e8-ae6b-6ebed87ff1a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:27.646459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:27.647524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:27.648626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:27.648626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:27.648626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:27.648626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:27.650326 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 348/677] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:27.651351 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e50944-8f70-46e8-ae6b-6ebed87ff1a3 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:27.688055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edb78b-ce82-4f09-b091-b8629bf9bb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:27.689123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edb78b-ce82-4f09-b091-b8629bf9bb9c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:27.689456 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edb78b-ce82-4f09-b091-b8629bf9bb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:27.690184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edb78b-ce82-4f09-b091-b8629bf9bb9c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:27.699869 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edb78b-ce82-4f09-b091-b8629bf9bb9c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:27.701363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edb78b-ce82-4f09-b091-b8629bf9bb9c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-35edb78b-ce82-4f09-b091-b8629bf9bb9c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:27.721164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:27.722262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:27.723239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:27.723239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:27.723239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:27.723239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:27.723239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:27.723239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:27.723239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:27.723239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:27.723239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:13:27.723239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:27.726450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 330/678] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:13:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:27.727552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edb78b-ce82-4f09-b091-b8629bf9bb9c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:27.769068 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e50944-8f70-46e8-ae6b-6ebed87ff1a3 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:27.805015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8ebde-2a98-46da-b1c4-be78cd37b729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:27.805668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8ebde-2a98-46da-b1c4-be78cd37b729 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:27.805947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8ebde-2a98-46da-b1c4-be78cd37b729 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:27.806225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8ebde-2a98-46da-b1c4-be78cd37b729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:27.807074 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8ebde-2a98-46da-b1c4-be78cd37b729 None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=c5efb606fb1b422182ab91576088c85f) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:27.807384 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8ebde-2a98-46da-b1c4-be78cd37b729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:27.808799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8ebde-2a98-46da-b1c4-be78cd37b729 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:27.814560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 349/679] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:27 2022] GET /identity/v3/role_assignments?user.id=c5efb606fb1b422182ab91576088c85f&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:27.815822 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56c287-73d3-4df9-9b96-57def6857474 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:27.816110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56c287-73d3-4df9-9b96-57def6857474 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:27.816380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56c287-73d3-4df9-9b96-57def6857474 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:27.817769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 350/680] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:27.822677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56c287-73d3-4df9-9b96-57def6857474 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:27.833007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edb78b-ce82-4f09-b091-b8629bf9bb9c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:27.871790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19f606-b22f-4a65-9c27-878e21a95eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:27.872875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19f606-b22f-4a65-9c27-878e21a95eac None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:27.873368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19f606-b22f-4a65-9c27-878e21a95eac None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:27.873820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19f606-b22f-4a65-9c27-878e21a95eac None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:27.874782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19f606-b22f-4a65-9c27-878e21a95eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:27.875278 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19f606-b22f-4a65-9c27-878e21a95eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:27.876895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19f606-b22f-4a65-9c27-878e21a95eac None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:27.890888 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 331/681] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:27.892659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f86d6-fa39-42d9-99ba-80a51fb523ea None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:27.893446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f86d6-fa39-42d9-99ba-80a51fb523ea None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:27.893913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f86d6-fa39-42d9-99ba-80a51fb523ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:27.912976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ab6f86d6-fa39-42d9-99ba-80a51fb523ea None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:27.914619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ab6f86d6-fa39-42d9-99ba-80a51fb523ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:27.936948 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56c287-73d3-4df9-9b96-57def6857474 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:27.975177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f17de7-83b5-4746-90f8-c9e87dcfae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:27.975760 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f17de7-83b5-4746-90f8-c9e87dcfae2a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:27.976040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f17de7-83b5-4746-90f8-c9e87dcfae2a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:27.976314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f17de7-83b5-4746-90f8-c9e87dcfae2a None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:27.977173 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f17de7-83b5-4746-90f8-c9e87dcfae2a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:27.977475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f17de7-83b5-4746-90f8-c9e87dcfae2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:27.978979 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f17de7-83b5-4746-90f8-c9e87dcfae2a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:27.996298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 332/682] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:27.997644 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f86d6-fa39-42d9-99ba-80a51fb523ea None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:28.010239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 351/683] 10.222.0.44 () {56 vars in 1135 bytes} [Thu May 5 15:13:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:28.011350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f17de7-83b5-4746-90f8-c9e87dcfae2a None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:28.128387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f86d6-fa39-42d9-99ba-80a51fb523ea None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:28.135354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f17de7-83b5-4746-90f8-c9e87dcfae2a None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:28.170913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac041ba-ee58-40c0-a736-dec88128d82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:28.171447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97292196-e741-46b5-9146-dba1843253fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:28.171720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac041ba-ee58-40c0-a736-dec88128d82e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:28.172076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac041ba-ee58-40c0-a736-dec88128d82e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:28.172444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac041ba-ee58-40c0-a736-dec88128d82e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:28.173009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97292196-e741-46b5-9146-dba1843253fe None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:28.173515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97292196-e741-46b5-9146-dba1843253fe None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:28.173939 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97292196-e741-46b5-9146-dba1843253fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:28.182472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97292196-e741-46b5-9146-dba1843253fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:28.184479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97292196-e741-46b5-9146-dba1843253fe None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-97292196-e741-46b5-9146-dba1843253fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:28.205208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:28.206469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:28.207553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:28.207553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:28.207553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:28.207553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:28.207553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:28.207553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:28.207553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:28.207553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:28.209964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 333/684] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:28.211008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97292196-e741-46b5-9146-dba1843253fe None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:28.251983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac041ba-ee58-40c0-a736-dec88128d82e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:28.253551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac041ba-ee58-40c0-a736-dec88128d82e None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:28.342740 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97292196-e741-46b5-9146-dba1843253fe None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:28.368317 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 352/685] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:13:28.368317 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac041ba-ee58-40c0-a736-dec88128d82e None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:28.382163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c47a9-6520-49a6-b54f-c13073d502e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:28.383182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c47a9-6520-49a6-b54f-c13073d502e7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:28.383626 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c47a9-6520-49a6-b54f-c13073d502e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:28.384058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c47a9-6520-49a6-b54f-c13073d502e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:28.394834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c47a9-6520-49a6-b54f-c13073d502e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-993c47a9-6520-49a6-b54f-c13073d502e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:28.402793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:28.404280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:28.405151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:28.405151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:28.405151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:28.405151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:28.405151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:28.405151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:28.405151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:28.405151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:28.405151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:28.405151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:28.405151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:28.405151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:28.407830 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 334/686] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:28.409115 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c47a9-6520-49a6-b54f-c13073d502e7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:28.465707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac041ba-ee58-40c0-a736-dec88128d82e None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:28.500643 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c78e2-359f-4238-983a-8a1ed20d825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:28.501314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c78e2-359f-4238-983a-8a1ed20d825b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:28.501651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c78e2-359f-4238-983a-8a1ed20d825b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:28.502023 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c78e2-359f-4238-983a-8a1ed20d825b None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:28.502800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c78e2-359f-4238-983a-8a1ed20d825b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:28.503113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c78e2-359f-4238-983a-8a1ed20d825b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:28.504630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c78e2-359f-4238-983a-8a1ed20d825b None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:28.513537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c47a9-6520-49a6-b54f-c13073d502e7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:28.521721 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 353/687] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:28.522578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c78e2-359f-4238-983a-8a1ed20d825b None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:28.550655 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ccc62-24e4-462e-bc79-7195b9fd35af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:28.551803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ccc62-24e4-462e-bc79-7195b9fd35af None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:28.552299 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ccc62-24e4-462e-bc79-7195b9fd35af None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:28.552787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ccc62-24e4-462e-bc79-7195b9fd35af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:28.564195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ccc62-24e4-462e-bc79-7195b9fd35af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:28.566159 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ccc62-24e4-462e-bc79-7195b9fd35af None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-fc8ccc62-24e4-462e-bc79-7195b9fd35af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:28.583868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:28.584790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:28.585782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:28.585782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:28.585782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:28.585782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:28.592961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 335/688] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:28.594053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ccc62-24e4-462e-bc79-7195b9fd35af None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:28.625646 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c78e2-359f-4238-983a-8a1ed20d825b None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:28.661815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c79c6-97bc-4ca4-bbc5-fbc8ac518588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:28.662526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c79c6-97bc-4ca4-bbc5-fbc8ac518588 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:28.662810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c79c6-97bc-4ca4-bbc5-fbc8ac518588 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:28.663085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c79c6-97bc-4ca4-bbc5-fbc8ac518588 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:28.663831 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c79c6-97bc-4ca4-bbc5-fbc8ac518588 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:28.664136 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c79c6-97bc-4ca4-bbc5-fbc8ac518588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:28.665497 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c79c6-97bc-4ca4-bbc5-fbc8ac518588 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:28.674953 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 354/689] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:28.675843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c79c6-97bc-4ca4-bbc5-fbc8ac518588 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:28.701287 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ccc62-24e4-462e-bc79-7195b9fd35af None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:28.737234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709855af-2e65-4eeb-abfc-932b8fc2d023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:28.738322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709855af-2e65-4eeb-abfc-932b8fc2d023 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:28.738820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709855af-2e65-4eeb-abfc-932b8fc2d023 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:28.739292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709855af-2e65-4eeb-abfc-932b8fc2d023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:28.740327 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709855af-2e65-4eeb-abfc-932b8fc2d023 None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=7fe051e3e2084f89a95a95aa4fd857df) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:28.740842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709855af-2e65-4eeb-abfc-932b8fc2d023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:28.742511 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709855af-2e65-4eeb-abfc-932b8fc2d023 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:28.749070 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 336/690] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:28 2022] GET /identity/v3/role_assignments?user.id=7fe051e3e2084f89a95a95aa4fd857df&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:28.750207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709855af-2e65-4eeb-abfc-932b8fc2d023 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:28.795116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c79c6-97bc-4ca4-bbc5-fbc8ac518588 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:28.834308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a1c28-fbe8-4ed8-9c15-89583a16b9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:28.835146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a1c28-fbe8-4ed8-9c15-89583a16b9dc None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:28.835465 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a1c28-fbe8-4ed8-9c15-89583a16b9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:28.835742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a1c28-fbe8-4ed8-9c15-89583a16b9dc None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:28.836478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a1c28-fbe8-4ed8-9c15-89583a16b9dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:28.836784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a1c28-fbe8-4ed8-9c15-89583a16b9dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:28.838632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a1c28-fbe8-4ed8-9c15-89583a16b9dc None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:28.853416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 355/691] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:28.859484 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a1c28-fbe8-4ed8-9c15-89583a16b9dc None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:28.995274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709855af-2e65-4eeb-abfc-932b8fc2d023 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:29.007951 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a1c28-fbe8-4ed8-9c15-89583a16b9dc None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:29.049940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bef42-fc83-40c2-bb9f-85112947ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:29.050967 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bef42-fc83-40c2-bb9f-85112947ab8e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:29.051254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bef42-fc83-40c2-bb9f-85112947ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:29.051533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bef42-fc83-40c2-bb9f-85112947ab8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:29.058868 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ad74d-f601-46fa-bf7d-743bef1f2e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:29.059665 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ad74d-f601-46fa-bf7d-743bef1f2e41 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:29.059944 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ad74d-f601-46fa-bf7d-743bef1f2e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:29.060936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ad74d-f601-46fa-bf7d-743bef1f2e41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:29.066067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bef42-fc83-40c2-bb9f-85112947ab8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:29.067845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bef42-fc83-40c2-bb9f-85112947ab8e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:29.068341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ad74d-f601-46fa-bf7d-743bef1f2e41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:29.069768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ad74d-f601-46fa-bf7d-743bef1f2e41 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b44bef42-fc83-40c2-bb9f-85112947ab8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:29.086559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:29.087630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:29.089924 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:29.089924 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:29.089924 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:29.089924 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-914ad74d-f601-46fa-bf7d-743bef1f2e41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:29.090208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:29.091228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:29.092901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:29.092901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:29.092901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:29.092901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:29.092901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:29.092901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:29.092901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:29.092901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:29.099870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 337/692] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:29.100028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 356/693] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:29.100168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bef42-fc83-40c2-bb9f-85112947ab8e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:29.102974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ad74d-f601-46fa-bf7d-743bef1f2e41 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:29.218619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bef42-fc83-40c2-bb9f-85112947ab8e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:29.243558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ad74d-f601-46fa-bf7d-743bef1f2e41 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:29.260095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad146d1-7209-477b-bec8-4059f650cb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:29.261136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad146d1-7209-477b-bec8-4059f650cb0e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:29.261693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad146d1-7209-477b-bec8-4059f650cb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:29.261976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad146d1-7209-477b-bec8-4059f650cb0e None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:29.262889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad146d1-7209-477b-bec8-4059f650cb0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:29.263804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad146d1-7209-477b-bec8-4059f650cb0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:29.265687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad146d1-7209-477b-bec8-4059f650cb0e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:29.281342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff90fc-28d0-4ad9-a419-5191377ef706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:29.281734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 338/694] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:29.282054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff90fc-28d0-4ad9-a419-5191377ef706 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:29.282413 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff90fc-28d0-4ad9-a419-5191377ef706 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:29.282731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff90fc-28d0-4ad9-a419-5191377ef706 None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:29.283526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff90fc-28d0-4ad9-a419-5191377ef706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:29.283838 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff90fc-28d0-4ad9-a419-5191377ef706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:29.285280 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff90fc-28d0-4ad9-a419-5191377ef706 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:29.287649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53730e60-6295-4abb-9a29-a837b1834d71 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:29.287943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53730e60-6295-4abb-9a29-a837b1834d71 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:29.288229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53730e60-6295-4abb-9a29-a837b1834d71 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:29.290173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 339/695] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:29.290946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53730e60-6295-4abb-9a29-a837b1834d71 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:29.300020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 357/696] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:29.301586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e299d-01b9-416f-a43e-527b83021d79 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:29.301978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e299d-01b9-416f-a43e-527b83021d79 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:29.302531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e299d-01b9-416f-a43e-527b83021d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:29.318776 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-af0e299d-01b9-416f-a43e-527b83021d79 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:29.320155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-af0e299d-01b9-416f-a43e-527b83021d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:29.389459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 358/697] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:29.390556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e299d-01b9-416f-a43e-527b83021d79 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:29.395739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53730e60-6295-4abb-9a29-a837b1834d71 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:29.434368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1788b-cc28-40ec-9d19-644c780859dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:29.435727 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1788b-cc28-40ec-9d19-644c780859dd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:29.436007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1788b-cc28-40ec-9d19-644c780859dd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:29.436280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1788b-cc28-40ec-9d19-644c780859dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:29.443541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1788b-cc28-40ec-9d19-644c780859dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:29.444977 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1788b-cc28-40ec-9d19-644c780859dd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-40e1788b-cc28-40ec-9d19-644c780859dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:29.461639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:29.464106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:29.467757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:29.467757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:29.467757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:29.467757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:29.467757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:29.467757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:29.467757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:29.467757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:29.467757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:13:29.467757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:29.467757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 340/698] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 5 15:13:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:29.467757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1788b-cc28-40ec-9d19-644c780859dd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:29.494187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e299d-01b9-416f-a43e-527b83021d79 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:29.529133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23ea80-e8fb-4b99-955b-82762888c290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:29.529719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23ea80-e8fb-4b99-955b-82762888c290 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:29.530004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23ea80-e8fb-4b99-955b-82762888c290 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:29.530266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23ea80-e8fb-4b99-955b-82762888c290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:29.531132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23ea80-e8fb-4b99-955b-82762888c290 None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=27e0b470f6b84df38565abf006dd8ba1) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:29.531444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23ea80-e8fb-4b99-955b-82762888c290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:29.533044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23ea80-e8fb-4b99-955b-82762888c290 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:29.539698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 359/699] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:29 2022] GET /identity/v3/role_assignments?user.id=27e0b470f6b84df38565abf006dd8ba1&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:29.540507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23ea80-e8fb-4b99-955b-82762888c290 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:29.573651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1788b-cc28-40ec-9d19-644c780859dd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:29.610552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140af7cc-4355-4818-be4d-acd27d3cd959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:29.611360 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af7cc-4355-4818-be4d-acd27d3cd959 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:29.611735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af7cc-4355-4818-be4d-acd27d3cd959 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:29.611899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af7cc-4355-4818-be4d-acd27d3cd959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:29.624166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140af7cc-4355-4818-be4d-acd27d3cd959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:29.625652 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140af7cc-4355-4818-be4d-acd27d3cd959 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-140af7cc-4355-4818-be4d-acd27d3cd959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:29.643651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:29.645545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:29.646702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:29.646702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:29.646702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:29.646702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:29.646702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 341/700] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:29.647127 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23ea80-e8fb-4b99-955b-82762888c290 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:29.650916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140af7cc-4355-4818-be4d-acd27d3cd959 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:29.684658 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15096b1f-4010-43c7-a6c5-2de57e9566d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:29.685951 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15096b1f-4010-43c7-a6c5-2de57e9566d0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:29.686383 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15096b1f-4010-43c7-a6c5-2de57e9566d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:29.686597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15096b1f-4010-43c7-a6c5-2de57e9566d0 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:29.687439 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15096b1f-4010-43c7-a6c5-2de57e9566d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:29.687745 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15096b1f-4010-43c7-a6c5-2de57e9566d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:29.689162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15096b1f-4010-43c7-a6c5-2de57e9566d0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:29.708586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 360/701] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 5 15:13:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:29.726878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15096b1f-4010-43c7-a6c5-2de57e9566d0 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:29.778894 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140af7cc-4355-4818-be4d-acd27d3cd959 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:29.819793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9976433-96f2-4f3a-9a6e-bcc4ad095966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:29.820501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9976433-96f2-4f3a-9a6e-bcc4ad095966 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:29.820849 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9976433-96f2-4f3a-9a6e-bcc4ad095966 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:29.821248 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9976433-96f2-4f3a-9a6e-bcc4ad095966 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:29.822150 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9976433-96f2-4f3a-9a6e-bcc4ad095966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:29.822574 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9976433-96f2-4f3a-9a6e-bcc4ad095966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:29.824242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9976433-96f2-4f3a-9a6e-bcc4ad095966 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:29.839497 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 342/702] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:29.847682 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9976433-96f2-4f3a-9a6e-bcc4ad095966 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:29.912268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15096b1f-4010-43c7-a6c5-2de57e9566d0 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:29.947752 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756c777-7bcc-434f-9d88-1689e1e4daf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:29.948417 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756c777-7bcc-434f-9d88-1689e1e4daf2 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:29.948699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756c777-7bcc-434f-9d88-1689e1e4daf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:29.948975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756c777-7bcc-434f-9d88-1689e1e4daf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:29.972803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9976433-96f2-4f3a-9a6e-bcc4ad095966 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:30.018792 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf33b-a3b3-40e3-8dcf-e7196385d7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:30.019481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf33b-a3b3-40e3-8dcf-e7196385d7b8 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:30.019765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf33b-a3b3-40e3-8dcf-e7196385d7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:30.020042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf33b-a3b3-40e3-8dcf-e7196385d7b8 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:30.020753 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bf33b-a3b3-40e3-8dcf-e7196385d7b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:30.022194 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bf33b-a3b3-40e3-8dcf-e7196385d7b8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:30.031375 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756c777-7bcc-434f-9d88-1689e1e4daf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:30.032883 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756c777-7bcc-434f-9d88-1689e1e4daf2 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:30.121057 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 343/703] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:13:29 2022] POST /identity/v3/users => generated 254 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:30.148863 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 361/704] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:13:30.154766 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf33b-a3b3-40e3-8dcf-e7196385d7b8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:30.285470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf33b-a3b3-40e3-8dcf-e7196385d7b8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:30.335035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed0f09-ac06-49a5-a890-19bb5b06df97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:30.335847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed0f09-ac06-49a5-a890-19bb5b06df97 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:30.336128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed0f09-ac06-49a5-a890-19bb5b06df97 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:30.336400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed0f09-ac06-49a5-a890-19bb5b06df97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:30.347785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed0f09-ac06-49a5-a890-19bb5b06df97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:30.349238 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed0f09-ac06-49a5-a890-19bb5b06df97 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-feed0f09-ac06-49a5-a890-19bb5b06df97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:30.367459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:30.369537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:30.371809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:30.371809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:30.371809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:30.371809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:30.371809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 344/705] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:30.379395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756c777-7bcc-434f-9d88-1689e1e4daf2 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:30.455790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2af14-a514-4691-9fb1-f31a52ef347b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:30.456144 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2af14-a514-4691-9fb1-f31a52ef347b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:30.456408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2af14-a514-4691-9fb1-f31a52ef347b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:30.458164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 345/706] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:30.463039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deed70-e9b7-4c9e-ac36-a7009914fdf3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:30.463850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deed70-e9b7-4c9e-ac36-a7009914fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:30.464241 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deed70-e9b7-4c9e-ac36-a7009914fdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:30.484951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-09deed70-e9b7-4c9e-ac36-a7009914fdf3 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:30.486154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-09deed70-e9b7-4c9e-ac36-a7009914fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:30.492236 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756c777-7bcc-434f-9d88-1689e1e4daf2 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:30.526504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd991ba-8ad4-4854-8a24-f1b71b4adb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:30.527176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd991ba-8ad4-4854-8a24-f1b71b4adb6d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:30.527461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd991ba-8ad4-4854-8a24-f1b71b4adb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:30.527740 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd991ba-8ad4-4854-8a24-f1b71b4adb6d None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:30.528461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd991ba-8ad4-4854-8a24-f1b71b4adb6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:30.529385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd991ba-8ad4-4854-8a24-f1b71b4adb6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:30.530790 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd991ba-8ad4-4854-8a24-f1b71b4adb6d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:30.543260 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 362/707] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:30.549290 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd991ba-8ad4-4854-8a24-f1b71b4adb6d None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:30.566389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 346/708] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:30.585110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deed70-e9b7-4c9e-ac36-a7009914fdf3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:30.670060 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd991ba-8ad4-4854-8a24-f1b71b4adb6d None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:30.702379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deed70-e9b7-4c9e-ac36-a7009914fdf3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:30.706271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94583289-0714-45b9-8e9f-f78157a20499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:30.707339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94583289-0714-45b9-8e9f-f78157a20499 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:30.707819 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94583289-0714-45b9-8e9f-f78157a20499 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:30.708302 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94583289-0714-45b9-8e9f-f78157a20499 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:30.715816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94583289-0714-45b9-8e9f-f78157a20499 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:30.718335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94583289-0714-45b9-8e9f-f78157a20499 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-94583289-0714-45b9-8e9f-f78157a20499 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:30.733641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:30.734590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:30.735467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:30.735467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:30.735467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:30.735467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:30.735467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:30.735467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:30.735467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:30.735467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:30.742331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0a654-56a7-47ea-90cc-6a9ca279fdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:30.742331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0a654-56a7-47ea-90cc-6a9ca279fdba None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:30.742331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0a654-56a7-47ea-90cc-6a9ca279fdba None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:30.742331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0a654-56a7-47ea-90cc-6a9ca279fdba None admin] PATH_INFO: `/v3/services/network` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:30.742693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0a654-56a7-47ea-90cc-6a9ca279fdba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:30.742961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0a654-56a7-47ea-90cc-6a9ca279fdba None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:30.743151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 363/709] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:30.744896 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94583289-0714-45b9-8e9f-f78157a20499 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-93a0a654-56a7-47ea-90cc-6a9ca279fdba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:30.760139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:30.761223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:30.762886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 347/710] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:30 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:30.768244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0a654-56a7-47ea-90cc-6a9ca279fdba None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:30.873584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0a654-56a7-47ea-90cc-6a9ca279fdba None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:30.908700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70724d3-20c7-49b4-8e3a-3d72ee4092cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:30.909385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70724d3-20c7-49b4-8e3a-3d72ee4092cd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:30.909669 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70724d3-20c7-49b4-8e3a-3d72ee4092cd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:30.909945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70724d3-20c7-49b4-8e3a-3d72ee4092cd None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:30.910762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70724d3-20c7-49b4-8e3a-3d72ee4092cd None admin] RBAC: Adding query filter params (name=network) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:30.911086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70724d3-20c7-49b4-8e3a-3d72ee4092cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:30.912721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70724d3-20c7-49b4-8e3a-3d72ee4092cd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:30.917165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94583289-0714-45b9-8e9f-f78157a20499 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:30.917568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 348/711] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 5 15:13:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:30.923856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70724d3-20c7-49b4-8e3a-3d72ee4092cd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:30.974117 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf98395-f352-4996-b19b-4d316b740a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:30.974872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf98395-f352-4996-b19b-4d316b740a11 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:30.975155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf98395-f352-4996-b19b-4d316b740a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:30.975424 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf98395-f352-4996-b19b-4d316b740a11 None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:30.976216 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf98395-f352-4996-b19b-4d316b740a11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:30.976521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf98395-f352-4996-b19b-4d316b740a11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:30.977939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf98395-f352-4996-b19b-4d316b740a11 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:31.000620 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 364/712] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:31.006490 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf98395-f352-4996-b19b-4d316b740a11 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:31.026201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70724d3-20c7-49b4-8e3a-3d72ee4092cd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:31.065213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d6d13-7003-47d2-a5e8-b347440702ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:31.065891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d6d13-7003-47d2-a5e8-b347440702ce None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:31.066174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d6d13-7003-47d2-a5e8-b347440702ce None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:31.066480 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d6d13-7003-47d2-a5e8-b347440702ce None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:31.067194 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d6d13-7003-47d2-a5e8-b347440702ce None admin] RBAC: Adding query filter params (type=network) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:31.067501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d6d13-7003-47d2-a5e8-b347440702ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:31.068880 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d6d13-7003-47d2-a5e8-b347440702ce None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:31.074909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 349/713] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 5 15:13:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:31.121189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf98395-f352-4996-b19b-4d316b740a11 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:31.160350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0cda0-f358-48e1-90bb-ad55e27c447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:31.161021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0cda0-f358-48e1-90bb-ad55e27c447d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:31.161560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0cda0-f358-48e1-90bb-ad55e27c447d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:31.161838 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0cda0-f358-48e1-90bb-ad55e27c447d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:31.166208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0cda0-f358-48e1-90bb-ad55e27c447d None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=eb4ff6ba4e17477d8787eaf1955bd1da) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:31.166208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0cda0-f358-48e1-90bb-ad55e27c447d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:31.166208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0cda0-f358-48e1-90bb-ad55e27c447d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:31.174947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 365/714] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:31 2022] GET /identity/v3/role_assignments?user.id=eb4ff6ba4e17477d8787eaf1955bd1da&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:31.496324 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33e133-8260-49a8-8364-3d69ba84b490 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:31.497008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33e133-8260-49a8-8364-3d69ba84b490 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:31.498025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33e133-8260-49a8-8364-3d69ba84b490 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:31.499968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 350/715] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:31.504839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fe3e9-121e-4a8f-9821-61fef377247f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:31.505360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fe3e9-121e-4a8f-9821-61fef377247f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:31.505855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fe3e9-121e-4a8f-9821-61fef377247f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:31.531384 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-132fe3e9-121e-4a8f-9821-61fef377247f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:31.532988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-132fe3e9-121e-4a8f-9821-61fef377247f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:31.614600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 366/716] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:31.643569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33e133-8260-49a8-8364-3d69ba84b490 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:31.798720 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33e133-8260-49a8-8364-3d69ba84b490 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:31.840042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c1b54-d587-48bc-9de2-6a5357a389f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:31.840856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c1b54-d587-48bc-9de2-6a5357a389f0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:31.841177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c1b54-d587-48bc-9de2-6a5357a389f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:31.841513 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c1b54-d587-48bc-9de2-6a5357a389f0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:31.842243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c1b54-d587-48bc-9de2-6a5357a389f0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:31.843729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c1b54-d587-48bc-9de2-6a5357a389f0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-d90c1b54-d587-48bc-9de2-6a5357a389f0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:31.861911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:31.862981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:13:31.863826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:31.866380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 351/717] 10.222.0.44 () {56 vars in 1129 bytes} [Thu May 5 15:13:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:31.868932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fe3e9-121e-4a8f-9821-61fef377247f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:31.994675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fe3e9-121e-4a8f-9821-61fef377247f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:32.040402 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9408a-c6e7-45c7-a005-0e10ce0c02e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:32.041007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9408a-c6e7-45c7-a005-0e10ce0c02e0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:32.041291 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9408a-c6e7-45c7-a005-0e10ce0c02e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:32.041567 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9408a-c6e7-45c7-a005-0e10ce0c02e0 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:32.042302 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9408a-c6e7-45c7-a005-0e10ce0c02e0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:32.042616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9408a-c6e7-45c7-a005-0e10ce0c02e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:32.043977 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9408a-c6e7-45c7-a005-0e10ce0c02e0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:32.054522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 367/718] 10.222.0.44 () {56 vars in 1124 bytes} [Thu May 5 15:13:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:32.060009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c1b54-d587-48bc-9de2-6a5357a389f0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:32.202364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c1b54-d587-48bc-9de2-6a5357a389f0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:32.250107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4487e5-025a-4155-a828-cfbf3ab714f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:32.250824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4487e5-025a-4155-a828-cfbf3ab714f3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:32.251108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4487e5-025a-4155-a828-cfbf3ab714f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:32.251390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4487e5-025a-4155-a828-cfbf3ab714f3 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:32.252110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4487e5-025a-4155-a828-cfbf3ab714f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:32.252418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4487e5-025a-4155-a828-cfbf3ab714f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:32.253879 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4487e5-025a-4155-a828-cfbf3ab714f3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:32.262253 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 352/719] 10.222.0.44 () {56 vars in 1124 bytes} [Thu May 5 15:13:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:32.723218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347c384-6790-41c3-9cc8-0c62d08a1861 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:32.723912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347c384-6790-41c3-9cc8-0c62d08a1861 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:32.723912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347c384-6790-41c3-9cc8-0c62d08a1861 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:32.725379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 368/720] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:32.731169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b64146-1f21-42cb-83d8-47b20723e694 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:32.731169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b64146-1f21-42cb-83d8-47b20723e694 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:32.731169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b64146-1f21-42cb-83d8-47b20723e694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:32.758891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c4b64146-1f21-42cb-83d8-47b20723e694 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:32.760778 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c4b64146-1f21-42cb-83d8-47b20723e694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:32.860563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 353/721] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:13:32.907783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347c384-6790-41c3-9cc8-0c62d08a1861 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:33.057725 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347c384-6790-41c3-9cc8-0c62d08a1861 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:33.103888 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c063-bedb-4bc4-985a-dcc08f98f09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:33.104693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c063-bedb-4bc4-985a-dcc08f98f09b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:33.104975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c063-bedb-4bc4-985a-dcc08f98f09b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:33.105246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c063-bedb-4bc4-985a-dcc08f98f09b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:33.124192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701c063-bedb-4bc4-985a-dcc08f98f09b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-e701c063-bedb-4bc4-985a-dcc08f98f09b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:33.132102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:33.133011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:33.133961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:33.133961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:33.133961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:33.133961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:33.133961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:33.133961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:33.133961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:33.133961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:33.133961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:33.133961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:33.133961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:33.133961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:33.138713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 369/722] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:33.143381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b64146-1f21-42cb-83d8-47b20723e694 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:33.306963 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b64146-1f21-42cb-83d8-47b20723e694 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:33.356096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b756af2-d942-499c-afca-f692ded307b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:33.356699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b756af2-d942-499c-afca-f692ded307b6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:33.357569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b756af2-d942-499c-afca-f692ded307b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:33.358438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b756af2-d942-499c-afca-f692ded307b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:33.359197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b756af2-d942-499c-afca-f692ded307b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:33.359511 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b756af2-d942-499c-afca-f692ded307b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:33.360892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b756af2-d942-499c-afca-f692ded307b6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:33.375231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 354/723] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:13:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:33.382218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c063-bedb-4bc4-985a-dcc08f98f09b None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:33.408752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f50ff9-2985-4138-a53b-dcf6eee81c5f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:33.409203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f50ff9-2985-4138-a53b-dcf6eee81c5f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:33.409587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f50ff9-2985-4138-a53b-dcf6eee81c5f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:33.411706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 355/724] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:13:33.416773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f532b8-517b-4f92-bbb8-5cb042ba36f3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:33.417163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f532b8-517b-4f92-bbb8-5cb042ba36f3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:33.417572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f532b8-517b-4f92-bbb8-5cb042ba36f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:33.435554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e8f532b8-517b-4f92-bbb8-5cb042ba36f3 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:33.436991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e8f532b8-517b-4f92-bbb8-5cb042ba36f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:33.538235 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 356/725] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:13:33.571389 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c063-bedb-4bc4-985a-dcc08f98f09b None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:33.602824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f532b8-517b-4f92-bbb8-5cb042ba36f3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:33.611591 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beec4bc-e4f4-4057-a9d5-7c95e78fdf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:33.612155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beec4bc-e4f4-4057-a9d5-7c95e78fdf76 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:33.612441 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beec4bc-e4f4-4057-a9d5-7c95e78fdf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:33.612723 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beec4bc-e4f4-4057-a9d5-7c95e78fdf76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:33.624732 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beec4bc-e4f4-4057-a9d5-7c95e78fdf76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:33.626210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beec4bc-e4f4-4057-a9d5-7c95e78fdf76 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-0beec4bc-e4f4-4057-a9d5-7c95e78fdf76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:33.645119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:33.646099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:33.647443 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:33.647443 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:33.647443 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:33.647443 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:33.647443 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 370/726] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:33.652066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beec4bc-e4f4-4057-a9d5-7c95e78fdf76 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:33.777393 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beec4bc-e4f4-4057-a9d5-7c95e78fdf76 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:33.819637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe01869-dc36-4992-8ee6-f064ff484482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:33.820634 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe01869-dc36-4992-8ee6-f064ff484482 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:33.821091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe01869-dc36-4992-8ee6-f064ff484482 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:33.821523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe01869-dc36-4992-8ee6-f064ff484482 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:33.822513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe01869-dc36-4992-8ee6-f064ff484482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:33.823011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe01869-dc36-4992-8ee6-f064ff484482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:33.825314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe01869-dc36-4992-8ee6-f064ff484482 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:33.840723 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 371/727] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:33.847453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe01869-dc36-4992-8ee6-f064ff484482 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:33.863131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f532b8-517b-4f92-bbb8-5cb042ba36f3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:33.963003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944d223-19da-4b9f-810a-049036c1c46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:33.963834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d223-19da-4b9f-810a-049036c1c46d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:33.964119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d223-19da-4b9f-810a-049036c1c46d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:33.964401 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d223-19da-4b9f-810a-049036c1c46d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:33.977459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe01869-dc36-4992-8ee6-f064ff484482 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:33.988421 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944d223-19da-4b9f-810a-049036c1c46d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9944d223-19da-4b9f-810a-049036c1c46d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:34.004850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:34.006092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:34.007163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:34.007163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:34.007163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:34.007163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:34.007163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:34.007163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:34.007163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:34.007163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:34.007163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:34.007163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:34.007163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:34.007163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:34.007163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 357/728] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:34.012328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944d223-19da-4b9f-810a-049036c1c46d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:34.023329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44330bf8-0343-499c-bc32-c94115df4324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:34.024408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44330bf8-0343-499c-bc32-c94115df4324 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:34.024845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44330bf8-0343-499c-bc32-c94115df4324 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:34.025272 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44330bf8-0343-499c-bc32-c94115df4324 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:34.034147 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44330bf8-0343-499c-bc32-c94115df4324 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:34.035880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44330bf8-0343-499c-bc32-c94115df4324 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-44330bf8-0343-499c-bc32-c94115df4324 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:34.051323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:34.052433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:34.053427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:34.053427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:34.053427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:34.053427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:34.053427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:34.053427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:34.053427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:34.053427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:34.053427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:13:34.053427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:34.055557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 372/729] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:13:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:34.061332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86be7f-a22d-4e7a-8b44-7a9e71183df5 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:34.061842 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86be7f-a22d-4e7a-8b44-7a9e71183df5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:34.062304 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86be7f-a22d-4e7a-8b44-7a9e71183df5 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:34.064202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 373/730] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:34.065086 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86be7f-a22d-4e7a-8b44-7a9e71183df5 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:34.131995 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944d223-19da-4b9f-810a-049036c1c46d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:34.167036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242e199-b33f-4fc9-af03-50ccc2b5813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:34.167877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242e199-b33f-4fc9-af03-50ccc2b5813c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:34.168180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242e199-b33f-4fc9-af03-50ccc2b5813c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:34.168442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242e199-b33f-4fc9-af03-50ccc2b5813c None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:34.169184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242e199-b33f-4fc9-af03-50ccc2b5813c None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:34.170005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242e199-b33f-4fc9-af03-50ccc2b5813c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:34.170706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86be7f-a22d-4e7a-8b44-7a9e71183df5 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:34.171408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242e199-b33f-4fc9-af03-50ccc2b5813c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:34.184365 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 358/731] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:34.186171 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42c0b-d6e7-49fe-9bda-e15cd5689a40 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:34.186483 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42c0b-d6e7-49fe-9bda-e15cd5689a40 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:34.186762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42c0b-d6e7-49fe-9bda-e15cd5689a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:34.204084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-aed42c0b-d6e7-49fe-9bda-e15cd5689a40 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:34.205280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aed42c0b-d6e7-49fe-9bda-e15cd5689a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:34.206978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c11c6b-e5dc-4086-a48c-c425e4ec4a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:34.207852 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c11c6b-e5dc-4086-a48c-c425e4ec4a21 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:34.208137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c11c6b-e5dc-4086-a48c-c425e4ec4a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:34.208419 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c11c6b-e5dc-4086-a48c-c425e4ec4a21 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:34.209263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c11c6b-e5dc-4086-a48c-c425e4ec4a21 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:34.209575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c11c6b-e5dc-4086-a48c-c425e4ec4a21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:34.211043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c11c6b-e5dc-4086-a48c-c425e4ec4a21 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:34.233701 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 374/732] 10.222.0.44 () {56 vars in 1135 bytes} [Thu May 5 15:13:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:34.233701 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c11c6b-e5dc-4086-a48c-c425e4ec4a21 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:34.277415 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 359/733] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:34.278715 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7248f57-832d-452e-8e76-ac423932c45b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:34.279098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7248f57-832d-452e-8e76-ac423932c45b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:34.279416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7248f57-832d-452e-8e76-ac423932c45b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:34.280816 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 360/734] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:34.281380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7248f57-832d-452e-8e76-ac423932c45b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:34.335508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c11c6b-e5dc-4086-a48c-c425e4ec4a21 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:34.369833 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2ca3e-f200-4494-bf03-6724c5a6b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:34.370741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2ca3e-f200-4494-bf03-6724c5a6b866 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:34.371021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2ca3e-f200-4494-bf03-6724c5a6b866 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:34.371332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2ca3e-f200-4494-bf03-6724c5a6b866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:34.381955 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2ca3e-f200-4494-bf03-6724c5a6b866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:34.383426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2ca3e-f200-4494-bf03-6724c5a6b866 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:34.391069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7248f57-832d-452e-8e76-ac423932c45b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-04d2ca3e-f200-4494-bf03-6724c5a6b866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:34.401840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:34.402839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:34.404307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:34.404307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:34.404307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:34.404307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:34.404599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 375/735] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:34.405752 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d24ee-7921-4389-aff8-eccfefc6840f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:34.406041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d24ee-7921-4389-aff8-eccfefc6840f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:34.406452 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d24ee-7921-4389-aff8-eccfefc6840f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:34.423867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-543d24ee-7921-4389-aff8-eccfefc6840f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:34.425061 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-543d24ee-7921-4389-aff8-eccfefc6840f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:34.433101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7946e-b18b-4643-97d8-4a5352786522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:34.433756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7946e-b18b-4643-97d8-4a5352786522 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:34.434034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7946e-b18b-4643-97d8-4a5352786522 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:34.434594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7946e-b18b-4643-97d8-4a5352786522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:34.506315 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 376/736] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:34.506315 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d24ee-7921-4389-aff8-eccfefc6840f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:34.606614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d24ee-7921-4389-aff8-eccfefc6840f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:34.623974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7946e-b18b-4643-97d8-4a5352786522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:34.625435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7946e-b18b-4643-97d8-4a5352786522 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:34.643115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa597cf-658b-4584-8b2d-846412d768d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:34.643863 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa597cf-658b-4584-8b2d-846412d768d8 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:34.644146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa597cf-658b-4584-8b2d-846412d768d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:34.644419 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa597cf-658b-4584-8b2d-846412d768d8 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:34.645148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa597cf-658b-4584-8b2d-846412d768d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:34.646602 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa597cf-658b-4584-8b2d-846412d768d8 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:34.722216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 361/737] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:13:34.722913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7946e-b18b-4643-97d8-4a5352786522 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:34.778551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 377/738] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:13:34 2022] POST /identity/v3/services => generated 240 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:34.778551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa597cf-658b-4584-8b2d-846412d768d8 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:34.858743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7946e-b18b-4643-97d8-4a5352786522 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:34.886650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa597cf-658b-4584-8b2d-846412d768d8 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:34.904536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9aabe-9774-43be-b873-ea8445127b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:34.905323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9aabe-9774-43be-b873-ea8445127b9b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:34.905607 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9aabe-9774-43be-b873-ea8445127b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:34.905881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9aabe-9774-43be-b873-ea8445127b9b None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:34.906707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9aabe-9774-43be-b873-ea8445127b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:34.907017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9aabe-9774-43be-b873-ea8445127b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:34.908443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9aabe-9774-43be-b873-ea8445127b9b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:34.921804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 362/739] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:34.922767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9aabe-9774-43be-b873-ea8445127b9b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:34.932055 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad5914-34bb-4cd0-9561-169e5b9b57ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:34.932938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad5914-34bb-4cd0-9561-169e5b9b57ba None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:34.933231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad5914-34bb-4cd0-9561-169e5b9b57ba None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:34.933512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad5914-34bb-4cd0-9561-169e5b9b57ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:34.945859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad5914-34bb-4cd0-9561-169e5b9b57ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-30ad5914-34bb-4cd0-9561-169e5b9b57ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:34.954586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:34.957049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 378/740] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:13:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:34.959114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad5914-34bb-4cd0-9561-169e5b9b57ba None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:35.041061 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9aabe-9774-43be-b873-ea8445127b9b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:35.067680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad5914-34bb-4cd0-9561-169e5b9b57ba None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:35.077801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c0aca-c48e-4af3-8d5b-6e46b262bd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:35.078654 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c0aca-c48e-4af3-8d5b-6e46b262bd58 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:35.078942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c0aca-c48e-4af3-8d5b-6e46b262bd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:35.079224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c0aca-c48e-4af3-8d5b-6e46b262bd58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:35.089962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c0aca-c48e-4af3-8d5b-6e46b262bd58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:35.092103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c0aca-c48e-4af3-8d5b-6e46b262bd58 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:35.101833 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0421d6-5979-4468-b724-fc6fada9a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:35.102685 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0421d6-5979-4468-b724-fc6fada9a8aa None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:35.102968 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0421d6-5979-4468-b724-fc6fada9a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:35.103244 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0421d6-5979-4468-b724-fc6fada9a8aa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-889c0aca-c48e-4af3-8d5b-6e46b262bd58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:35.110255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:35.111187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:35.112685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:35.112685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:35.112685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:35.112685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:35.112685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 363/741] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:35.112967 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0421d6-5979-4468-b724-fc6fada9a8aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:35.113038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c0aca-c48e-4af3-8d5b-6e46b262bd58 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:35.114301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0421d6-5979-4468-b724-fc6fada9a8aa None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-dc0421d6-5979-4468-b724-fc6fada9a8aa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:35.133905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:35.135115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:35.136342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:35.136342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:35.136342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:35.136342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:35.136342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:35.136342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:35.136342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:35.136342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:35.136342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:13:35.136342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:35.136342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 379/742] 10.222.0.44 () {56 vars in 1117 bytes} [Thu May 5 15:13:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:35.136342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0421d6-5979-4468-b724-fc6fada9a8aa None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:35.234368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c0aca-c48e-4af3-8d5b-6e46b262bd58 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:35.241173 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0421d6-5979-4468-b724-fc6fada9a8aa None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:35.271199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e5adf-fc8c-49c6-9bf5-9bb91844cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:35.271863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e5adf-fc8c-49c6-9bf5-9bb91844cf8c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:35.272162 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e5adf-fc8c-49c6-9bf5-9bb91844cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:35.272414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e5adf-fc8c-49c6-9bf5-9bb91844cf8c None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:35.273171 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e5adf-fc8c-49c6-9bf5-9bb91844cf8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:35.273448 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e5adf-fc8c-49c6-9bf5-9bb91844cf8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:35.274846 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e5adf-fc8c-49c6-9bf5-9bb91844cf8c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:35.275692 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cb78e-6ad7-4722-baf8-b9ecede64752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:35.276359 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb78e-6ad7-4722-baf8-b9ecede64752 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:35.276635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb78e-6ad7-4722-baf8-b9ecede64752 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:35.276917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb78e-6ad7-4722-baf8-b9ecede64752 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:35.277629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cb78e-6ad7-4722-baf8-b9ecede64752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:35.277936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cb78e-6ad7-4722-baf8-b9ecede64752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:35.280092 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cb78e-6ad7-4722-baf8-b9ecede64752 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:35.289143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 364/743] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:35.289143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e5adf-fc8c-49c6-9bf5-9bb91844cf8c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:35.292680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 380/744] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:35.293983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b331ae-1d3d-44b5-a3b8-5cb18ef58406 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:35.295230 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b331ae-1d3d-44b5-a3b8-5cb18ef58406 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:35.295709 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b331ae-1d3d-44b5-a3b8-5cb18ef58406 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:35.297073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 381/745] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:35.298891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b331ae-1d3d-44b5-a3b8-5cb18ef58406 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:35.393313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e5adf-fc8c-49c6-9bf5-9bb91844cf8c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:35.409422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b331ae-1d3d-44b5-a3b8-5cb18ef58406 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:35.427831 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc8392-d6fb-438a-bcb9-e9bd5809a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:35.428500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc8392-d6fb-438a-bcb9-e9bd5809a9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:35.428783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc8392-d6fb-438a-bcb9-e9bd5809a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:35.429059 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc8392-d6fb-438a-bcb9-e9bd5809a9c2 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:35.429885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc8392-d6fb-438a-bcb9-e9bd5809a9c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:35.430196 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc8392-d6fb-438a-bcb9-e9bd5809a9c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:35.431744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc8392-d6fb-438a-bcb9-e9bd5809a9c2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:35.448289 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf2c5f-61fc-4c05-9502-49670be691cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:35.453954 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 365/746] 10.222.0.44 () {56 vars in 1149 bytes} [Thu May 5 15:13:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:35.454094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf2c5f-61fc-4c05-9502-49670be691cb None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:35.454094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf2c5f-61fc-4c05-9502-49670be691cb None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:35.454094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf2c5f-61fc-4c05-9502-49670be691cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:35.454316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc8392-d6fb-438a-bcb9-e9bd5809a9c2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:35.464206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf2c5f-61fc-4c05-9502-49670be691cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:35.465640 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf2c5f-61fc-4c05-9502-49670be691cb None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-7abf2c5f-61fc-4c05-9502-49670be691cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:35.483798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:35.484915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:35.485908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:35.485908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:35.485908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:35.485908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:35.485908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 382/747] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:35.486889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea704e8-de8a-420f-a21e-b243de51e560 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:35.487171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea704e8-de8a-420f-a21e-b243de51e560 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:35.487446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea704e8-de8a-420f-a21e-b243de51e560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:35.504286 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-1ea704e8-de8a-420f-a21e-b243de51e560 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:35.505461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1ea704e8-de8a-420f-a21e-b243de51e560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:35.556630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc8392-d6fb-438a-bcb9-e9bd5809a9c2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:35.571997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 383/748] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:35 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:13:35.573073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea704e8-de8a-420f-a21e-b243de51e560 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:35.600336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac948d-da4b-4d3b-a6d6-a4b80da296c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:35.601147 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac948d-da4b-4d3b-a6d6-a4b80da296c1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:35.601417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac948d-da4b-4d3b-a6d6-a4b80da296c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:35.601689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac948d-da4b-4d3b-a6d6-a4b80da296c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:35.609124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac948d-da4b-4d3b-a6d6-a4b80da296c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:35.610625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac948d-da4b-4d3b-a6d6-a4b80da296c1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-47ac948d-da4b-4d3b-a6d6-a4b80da296c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:35.624873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:35.625829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:35.626865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:35.626865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:35.626865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:35.626865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:35.626865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:35.626865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:35.626865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:35.626865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:35.626865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 366/749] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:35.626865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac948d-da4b-4d3b-a6d6-a4b80da296c1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:35.689179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea704e8-de8a-420f-a21e-b243de51e560 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:35.723895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a8ab-4208-42eb-94cf-294df0e106e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:35.724558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a8ab-4208-42eb-94cf-294df0e106e4 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:35.724845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a8ab-4208-42eb-94cf-294df0e106e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:35.724943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac948d-da4b-4d3b-a6d6-a4b80da296c1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:35.725163 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a8ab-4208-42eb-94cf-294df0e106e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:35.763681 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfec3b-0deb-4189-9435-f293a55c6381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:35.764352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfec3b-0deb-4189-9435-f293a55c6381 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:35.764634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfec3b-0deb-4189-9435-f293a55c6381 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:35.764907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfec3b-0deb-4189-9435-f293a55c6381 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:35.765625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfec3b-0deb-4189-9435-f293a55c6381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:35.765927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfec3b-0deb-4189-9435-f293a55c6381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:35.767320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfec3b-0deb-4189-9435-f293a55c6381 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:35.779561 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 367/750] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:35.780370 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfec3b-0deb-4189-9435-f293a55c6381 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:35.807283 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777a8ab-4208-42eb-94cf-294df0e106e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:35.808789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777a8ab-4208-42eb-94cf-294df0e106e4 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:35.877620 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfec3b-0deb-4189-9435-f293a55c6381 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:35.908489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 384/751] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:35 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:13:35.909358 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a8ab-4208-42eb-94cf-294df0e106e4 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:35.915925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cc510-3be5-4a68-ac3c-be8be3fa338f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:35.916591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cc510-3be5-4a68-ac3c-be8be3fa338f None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:35.916869 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cc510-3be5-4a68-ac3c-be8be3fa338f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:35.917141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cc510-3be5-4a68-ac3c-be8be3fa338f None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:35.917849 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cc510-3be5-4a68-ac3c-be8be3fa338f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:35.919902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cc510-3be5-4a68-ac3c-be8be3fa338f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:36.004522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 368/752] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:13:35 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:36.005341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a8ab-4208-42eb-94cf-294df0e106e4 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:36.006012 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cc510-3be5-4a68-ac3c-be8be3fa338f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:36.054405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb6f3c-056a-42f2-94ac-b72426726d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:36.054977 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb6f3c-056a-42f2-94ac-b72426726d06 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:36.055264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb6f3c-056a-42f2-94ac-b72426726d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:36.055542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb6f3c-056a-42f2-94ac-b72426726d06 None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:36.056353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb6f3c-056a-42f2-94ac-b72426726d06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:36.056704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb6f3c-056a-42f2-94ac-b72426726d06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:36.059157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb6f3c-056a-42f2-94ac-b72426726d06 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:36.075284 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 385/753] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:36.077060 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb6f3c-056a-42f2-94ac-b72426726d06 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:36.133363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cc510-3be5-4a68-ac3c-be8be3fa338f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:36.171558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba9d31-c113-4752-bf2d-27469145c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:36.172318 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba9d31-c113-4752-bf2d-27469145c810 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:36.172649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba9d31-c113-4752-bf2d-27469145c810 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:36.172933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba9d31-c113-4752-bf2d-27469145c810 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:36.182327 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba9d31-c113-4752-bf2d-27469145c810 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:36.183834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba9d31-c113-4752-bf2d-27469145c810 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-98ba9d31-c113-4752-bf2d-27469145c810 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:36.199022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:36.200027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:36.201696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:36.201696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:36.201696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:36.201696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:36.201696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:36.201696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:36.201696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:36.201696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:36.201696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:13:36.201696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:36.206172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 369/754] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 5 15:13:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:36.207171 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba9d31-c113-4752-bf2d-27469145c810 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:36.214501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb6f3c-056a-42f2-94ac-b72426726d06 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:36.259887 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98129db8-adaf-4afb-b764-e4a9a5a5661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:36.260699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98129db8-adaf-4afb-b764-e4a9a5a5661b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:36.260980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98129db8-adaf-4afb-b764-e4a9a5a5661b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:36.261254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98129db8-adaf-4afb-b764-e4a9a5a5661b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:36.274668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98129db8-adaf-4afb-b764-e4a9a5a5661b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:36.276108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98129db8-adaf-4afb-b764-e4a9a5a5661b None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-98129db8-adaf-4afb-b764-e4a9a5a5661b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:36.295551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:36.296562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:36.297458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:36.297458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:36.297458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:36.297458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:36.297458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 386/755] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:36.297751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98129db8-adaf-4afb-b764-e4a9a5a5661b None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:36.328370 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba9d31-c113-4752-bf2d-27469145c810 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:36.363357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022dc7b-c309-4713-877b-b614713478d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:36.364359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022dc7b-c309-4713-877b-b614713478d5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:36.364874 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022dc7b-c309-4713-877b-b614713478d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:36.365354 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022dc7b-c309-4713-877b-b614713478d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:36.366506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022dc7b-c309-4713-877b-b614713478d5 None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=27e0b470f6b84df38565abf006dd8ba1) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:36.367028 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022dc7b-c309-4713-877b-b614713478d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:36.368678 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022dc7b-c309-4713-877b-b614713478d5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:36.375530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 370/756] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:36 2022] GET /identity/v3/role_assignments?user.id=27e0b470f6b84df38565abf006dd8ba1&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:36.376660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022dc7b-c309-4713-877b-b614713478d5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:36.404138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98129db8-adaf-4afb-b764-e4a9a5a5661b None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:36.441157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9cbfe-3859-4fcc-8c74-42b06bc6f6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:36.441850 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9cbfe-3859-4fcc-8c74-42b06bc6f6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:36.442134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9cbfe-3859-4fcc-8c74-42b06bc6f6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:36.442451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9cbfe-3859-4fcc-8c74-42b06bc6f6e9 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:36.443309 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9cbfe-3859-4fcc-8c74-42b06bc6f6e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:36.443620 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9cbfe-3859-4fcc-8c74-42b06bc6f6e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:36.445058 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9cbfe-3859-4fcc-8c74-42b06bc6f6e9 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:36.464665 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 387/757] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 5 15:13:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:36.470891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9cbfe-3859-4fcc-8c74-42b06bc6f6e9 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:36.487227 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022dc7b-c309-4713-877b-b614713478d5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:36.523908 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da7d0a-6bea-4c30-af31-6507c7bb75ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:36.525001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7d0a-6bea-4c30-af31-6507c7bb75ad None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:36.525493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7d0a-6bea-4c30-af31-6507c7bb75ad None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:36.525976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7d0a-6bea-4c30-af31-6507c7bb75ad None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:36.526970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da7d0a-6bea-4c30-af31-6507c7bb75ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:36.527488 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da7d0a-6bea-4c30-af31-6507c7bb75ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:36.529778 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da7d0a-6bea-4c30-af31-6507c7bb75ad None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:36.543290 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 371/758] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:36.551573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da7d0a-6bea-4c30-af31-6507c7bb75ad None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:36.615705 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9cbfe-3859-4fcc-8c74-42b06bc6f6e9 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:36.665525 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b89277-995f-49fc-9b37-0625e9d5aee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:36.666772 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b89277-995f-49fc-9b37-0625e9d5aee2 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:36.667281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b89277-995f-49fc-9b37-0625e9d5aee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:36.667761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b89277-995f-49fc-9b37-0625e9d5aee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:36.679651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b89277-995f-49fc-9b37-0625e9d5aee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:36.681427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b89277-995f-49fc-9b37-0625e9d5aee2 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-42b89277-995f-49fc-9b37-0625e9d5aee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:36.701401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:36.702367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:36.703295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:36.703295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:36.703295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:36.703295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:36.710372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da7d0a-6bea-4c30-af31-6507c7bb75ad None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:36.710857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 388/759] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:36.713039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b89277-995f-49fc-9b37-0625e9d5aee2 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:36.745054 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d25175-d785-48da-8f97-249ee0c22aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:36.745852 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d25175-d785-48da-8f97-249ee0c22aff None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:36.746231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d25175-d785-48da-8f97-249ee0c22aff None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:36.746533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d25175-d785-48da-8f97-249ee0c22aff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:36.753654 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d25175-d785-48da-8f97-249ee0c22aff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:36.757453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d25175-d785-48da-8f97-249ee0c22aff None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e3d25175-d785-48da-8f97-249ee0c22aff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:36.770023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:36.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:36.771878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:36.771878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:36.771878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:36.771878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:36.771878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:36.771878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:36.771878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:36.771878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:36.771878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 372/760] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:36.779440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d25175-d785-48da-8f97-249ee0c22aff None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:36.831492 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b89277-995f-49fc-9b37-0625e9d5aee2 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:36.876651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a095bd-7658-4527-8dda-8e49d802401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:36.877626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a095bd-7658-4527-8dda-8e49d802401c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:36.878093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a095bd-7658-4527-8dda-8e49d802401c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:36.878577 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a095bd-7658-4527-8dda-8e49d802401c None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:36.879508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a095bd-7658-4527-8dda-8e49d802401c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:36.879994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a095bd-7658-4527-8dda-8e49d802401c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:36.881557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a095bd-7658-4527-8dda-8e49d802401c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:36.883584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d25175-d785-48da-8f97-249ee0c22aff None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:36.902531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 389/761] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:36.909763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a095bd-7658-4527-8dda-8e49d802401c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:36.952464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b6649-cd28-40a6-bc62-6c2ca4fb1921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:36.953148 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b6649-cd28-40a6-bc62-6c2ca4fb1921 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:36.953436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b6649-cd28-40a6-bc62-6c2ca4fb1921 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:36.953719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b6649-cd28-40a6-bc62-6c2ca4fb1921 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:36.954717 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b6649-cd28-40a6-bc62-6c2ca4fb1921 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:36.955031 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b6649-cd28-40a6-bc62-6c2ca4fb1921 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:36.956489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b6649-cd28-40a6-bc62-6c2ca4fb1921 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:36.985729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 373/762] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:37.005765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b6649-cd28-40a6-bc62-6c2ca4fb1921 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:37.027972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a095bd-7658-4527-8dda-8e49d802401c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:37.064782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c13932-6b92-4540-9c79-4bf7f1b39c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:37.066110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13932-6b92-4540-9c79-4bf7f1b39c91 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:37.067648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13932-6b92-4540-9c79-4bf7f1b39c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:37.068764 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13932-6b92-4540-9c79-4bf7f1b39c91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:37.079874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c13932-6b92-4540-9c79-4bf7f1b39c91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:37.083578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c13932-6b92-4540-9c79-4bf7f1b39c91 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-c1c13932-6b92-4540-9c79-4bf7f1b39c91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:37.109132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:37.110085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:37.111078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:37.111078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:37.111078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:37.111078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:37.111078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:37.111078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:37.111078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:37.111078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:37.111508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 390/763] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:37.119477 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c13932-6b92-4540-9c79-4bf7f1b39c91 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:37.215731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b6649-cd28-40a6-bc62-6c2ca4fb1921 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:37.276914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee279fd-3b72-4b18-bae9-6b71e8a7e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:37.277603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee279fd-3b72-4b18-bae9-6b71e8a7e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:37.277880 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee279fd-3b72-4b18-bae9-6b71e8a7e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:37.278149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee279fd-3b72-4b18-bae9-6b71e8a7e8b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:37.280244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee279fd-3b72-4b18-bae9-6b71e8a7e8b3 None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=6d5886d3fdab4730828183bd6204c6ef) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:37.280244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee279fd-3b72-4b18-bae9-6b71e8a7e8b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:37.281509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee279fd-3b72-4b18-bae9-6b71e8a7e8b3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:37.292493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 374/764] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:37 2022] GET /identity/v3/role_assignments?user.id=6d5886d3fdab4730828183bd6204c6ef&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:37.305601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c13932-6b92-4540-9c79-4bf7f1b39c91 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:37.316525 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5951e-16c1-440f-a6a7-54a6f695e363 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:37.316931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5951e-16c1-440f-a6a7-54a6f695e363 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:37.317126 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5951e-16c1-440f-a6a7-54a6f695e363 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:37.318835 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 375/765] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:37.324009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313efdbd-d71b-40fe-bc0f-60cefccdb3f3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:37.324362 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313efdbd-d71b-40fe-bc0f-60cefccdb3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:37.324551 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313efdbd-d71b-40fe-bc0f-60cefccdb3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:37.345034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-313efdbd-d71b-40fe-bc0f-60cefccdb3f3 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:37.346256 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-313efdbd-d71b-40fe-bc0f-60cefccdb3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:37.378590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959374a-6e02-4c9f-81e3-6fb1459376fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:37.379269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959374a-6e02-4c9f-81e3-6fb1459376fb None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:37.379548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959374a-6e02-4c9f-81e3-6fb1459376fb None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:37.379821 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959374a-6e02-4c9f-81e3-6fb1459376fb None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:37.380621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959374a-6e02-4c9f-81e3-6fb1459376fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:37.380928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959374a-6e02-4c9f-81e3-6fb1459376fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:37.382412 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959374a-6e02-4c9f-81e3-6fb1459376fb None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:37.409874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 391/766] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:37.415158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959374a-6e02-4c9f-81e3-6fb1459376fb None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:37.512743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 376/767] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:13:37.537417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313efdbd-d71b-40fe-bc0f-60cefccdb3f3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:37.555645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959374a-6e02-4c9f-81e3-6fb1459376fb None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:37.606100 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bb141-c155-4a18-ad7e-9ccba15691fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:37.607153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bb141-c155-4a18-ad7e-9ccba15691fe None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:37.607371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bb141-c155-4a18-ad7e-9ccba15691fe None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:37.607638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bb141-c155-4a18-ad7e-9ccba15691fe None admin] PATH_INFO: `/v3/projects/587280a3c4c54bffb4d769e406af3689/users/eb4ff6ba4e17477d8787eaf1955bd1da/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:37.609660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bb141-c155-4a18-ad7e-9ccba15691fe None admin] RBAC: Authorizing `identity:create_grant(project_id=587280a3c4c54bffb4d769e406af3689, user_id=eb4ff6ba4e17477d8787eaf1955bd1da, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:37.611134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bb141-c155-4a18-ad7e-9ccba15691fe None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:37.666845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313efdbd-d71b-40fe-bc0f-60cefccdb3f3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:37.684517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 392/768] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:13:37 2022] PUT /identity/v3/projects/587280a3c4c54bffb4d769e406af3689/users/eb4ff6ba4e17477d8787eaf1955bd1da/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:13:37.712331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dfadc-cbad-4e04-a6d1-59249fa783b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:37.713175 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dfadc-cbad-4e04-a6d1-59249fa783b0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:37.713458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dfadc-cbad-4e04-a6d1-59249fa783b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:37.713755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dfadc-cbad-4e04-a6d1-59249fa783b0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:37.714451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4dfadc-cbad-4e04-a6d1-59249fa783b0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:37.715942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4dfadc-cbad-4e04-a6d1-59249fa783b0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-bc4dfadc-cbad-4e04-a6d1-59249fa783b0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:37.729795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:37.730892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:37.732216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 377/769] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:37 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:37.737326 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bb141-c155-4a18-ad7e-9ccba15691fe None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:37.868214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bb141-c155-4a18-ad7e-9ccba15691fe None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:37.907322 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ee2ad-5c30-4990-b878-009caa2715ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:37.908017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ee2ad-5c30-4990-b878-009caa2715ec None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:37.908313 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ee2ad-5c30-4990-b878-009caa2715ec None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:37.908591 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ee2ad-5c30-4990-b878-009caa2715ec None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:37.909316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ee2ad-5c30-4990-b878-009caa2715ec None admin] RBAC: Adding query filter params (name=network) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:37.909624 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ee2ad-5c30-4990-b878-009caa2715ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:37.911052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ee2ad-5c30-4990-b878-009caa2715ec None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:37.916919 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 393/770] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 5 15:13:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:37.923111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dfadc-cbad-4e04-a6d1-59249fa783b0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:38.031186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dfadc-cbad-4e04-a6d1-59249fa783b0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:38.064713 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a872a2f-5339-41b2-9aa1-afaf922d51aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:38.065433 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a872a2f-5339-41b2-9aa1-afaf922d51aa None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:38.065719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a872a2f-5339-41b2-9aa1-afaf922d51aa None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:38.065999 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a872a2f-5339-41b2-9aa1-afaf922d51aa None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:38.066751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a872a2f-5339-41b2-9aa1-afaf922d51aa None admin] RBAC: Adding query filter params (type=network) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:38.067062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a872a2f-5339-41b2-9aa1-afaf922d51aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:38.068431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a872a2f-5339-41b2-9aa1-afaf922d51aa None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:38.073927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 378/771] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 5 15:13:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:38.080213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ee2ad-5c30-4990-b878-009caa2715ec None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:38.200115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ee2ad-5c30-4990-b878-009caa2715ec None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:38.248732 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c8a4e-1028-497d-a315-a241ea7f67bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:38.249405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8a4e-1028-497d-a315-a241ea7f67bd None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:38.249691 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8a4e-1028-497d-a315-a241ea7f67bd None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:38.249971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8a4e-1028-497d-a315-a241ea7f67bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:38.250793 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c8a4e-1028-497d-a315-a241ea7f67bd None admin] RBAC: Adding query filter params (interface=public, service_id=8e4d86ad36e9459db3fa5e45582bd278, region_id=RegionOne) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:38.251110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c8a4e-1028-497d-a315-a241ea7f67bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:38.252478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c8a4e-1028-497d-a315-a241ea7f67bd None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:38.265065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 394/772] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 5 15:13:38 2022] GET /identity/v3/endpoints?service_id=8e4d86ad36e9459db3fa5e45582bd278&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:38.270550 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a872a2f-5339-41b2-9aa1-afaf922d51aa None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:38.382889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a872a2f-5339-41b2-9aa1-afaf922d51aa None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:38.417019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20dbdff-d879-4878-a613-995f75b0085a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:38.417695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dbdff-d879-4878-a613-995f75b0085a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:38.417985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dbdff-d879-4878-a613-995f75b0085a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:38.418265 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dbdff-d879-4878-a613-995f75b0085a None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:38.418971 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20dbdff-d879-4878-a613-995f75b0085a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:38.420928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20dbdff-d879-4878-a613-995f75b0085a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:38.426634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 379/773] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 5 15:13:38 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:38.796204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c387b-5256-458c-bcd4-2936e60a7280 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:38.796204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c387b-5256-458c-bcd4-2936e60a7280 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:38.796204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c387b-5256-458c-bcd4-2936e60a7280 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:38.796204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 395/774] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:38.802021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58428fcf-9561-4d28-b51a-845aef2c2978 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:38.802603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58428fcf-9561-4d28-b51a-845aef2c2978 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:38.803081 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58428fcf-9561-4d28-b51a-845aef2c2978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:38.822227 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-58428fcf-9561-4d28-b51a-845aef2c2978 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:38.823455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-58428fcf-9561-4d28-b51a-845aef2c2978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:38.933026 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 380/775] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:38.970061 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c387b-5256-458c-bcd4-2936e60a7280 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:39.134870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c387b-5256-458c-bcd4-2936e60a7280 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:39.183677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361212f4-9317-4b5f-9cb9-84e07af040c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:39.184509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361212f4-9317-4b5f-9cb9-84e07af040c6 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:39.185318 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361212f4-9317-4b5f-9cb9-84e07af040c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:39.185605 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361212f4-9317-4b5f-9cb9-84e07af040c6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:39.186271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361212f4-9317-4b5f-9cb9-84e07af040c6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:39.187680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361212f4-9317-4b5f-9cb9-84e07af040c6 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-361212f4-9317-4b5f-9cb9-84e07af040c6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:39.208213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:39.209218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:13:39.210041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:39.210947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 396/776] 10.222.0.44 () {56 vars in 1129 bytes} [Thu May 5 15:13:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:39.219385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58428fcf-9561-4d28-b51a-845aef2c2978 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:39.287125 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f2df7-e221-4cf1-ab0b-2cecf47875bc None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:39.287448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f2df7-e221-4cf1-ab0b-2cecf47875bc None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:39.287694 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f2df7-e221-4cf1-ab0b-2cecf47875bc None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:39.289310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 397/777] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:39.293957 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847e705-114f-4e7f-823b-519a9bc26bc7 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:39.294804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847e705-114f-4e7f-823b-519a9bc26bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:39.295091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847e705-114f-4e7f-823b-519a9bc26bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:39.329137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58428fcf-9561-4d28-b51a-845aef2c2978 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:39.330427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-9847e705-114f-4e7f-823b-519a9bc26bc7 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:39.331856 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9847e705-114f-4e7f-823b-519a9bc26bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:39.367567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4436e-7f8e-4ac5-91ed-3fd76835eac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:39.368243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4436e-7f8e-4ac5-91ed-3fd76835eac9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:39.368531 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4436e-7f8e-4ac5-91ed-3fd76835eac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:39.368806 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4436e-7f8e-4ac5-91ed-3fd76835eac9 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:39.369511 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4436e-7f8e-4ac5-91ed-3fd76835eac9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:39.369819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4436e-7f8e-4ac5-91ed-3fd76835eac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:39.371206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4436e-7f8e-4ac5-91ed-3fd76835eac9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:39.379008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 381/778] 10.222.0.44 () {56 vars in 1124 bytes} [Thu May 5 15:13:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:39.386060 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4436e-7f8e-4ac5-91ed-3fd76835eac9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:39.424354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 398/779] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:39.459444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847e705-114f-4e7f-823b-519a9bc26bc7 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:39.498015 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4436e-7f8e-4ac5-91ed-3fd76835eac9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:39.536450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06594c4a-6ac1-405c-bbb4-f793b818eb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:39.537537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06594c4a-6ac1-405c-bbb4-f793b818eb08 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:39.538124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06594c4a-6ac1-405c-bbb4-f793b818eb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:39.538566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06594c4a-6ac1-405c-bbb4-f793b818eb08 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:39.539406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06594c4a-6ac1-405c-bbb4-f793b818eb08 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:39.539884 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06594c4a-6ac1-405c-bbb4-f793b818eb08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:39.541547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06594c4a-6ac1-405c-bbb4-f793b818eb08 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:39.547861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 382/780] 10.222.0.44 () {56 vars in 1124 bytes} [Thu May 5 15:13:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:39.554078 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06594c4a-6ac1-405c-bbb4-f793b818eb08 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:39.664022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06594c4a-6ac1-405c-bbb4-f793b818eb08 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:39.702793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d7e35-4ca6-4d21-a3bc-9eb30f5f3674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:39.703706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d7e35-4ca6-4d21-a3bc-9eb30f5f3674 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:39.704315 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d7e35-4ca6-4d21-a3bc-9eb30f5f3674 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:39.705056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d7e35-4ca6-4d21-a3bc-9eb30f5f3674 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:39.705992 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d7e35-4ca6-4d21-a3bc-9eb30f5f3674 None admin] RBAC: Adding query filter params (interface=public, service_id=5333075c22634435a35ff1a6c46b7b4f, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:39.706485 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d7e35-4ca6-4d21-a3bc-9eb30f5f3674 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:39.707995 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d7e35-4ca6-4d21-a3bc-9eb30f5f3674 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:39.716808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847e705-114f-4e7f-823b-519a9bc26bc7 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:39.718299 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 383/781] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 5 15:13:39 2022] GET /identity/v3/endpoints?service_id=5333075c22634435a35ff1a6c46b7b4f&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:39.725965 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d7e35-4ca6-4d21-a3bc-9eb30f5f3674 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:39.830999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4932d00-e237-432e-b325-328bfff7126e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:39.831823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4932d00-e237-432e-b325-328bfff7126e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:39.832149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4932d00-e237-432e-b325-328bfff7126e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:39.832383 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4932d00-e237-432e-b325-328bfff7126e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:39.834644 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d7e35-4ca6-4d21-a3bc-9eb30f5f3674 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:39.859470 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4932d00-e237-432e-b325-328bfff7126e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:39.869883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffe06a-dc66-40f0-b9e6-456361804ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:39.870802 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffe06a-dc66-40f0-b9e6-456361804ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:39.871255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffe06a-dc66-40f0-b9e6-456361804ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:39.871670 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffe06a-dc66-40f0-b9e6-456361804ef3 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:39.873009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffe06a-dc66-40f0-b9e6-456361804ef3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:39.874808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffe06a-dc66-40f0-b9e6-456361804ef3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-f4932d00-e237-432e-b325-328bfff7126e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:39.875133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:39.876221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:39.877149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:39.877149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:39.877149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:39.877149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:39.877149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:39.877149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:39.877149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:39.877149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:39.877149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:39.877149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:39.877149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:39.877149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:39.877149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 399/782] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:13:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:39.882242 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4932d00-e237-432e-b325-328bfff7126e None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:39.883686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 384/783] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 5 15:13:39 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:40.061763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4932d00-e237-432e-b325-328bfff7126e None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:40.113907 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7fafb-1ce6-4fcd-be9a-f956ce03264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:40.114895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7fafb-1ce6-4fcd-be9a-f956ce03264f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:40.115322 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7fafb-1ce6-4fcd-be9a-f956ce03264f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:40.115740 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7fafb-1ce6-4fcd-be9a-f956ce03264f None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:40.116637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7fafb-1ce6-4fcd-be9a-f956ce03264f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:40.117084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7fafb-1ce6-4fcd-be9a-f956ce03264f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:40.118632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7fafb-1ce6-4fcd-be9a-f956ce03264f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:40.128612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 400/784] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:40.134591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffe06a-dc66-40f0-b9e6-456361804ef3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:40.248495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffe06a-dc66-40f0-b9e6-456361804ef3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:40.269466 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4b8ae-d984-48ca-abad-c810934c43e1 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:40.270126 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4b8ae-d984-48ca-abad-c810934c43e1 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:40.270891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4b8ae-d984-48ca-abad-c810934c43e1 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:40.273194 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 401/785] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:13:40.279621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afa5a1-bf33-432c-a9f5-b6c85e6fefcf None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:40.280243 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afa5a1-bf33-432c-a9f5-b6c85e6fefcf None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:40.280742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afa5a1-bf33-432c-a9f5-b6c85e6fefcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:40.288135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e97f8-216f-4d17-a9cf-ffcf41962a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:40.288135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e97f8-216f-4d17-a9cf-ffcf41962a2e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:40.288603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e97f8-216f-4d17-a9cf-ffcf41962a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:40.288765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e97f8-216f-4d17-a9cf-ffcf41962a2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:40.301579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b0afa5a1-bf33-432c-a9f5-b6c85e6fefcf None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:40.303222 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b0afa5a1-bf33-432c-a9f5-b6c85e6fefcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:40.303509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e97f8-216f-4d17-a9cf-ffcf41962a2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:40.305017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e97f8-216f-4d17-a9cf-ffcf41962a2e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-014e97f8-216f-4d17-a9cf-ffcf41962a2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:40.324946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:40.326441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:40.327353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:40.327353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:40.327353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:40.327353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:40.327353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 385/786] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:40.335357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e97f8-216f-4d17-a9cf-ffcf41962a2e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:40.399847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 402/787] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:13:40.455746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e97f8-216f-4d17-a9cf-ffcf41962a2e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:40.477236 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afa5a1-bf33-432c-a9f5-b6c85e6fefcf None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:40.501139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a158d0b-3a93-4674-9202-4ac8b342622a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:40.501824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a158d0b-3a93-4674-9202-4ac8b342622a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:40.502110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a158d0b-3a93-4674-9202-4ac8b342622a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:40.502408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a158d0b-3a93-4674-9202-4ac8b342622a None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:40.503137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a158d0b-3a93-4674-9202-4ac8b342622a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:40.503443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a158d0b-3a93-4674-9202-4ac8b342622a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:40.504829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a158d0b-3a93-4674-9202-4ac8b342622a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:40.525531 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 386/788] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:40.531361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab6b2b-cab5-4869-9aec-9c4862f540be None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:40.531654 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab6b2b-cab5-4869-9aec-9c4862f540be None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:40.532813 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab6b2b-cab5-4869-9aec-9c4862f540be None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:40.534492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 387/789] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:40.535242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab6b2b-cab5-4869-9aec-9c4862f540be None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:40.610718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afa5a1-bf33-432c-a9f5-b6c85e6fefcf None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:40.647679 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8398b00-a730-4759-a354-bcc413f79fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:40.648496 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8398b00-a730-4759-a354-bcc413f79fdf None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:40.648604 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab6b2b-cab5-4869-9aec-9c4862f540be None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:40.648802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8398b00-a730-4759-a354-bcc413f79fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:40.649040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8398b00-a730-4759-a354-bcc413f79fdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:40.661036 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8398b00-a730-4759-a354-bcc413f79fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-b8398b00-a730-4759-a354-bcc413f79fdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:40.670350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:40.671395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:40.672220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:40.672220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:40.672220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:40.672220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:40.672220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:40.672220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:40.672220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:40.672220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:40.672220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:40.672220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:40.672220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:40.672220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:40.676747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 403/790] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:40.678099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0f5ff-55a8-45ea-a911-165a31f5fc5a None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:40.678418 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0f5ff-55a8-45ea-a911-165a31f5fc5a None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:40.678700 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0f5ff-55a8-45ea-a911-165a31f5fc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:40.687658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0488a-0b16-4aca-a775-8f5358e68228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:40.688510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0488a-0b16-4aca-a775-8f5358e68228 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:40.691234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0488a-0b16-4aca-a775-8f5358e68228 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:40.691234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0488a-0b16-4aca-a775-8f5358e68228 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:40.696037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b9b0f5ff-55a8-45ea-a911-165a31f5fc5a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:40.697225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b9b0f5ff-55a8-45ea-a911-165a31f5fc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:40.697424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0488a-0b16-4aca-a775-8f5358e68228 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:40.698904 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0488a-0b16-4aca-a775-8f5358e68228 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6ed0488a-0b16-4aca-a775-8f5358e68228 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:40.718968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:40.720473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:40.721467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:40.721467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:40.721467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:40.721467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:40.721467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:40.721467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:40.721467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:40.721467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:40.721467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:13:40.721467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:40.721467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 388/791] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:13:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:40.722056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0488a-0b16-4aca-a775-8f5358e68228 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:40.786751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 404/792] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:40.787859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0f5ff-55a8-45ea-a911-165a31f5fc5a None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:40.865988 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0488a-0b16-4aca-a775-8f5358e68228 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:40.887837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0f5ff-55a8-45ea-a911-165a31f5fc5a None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:40.901698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d24073-50b0-4bed-817e-4c4b9bde981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:40.902761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d24073-50b0-4bed-817e-4c4b9bde981c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:40.903265 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d24073-50b0-4bed-817e-4c4b9bde981c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:40.903852 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d24073-50b0-4bed-817e-4c4b9bde981c None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:40.904844 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d24073-50b0-4bed-817e-4c4b9bde981c None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:40.905381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d24073-50b0-4bed-817e-4c4b9bde981c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:40.907020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d24073-50b0-4bed-817e-4c4b9bde981c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:40.921386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 389/793] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:40.922614 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d24073-50b0-4bed-817e-4c4b9bde981c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:40.924973 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e18cbb-0ee4-4b50-9039-bc6263a47e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:40.925656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e18cbb-0ee4-4b50-9039-bc6263a47e36 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:40.925940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e18cbb-0ee4-4b50-9039-bc6263a47e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:40.926218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e18cbb-0ee4-4b50-9039-bc6263a47e36 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:40.927122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e18cbb-0ee4-4b50-9039-bc6263a47e36 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:40.927433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e18cbb-0ee4-4b50-9039-bc6263a47e36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:40.928946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e18cbb-0ee4-4b50-9039-bc6263a47e36 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:40.948108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 405/794] 10.222.0.44 () {56 vars in 1135 bytes} [Thu May 5 15:13:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:40.948957 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e18cbb-0ee4-4b50-9039-bc6263a47e36 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:41.028602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d24073-50b0-4bed-817e-4c4b9bde981c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:41.054276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e18cbb-0ee4-4b50-9039-bc6263a47e36 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:41.064269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ab480-40e7-4381-86de-a6aaad4ef428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:41.065408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ab480-40e7-4381-86de-a6aaad4ef428 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:41.065927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ab480-40e7-4381-86de-a6aaad4ef428 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:41.066561 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ab480-40e7-4381-86de-a6aaad4ef428 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:41.078067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ab480-40e7-4381-86de-a6aaad4ef428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e24ab480-40e7-4381-86de-a6aaad4ef428 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:41.086243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:41.087207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:41.088041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:41.088041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:41.088041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:41.088041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:41.088041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:41.088041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:41.088041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:41.088041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:41.088041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:41.088041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:41.088041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:41.088041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:41.092126 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 390/795] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:41.093298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ab480-40e7-4381-86de-a6aaad4ef428 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:41.098547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1e47e-ca82-43a5-95f7-49dd6534897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:41.100231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e47e-ca82-43a5-95f7-49dd6534897c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:41.100735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e47e-ca82-43a5-95f7-49dd6534897c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:41.101199 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e47e-ca82-43a5-95f7-49dd6534897c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:41.113323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1e47e-ca82-43a5-95f7-49dd6534897c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:41.115217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1e47e-ca82-43a5-95f7-49dd6534897c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-a0b1e47e-ca82-43a5-95f7-49dd6534897c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:41.137662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:41.139448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:41.140515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:41.140515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:41.140515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:41.140515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:41.142503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 406/796] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:41.143508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1e47e-ca82-43a5-95f7-49dd6534897c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:41.208656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ab480-40e7-4381-86de-a6aaad4ef428 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:41.244050 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e2208-7f9b-43a6-ba7f-fc21678d077a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:41.245032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e2208-7f9b-43a6-ba7f-fc21678d077a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:41.245404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e2208-7f9b-43a6-ba7f-fc21678d077a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:41.245787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e2208-7f9b-43a6-ba7f-fc21678d077a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:41.253462 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1e47e-ca82-43a5-95f7-49dd6534897c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:41.257238 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e2208-7f9b-43a6-ba7f-fc21678d077a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:41.258831 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e2208-7f9b-43a6-ba7f-fc21678d077a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b43e2208-7f9b-43a6-ba7f-fc21678d077a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:41.276703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:41.277664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:41.279295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:41.279295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:41.279295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:41.279295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:41.282397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 391/797] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:41.283392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e2208-7f9b-43a6-ba7f-fc21678d077a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:41.292975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db02ed4-0a82-4f0e-9cd7-ed6df04f12e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:41.294110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db02ed4-0a82-4f0e-9cd7-ed6df04f12e1 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:41.295097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db02ed4-0a82-4f0e-9cd7-ed6df04f12e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:41.295586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db02ed4-0a82-4f0e-9cd7-ed6df04f12e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:41.296522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db02ed4-0a82-4f0e-9cd7-ed6df04f12e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:41.296977 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db02ed4-0a82-4f0e-9cd7-ed6df04f12e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:41.298544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db02ed4-0a82-4f0e-9cd7-ed6df04f12e1 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:41.307323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 407/798] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:13:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:41.308271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db02ed4-0a82-4f0e-9cd7-ed6df04f12e1 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:41.393766 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e2208-7f9b-43a6-ba7f-fc21678d077a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:41.412812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db02ed4-0a82-4f0e-9cd7-ed6df04f12e1 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:41.426934 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fec938-bd3f-4377-a543-cce3980f541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:41.427599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fec938-bd3f-4377-a543-cce3980f541e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:41.427887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fec938-bd3f-4377-a543-cce3980f541e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:41.428170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fec938-bd3f-4377-a543-cce3980f541e None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:41.428889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fec938-bd3f-4377-a543-cce3980f541e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:41.429197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fec938-bd3f-4377-a543-cce3980f541e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:41.430603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fec938-bd3f-4377-a543-cce3980f541e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:41.447310 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 392/799] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:41.447310 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abb494-d898-4081-aa51-298586ba9549 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:41.447310 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abb494-d898-4081-aa51-298586ba9549 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:41.447310 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abb494-d898-4081-aa51-298586ba9549 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:41.447310 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 393/800] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:41.447310 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abb494-d898-4081-aa51-298586ba9549 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:41.455076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5916006-efe9-4ce8-999b-8325b98b11b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:41.455991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5916006-efe9-4ce8-999b-8325b98b11b1 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:41.456504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5916006-efe9-4ce8-999b-8325b98b11b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:41.456783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5916006-efe9-4ce8-999b-8325b98b11b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:41.457518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5916006-efe9-4ce8-999b-8325b98b11b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:41.457826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5916006-efe9-4ce8-999b-8325b98b11b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:41.459238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5916006-efe9-4ce8-999b-8325b98b11b1 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:41.471177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 408/801] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:41.472000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5916006-efe9-4ce8-999b-8325b98b11b1 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:41.550785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abb494-d898-4081-aa51-298586ba9549 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:41.571316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5916006-efe9-4ce8-999b-8325b98b11b1 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:41.585207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29af5b-42f8-4c9c-b10c-66719f930ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:41.586020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29af5b-42f8-4c9c-b10c-66719f930ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:41.586318 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29af5b-42f8-4c9c-b10c-66719f930ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:41.586603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29af5b-42f8-4c9c-b10c-66719f930ac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:41.597186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29af5b-42f8-4c9c-b10c-66719f930ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:41.598661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29af5b-42f8-4c9c-b10c-66719f930ac3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:41.606462 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9aa95-6eb6-4b45-8f1e-069b7d79d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:41.607350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9aa95-6eb6-4b45-8f1e-069b7d79d332 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:41.607635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9aa95-6eb6-4b45-8f1e-069b7d79d332 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:41.607912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9aa95-6eb6-4b45-8f1e-069b7d79d332 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:41.614866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9aa95-6eb6-4b45-8f1e-069b7d79d332 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:41.616305 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9aa95-6eb6-4b45-8f1e-069b7d79d332 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-cf29af5b-42f8-4c9c-b10c-66719f930ac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:41.616707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:41.617540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:41.618463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:41.618463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:41.618463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:41.618463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:41.618463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 394/802] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:41.619222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094c3e-8a67-454b-be7f-48703d655934 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:41.619385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094c3e-8a67-454b-be7f-48703d655934 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:41.619646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094c3e-8a67-454b-be7f-48703d655934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:41.635911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ee094c3e-8a67-454b-be7f-48703d655934 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:41.637099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ee094c3e-8a67-454b-be7f-48703d655934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-77d9aa95-6eb6-4b45-8f1e-069b7d79d332 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:41.639832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:41.650211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:41.651197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:41.651197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:41.651197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:41.651197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:41.651197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:41.651197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:41.651197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:41.651197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:41.651197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:13:41.651197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:41.651197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 409/803] 10.222.0.44 () {56 vars in 1117 bytes} [Thu May 5 15:13:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:41.651197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9aa95-6eb6-4b45-8f1e-069b7d79d332 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:41.709595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 395/804] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:41.710274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee094c3e-8a67-454b-be7f-48703d655934 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:41.751066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9aa95-6eb6-4b45-8f1e-069b7d79d332 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:41.792965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eba168-8663-4cc1-98c7-cc3246ba95a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:41.793766 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eba168-8663-4cc1-98c7-cc3246ba95a0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:41.794630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eba168-8663-4cc1-98c7-cc3246ba95a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:41.794851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eba168-8663-4cc1-98c7-cc3246ba95a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:41.802071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eba168-8663-4cc1-98c7-cc3246ba95a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:41.803554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eba168-8663-4cc1-98c7-cc3246ba95a0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:41.814907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee094c3e-8a67-454b-be7f-48703d655934 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-c1eba168-8663-4cc1-98c7-cc3246ba95a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:41.818830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:41.819683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:41.820559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:41.820559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:41.820559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:41.820559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:41.820559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:41.820559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:41.820559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:41.820559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:41.824869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 410/805] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:41.826001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eba168-8663-4cc1-98c7-cc3246ba95a0 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:41.848835 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd5927-7d86-4b54-be2b-8e4ffd593551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:41.849504 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd5927-7d86-4b54-be2b-8e4ffd593551 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:41.849799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd5927-7d86-4b54-be2b-8e4ffd593551 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:41.850081 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd5927-7d86-4b54-be2b-8e4ffd593551 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:41.850843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd5927-7d86-4b54-be2b-8e4ffd593551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:41.851153 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd5927-7d86-4b54-be2b-8e4ffd593551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:41.852523 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd5927-7d86-4b54-be2b-8e4ffd593551 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:41.868738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 396/806] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:41.868738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd5927-7d86-4b54-be2b-8e4ffd593551 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:41.926245 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eba168-8663-4cc1-98c7-cc3246ba95a0 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:41.959754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71889d8e-ee19-463c-b5c6-a63083511bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:41.960435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71889d8e-ee19-463c-b5c6-a63083511bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:41.960722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71889d8e-ee19-463c-b5c6-a63083511bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:41.961000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71889d8e-ee19-463c-b5c6-a63083511bf6 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:41.961838 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71889d8e-ee19-463c-b5c6-a63083511bf6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:41.962149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71889d8e-ee19-463c-b5c6-a63083511bf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:41.963625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71889d8e-ee19-463c-b5c6-a63083511bf6 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:41.969293 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd5927-7d86-4b54-be2b-8e4ffd593551 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:41.985947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 411/807] 10.222.0.44 () {56 vars in 1149 bytes} [Thu May 5 15:13:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:41.985947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71889d8e-ee19-463c-b5c6-a63083511bf6 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:42.007662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4b600-0e2d-405a-8abc-0d375beaeeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:42.008466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4b600-0e2d-405a-8abc-0d375beaeeba None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:42.008756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4b600-0e2d-405a-8abc-0d375beaeeba None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:42.009034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4b600-0e2d-405a-8abc-0d375beaeeba None admin] PATH_INFO: `/v3/services/network` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:42.009684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4b600-0e2d-405a-8abc-0d375beaeeba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:42.011073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4b600-0e2d-405a-8abc-0d375beaeeba None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-50a4b600-0e2d-405a-8abc-0d375beaeeba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:42.023827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:42.024913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:42.025737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 397/808] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:41 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:42.026555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4b600-0e2d-405a-8abc-0d375beaeeba None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:42.084974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71889d8e-ee19-463c-b5c6-a63083511bf6 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:42.119016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd40a4-2031-409b-8fd3-2e27aebec09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:42.120363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd40a4-2031-409b-8fd3-2e27aebec09e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:42.120646 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd40a4-2031-409b-8fd3-2e27aebec09e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:42.120920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd40a4-2031-409b-8fd3-2e27aebec09e None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:42.121708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd40a4-2031-409b-8fd3-2e27aebec09e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:42.122011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd40a4-2031-409b-8fd3-2e27aebec09e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:42.123812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd40a4-2031-409b-8fd3-2e27aebec09e None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:42.139895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 412/809] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:42.140074 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4b600-0e2d-405a-8abc-0d375beaeeba None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:42.140158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd40a4-2031-409b-8fd3-2e27aebec09e None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:42.171448 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6e3ff-6fc9-4f39-a1fa-ba53d2481370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:42.172274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6e3ff-6fc9-4f39-a1fa-ba53d2481370 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:42.172560 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6e3ff-6fc9-4f39-a1fa-ba53d2481370 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:42.172835 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6e3ff-6fc9-4f39-a1fa-ba53d2481370 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:42.180448 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6e3ff-6fc9-4f39-a1fa-ba53d2481370 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:42.181823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6e3ff-6fc9-4f39-a1fa-ba53d2481370 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-73b6e3ff-6fc9-4f39-a1fa-ba53d2481370 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:42.196455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:42.197367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:42.198302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:42.198302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:42.198302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:42.198302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:42.198302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:42.198302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:42.198302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:42.198302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:42.198302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:13:42.198302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:42.198302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 398/810] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 5 15:13:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:42.198889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6e3ff-6fc9-4f39-a1fa-ba53d2481370 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:42.241026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd40a4-2031-409b-8fd3-2e27aebec09e None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:42.273388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2acfb-3b27-4e6f-908f-6a26f75f74e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:42.274189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2acfb-3b27-4e6f-908f-6a26f75f74e5 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:42.274805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2acfb-3b27-4e6f-908f-6a26f75f74e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:42.275082 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2acfb-3b27-4e6f-908f-6a26f75f74e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:42.286693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2acfb-3b27-4e6f-908f-6a26f75f74e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:42.288145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2acfb-3b27-4e6f-908f-6a26f75f74e5 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:42.299043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6e3ff-6fc9-4f39-a1fa-ba53d2481370 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-1df2acfb-3b27-4e6f-908f-6a26f75f74e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:42.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:42.306754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:42.307678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:42.307678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:42.307678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:42.307678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:42.307678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 413/811] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:42.307678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2acfb-3b27-4e6f-908f-6a26f75f74e5 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:42.337551 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c3748-59f8-4c4f-96ef-72f24a26042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:42.338240 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c3748-59f8-4c4f-96ef-72f24a26042b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:42.338581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c3748-59f8-4c4f-96ef-72f24a26042b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:42.338854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c3748-59f8-4c4f-96ef-72f24a26042b None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:42.339567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c3748-59f8-4c4f-96ef-72f24a26042b None admin] RBAC: Adding query filter params (name=network) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:42.339870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c3748-59f8-4c4f-96ef-72f24a26042b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:42.342098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c3748-59f8-4c4f-96ef-72f24a26042b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:42.351739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 399/812] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 5 15:13:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:42.351739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c3748-59f8-4c4f-96ef-72f24a26042b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:42.419645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2acfb-3b27-4e6f-908f-6a26f75f74e5 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:42.453536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944391e5-8c98-4e43-bdd0-eefb826db9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:42.453870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c3748-59f8-4c4f-96ef-72f24a26042b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:42.454396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944391e5-8c98-4e43-bdd0-eefb826db9f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:42.454683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944391e5-8c98-4e43-bdd0-eefb826db9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:42.454960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944391e5-8c98-4e43-bdd0-eefb826db9f8 None admin] PATH_INFO: `/v3/projects/587280a3c4c54bffb4d769e406af3689/users/27e0b470f6b84df38565abf006dd8ba1/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:42.457006 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944391e5-8c98-4e43-bdd0-eefb826db9f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=587280a3c4c54bffb4d769e406af3689, user_id=27e0b470f6b84df38565abf006dd8ba1, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:42.458603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944391e5-8c98-4e43-bdd0-eefb826db9f8 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:42.486558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ee39a-8258-4002-818c-98d1e2167723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:42.487223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ee39a-8258-4002-818c-98d1e2167723 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:42.487504 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ee39a-8258-4002-818c-98d1e2167723 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:42.487778 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ee39a-8258-4002-818c-98d1e2167723 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:42.488600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ee39a-8258-4002-818c-98d1e2167723 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:42.488901 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ee39a-8258-4002-818c-98d1e2167723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:42.490329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ee39a-8258-4002-818c-98d1e2167723 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:42.507136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 400/813] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 5 15:13:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:42.507935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ee39a-8258-4002-818c-98d1e2167723 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:42.558563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 414/814] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:13:42 2022] PUT /identity/v3/projects/587280a3c4c54bffb4d769e406af3689/users/27e0b470f6b84df38565abf006dd8ba1/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:13:42.559425 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944391e5-8c98-4e43-bdd0-eefb826db9f8 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:42.612617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ee39a-8258-4002-818c-98d1e2167723 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:42.650386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b77ee8-653f-48e8-b3da-82d0ca6aa9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:42.651453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b77ee8-653f-48e8-b3da-82d0ca6aa9ee None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:42.651752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b77ee8-653f-48e8-b3da-82d0ca6aa9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:42.652018 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b77ee8-653f-48e8-b3da-82d0ca6aa9ee None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:42.652828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b77ee8-653f-48e8-b3da-82d0ca6aa9ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:42.653195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b77ee8-653f-48e8-b3da-82d0ca6aa9ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:42.654739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b77ee8-653f-48e8-b3da-82d0ca6aa9ee None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:42.667473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944391e5-8c98-4e43-bdd0-eefb826db9f8 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:42.667681 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 401/815] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:42.674466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b77ee8-653f-48e8-b3da-82d0ca6aa9ee None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:42.704350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f5731-2a92-4120-bc5d-05fefb46e027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:42.705142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f5731-2a92-4120-bc5d-05fefb46e027 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:42.705433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f5731-2a92-4120-bc5d-05fefb46e027 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:42.705711 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f5731-2a92-4120-bc5d-05fefb46e027 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:42.706479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f5731-2a92-4120-bc5d-05fefb46e027 None admin] RBAC: Adding query filter params (type=network) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:42.706785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f5731-2a92-4120-bc5d-05fefb46e027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:42.708182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f5731-2a92-4120-bc5d-05fefb46e027 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:42.719988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 415/816] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 5 15:13:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:42.721503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d095b75-70d6-42a6-a734-4caebfc65678 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:42.721802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d095b75-70d6-42a6-a734-4caebfc65678 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:42.722126 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d095b75-70d6-42a6-a734-4caebfc65678 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:42.726484 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 416/817] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:42.726484 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d095b75-70d6-42a6-a734-4caebfc65678 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:42.785580 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b77ee8-653f-48e8-b3da-82d0ca6aa9ee None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:42.820337 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413b4a5-c08e-488a-b16f-129f0a630908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:42.820996 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413b4a5-c08e-488a-b16f-129f0a630908 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:42.821280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413b4a5-c08e-488a-b16f-129f0a630908 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:42.821559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413b4a5-c08e-488a-b16f-129f0a630908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:42.847065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d095b75-70d6-42a6-a734-4caebfc65678 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:42.880988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c60b7a-1409-4c50-8a42-c1531f6b058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:42.881794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c60b7a-1409-4c50-8a42-c1531f6b058e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:42.882075 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c60b7a-1409-4c50-8a42-c1531f6b058e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:42.882394 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c60b7a-1409-4c50-8a42-c1531f6b058e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:42.889406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413b4a5-c08e-488a-b16f-129f0a630908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:42.889543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c60b7a-1409-4c50-8a42-c1531f6b058e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:42.890881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413b4a5-c08e-488a-b16f-129f0a630908 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:42.891005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c60b7a-1409-4c50-8a42-c1531f6b058e None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-a9c60b7a-1409-4c50-8a42-c1531f6b058e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:42.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:42.906753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:42.907635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:42.907635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:42.907635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:42.907635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:42.907635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:42.907635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:42.907635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:42.907635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:42.907635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 417/818] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:42.908107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c60b7a-1409-4c50-8a42-c1531f6b058e None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:43.000453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 402/819] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:13:43.001724 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abaf6c-5d9a-45c8-a2b7-8f39eec0d24a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:43.002017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abaf6c-5d9a-45c8-a2b7-8f39eec0d24a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:43.002330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abaf6c-5d9a-45c8-a2b7-8f39eec0d24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:43.012143 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c60b7a-1409-4c50-8a42-c1531f6b058e None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:43.018902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-70abaf6c-5d9a-45c8-a2b7-8f39eec0d24a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:43.020097 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-70abaf6c-5d9a-45c8-a2b7-8f39eec0d24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:43.047415 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b65b04-4d16-4e3b-ab1f-baa1c9b43ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:43.048078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b65b04-4d16-4e3b-ab1f-baa1c9b43ede None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:43.048360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b65b04-4d16-4e3b-ab1f-baa1c9b43ede None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:43.048636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b65b04-4d16-4e3b-ab1f-baa1c9b43ede None admin] PATH_INFO: `/v3/endpoints` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:43.049369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b65b04-4d16-4e3b-ab1f-baa1c9b43ede None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:43.050761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b65b04-4d16-4e3b-ab1f-baa1c9b43ede None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:43.084669 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 403/820] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:43.085405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abaf6c-5d9a-45c8-a2b7-8f39eec0d24a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:43.136444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 418/821] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 5 15:13:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:43.138660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b65b04-4d16-4e3b-ab1f-baa1c9b43ede None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:43.197509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abaf6c-5d9a-45c8-a2b7-8f39eec0d24a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:43.248905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f7b4-fb3a-445e-992b-3c1b9e8f259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:43.249672 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f7b4-fb3a-445e-992b-3c1b9e8f259b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:43.249959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f7b4-fb3a-445e-992b-3c1b9e8f259b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:43.250240 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f7b4-fb3a-445e-992b-3c1b9e8f259b None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:43.251426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44f7b4-fb3a-445e-992b-3c1b9e8f259b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:43.251426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44f7b4-fb3a-445e-992b-3c1b9e8f259b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:43.252899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44f7b4-fb3a-445e-992b-3c1b9e8f259b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:43.260106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b65b04-4d16-4e3b-ab1f-baa1c9b43ede None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:43.271942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 404/822] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:43.271942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f7b4-fb3a-445e-992b-3c1b9e8f259b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:43.306108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81553b-673d-4e95-a502-31f8046ef070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:43.307332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81553b-673d-4e95-a502-31f8046ef070 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:43.307823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81553b-673d-4e95-a502-31f8046ef070 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:43.308302 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81553b-673d-4e95-a502-31f8046ef070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:43.321787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81553b-673d-4e95-a502-31f8046ef070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:43.323637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81553b-673d-4e95-a502-31f8046ef070 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-de81553b-673d-4e95-a502-31f8046ef070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:43.343348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:43.344301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:43.345194 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:43.345194 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:43.345194 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:43.345194 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:43.351747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 419/823] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:43.352878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81553b-673d-4e95-a502-31f8046ef070 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:43.379631 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f7b4-fb3a-445e-992b-3c1b9e8f259b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:43.418952 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdb534-8789-4eed-bffc-4f2ab35c8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:43.420592 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdb534-8789-4eed-bffc-4f2ab35c8e40 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:43.420891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdb534-8789-4eed-bffc-4f2ab35c8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:43.421170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdb534-8789-4eed-bffc-4f2ab35c8e40 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:43.421827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdb534-8789-4eed-bffc-4f2ab35c8e40 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:43.423232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdb534-8789-4eed-bffc-4f2ab35c8e40 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-81fdb534-8789-4eed-bffc-4f2ab35c8e40 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:43.436111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:43.437120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:43.437960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 405/824] 10.222.0.44 () {56 vars in 1129 bytes} [Thu May 5 15:13:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:43.439387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdb534-8789-4eed-bffc-4f2ab35c8e40 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:43.475004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81553b-673d-4e95-a502-31f8046ef070 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:43.507225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e95a2d-8864-4a38-bc0a-ba7c53a2fcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:43.508030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e95a2d-8864-4a38-bc0a-ba7c53a2fcb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:43.508309 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e95a2d-8864-4a38-bc0a-ba7c53a2fcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:43.508579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e95a2d-8864-4a38-bc0a-ba7c53a2fcb5 None admin] PATH_INFO: `/v3/projects/587280a3c4c54bffb4d769e406af3689/users/6d5886d3fdab4730828183bd6204c6ef/roles/139847713c8a4df68a3d20babdbb75d5` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:43.522817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e95a2d-8864-4a38-bc0a-ba7c53a2fcb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=587280a3c4c54bffb4d769e406af3689, user_id=6d5886d3fdab4730828183bd6204c6ef, role_id=139847713c8a4df68a3d20babdbb75d5)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:43.524248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e95a2d-8864-4a38-bc0a-ba7c53a2fcb5 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:43.536156 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdb534-8789-4eed-bffc-4f2ab35c8e40 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:43.569123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b637e-afb9-4fd5-ad23-6721c7d489d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:43.569791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b637e-afb9-4fd5-ad23-6721c7d489d1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:43.570077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b637e-afb9-4fd5-ad23-6721c7d489d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:43.570381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b637e-afb9-4fd5-ad23-6721c7d489d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:43.571098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b637e-afb9-4fd5-ad23-6721c7d489d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:43.571436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b637e-afb9-4fd5-ad23-6721c7d489d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:43.572793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b637e-afb9-4fd5-ad23-6721c7d489d1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:43.585965 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 406/825] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:43.587031 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b637e-afb9-4fd5-ad23-6721c7d489d1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:43.598620 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 420/826] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:13:43 2022] PUT /identity/v3/projects/587280a3c4c54bffb4d769e406af3689/users/6d5886d3fdab4730828183bd6204c6ef/roles/139847713c8a4df68a3d20babdbb75d5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:13:43.599661 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e95a2d-8864-4a38-bc0a-ba7c53a2fcb5 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:43.706849 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b637e-afb9-4fd5-ad23-6721c7d489d1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:43.733643 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e95a2d-8864-4a38-bc0a-ba7c53a2fcb5 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:43.748602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d4d6b-3d0d-4c77-857f-7b4694cb7f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:43.749449 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d4d6b-3d0d-4c77-857f-7b4694cb7f19 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:43.749803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d4d6b-3d0d-4c77-857f-7b4694cb7f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:43.750153 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d4d6b-3d0d-4c77-857f-7b4694cb7f19 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:43.750972 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d4d6b-3d0d-4c77-857f-7b4694cb7f19 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:43.751367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d4d6b-3d0d-4c77-857f-7b4694cb7f19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:43.752874 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d4d6b-3d0d-4c77-857f-7b4694cb7f19 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:43.762408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 407/827] 10.222.0.44 () {56 vars in 1124 bytes} [Thu May 5 15:13:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:43.765195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d4d6b-3d0d-4c77-857f-7b4694cb7f19 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:43.783028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a884616-8191-4dd7-9936-a04e06a5b143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:43.783847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884616-8191-4dd7-9936-a04e06a5b143 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:43.784137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884616-8191-4dd7-9936-a04e06a5b143 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:43.784419 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884616-8191-4dd7-9936-a04e06a5b143 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:43.793520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a884616-8191-4dd7-9936-a04e06a5b143 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:43.795548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a884616-8191-4dd7-9936-a04e06a5b143 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-6a884616-8191-4dd7-9936-a04e06a5b143 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:43.811187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:43.812099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:43.812971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:43.812971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:43.812971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:43.812971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:43.812971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:43.812971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:43.812971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:43.812971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:43.812971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 421/828] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:43.818052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a884616-8191-4dd7-9936-a04e06a5b143 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:43.880406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d4d6b-3d0d-4c77-857f-7b4694cb7f19 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:43.920018 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ea459-7869-4518-8e66-cc60495c0766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:43.921260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ea459-7869-4518-8e66-cc60495c0766 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:43.921679 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ea459-7869-4518-8e66-cc60495c0766 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:43.921969 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ea459-7869-4518-8e66-cc60495c0766 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:43.922880 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ea459-7869-4518-8e66-cc60495c0766 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:43.923196 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ea459-7869-4518-8e66-cc60495c0766 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:43.924884 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ea459-7869-4518-8e66-cc60495c0766 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:43.931864 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 408/829] 10.222.0.44 () {56 vars in 1124 bytes} [Thu May 5 15:13:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:43.938157 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ea459-7869-4518-8e66-cc60495c0766 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:43.942431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a884616-8191-4dd7-9936-a04e06a5b143 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:43.984983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4a817-9eec-4af8-bb2e-f83578b05033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:43.985600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4a817-9eec-4af8-bb2e-f83578b05033 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:43.985884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4a817-9eec-4af8-bb2e-f83578b05033 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:43.986165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4a817-9eec-4af8-bb2e-f83578b05033 None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:43.986999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4a817-9eec-4af8-bb2e-f83578b05033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:43.987312 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4a817-9eec-4af8-bb2e-f83578b05033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:43.989300 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4a817-9eec-4af8-bb2e-f83578b05033 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:44.005860 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 422/830] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:44.011543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4a817-9eec-4af8-bb2e-f83578b05033 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:44.056278 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ea459-7869-4518-8e66-cc60495c0766 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:44.090837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3c1fc-9660-4258-8eb7-62d71430a305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:44.092526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3c1fc-9660-4258-8eb7-62d71430a305 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:44.092951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3c1fc-9660-4258-8eb7-62d71430a305 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:44.093369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3c1fc-9660-4258-8eb7-62d71430a305 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:44.094267 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3c1fc-9660-4258-8eb7-62d71430a305 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:44.095783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3c1fc-9660-4258-8eb7-62d71430a305 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:44.132927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4a817-9eec-4af8-bb2e-f83578b05033 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:44.161117 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 409/831] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 5 15:13:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:44.177052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda671e-3d97-4c36-8218-565b6b3fc472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:44.177781 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda671e-3d97-4c36-8218-565b6b3fc472 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:44.177991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda671e-3d97-4c36-8218-565b6b3fc472 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:44.178255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda671e-3d97-4c36-8218-565b6b3fc472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:44.179122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda671e-3d97-4c36-8218-565b6b3fc472 None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=eb4ff6ba4e17477d8787eaf1955bd1da) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:44.179441 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda671e-3d97-4c36-8218-565b6b3fc472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:44.181075 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda671e-3d97-4c36-8218-565b6b3fc472 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:44.188564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 423/832] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:44 2022] GET /identity/v3/role_assignments?user.id=eb4ff6ba4e17477d8787eaf1955bd1da&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:44.910647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d3f5-366e-4566-8edc-f45ec508e8ea None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:44.911155 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d3f5-366e-4566-8edc-f45ec508e8ea None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:44.911521 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d3f5-366e-4566-8edc-f45ec508e8ea None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:44.913034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 410/833] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:44.918350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f4ba1-9173-4707-a938-437f57bdf3af None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:44.918651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f4ba1-9173-4707-a938-437f57bdf3af None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:44.918924 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f4ba1-9173-4707-a938-437f57bdf3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:44.936739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a54f4ba1-9173-4707-a938-437f57bdf3af None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:44.937917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a54f4ba1-9173-4707-a938-437f57bdf3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:45.011285 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 424/834] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:45.035682 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0d3f5-366e-4566-8edc-f45ec508e8ea None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:45.138775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0d3f5-366e-4566-8edc-f45ec508e8ea None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:45.173742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f9f7a-9c13-48fc-9bee-b29231846f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:45.174635 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f9f7a-9c13-48fc-9bee-b29231846f93 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:45.174918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f9f7a-9c13-48fc-9bee-b29231846f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:45.175195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f9f7a-9c13-48fc-9bee-b29231846f93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:45.186725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f9f7a-9c13-48fc-9bee-b29231846f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-1e2f9f7a-9c13-48fc-9bee-b29231846f93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:45.194223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:45.195135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:45.195968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:45.195968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:45.195968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:45.195968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:45.195968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:45.195968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:45.195968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:45.195968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:45.195968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:45.195968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:45.195968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:13:45.195968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:45.195968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 411/835] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:13:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:45.202834 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f4ba1-9173-4707-a938-437f57bdf3af None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:45.304205 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f4ba1-9173-4707-a938-437f57bdf3af None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:45.339781 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6b577-62eb-476e-97f5-3a5bd03c59ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:45.340480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6b577-62eb-476e-97f5-3a5bd03c59ab None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:45.340760 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6b577-62eb-476e-97f5-3a5bd03c59ab None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:45.341773 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6b577-62eb-476e-97f5-3a5bd03c59ab None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:45.342661 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6b577-62eb-476e-97f5-3a5bd03c59ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:45.342966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6b577-62eb-476e-97f5-3a5bd03c59ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:45.344331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6b577-62eb-476e-97f5-3a5bd03c59ab None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:45.353319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 425/836] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:13:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:45.359177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f9f7a-9c13-48fc-9bee-b29231846f93 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:45.466825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f9f7a-9c13-48fc-9bee-b29231846f93 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:45.500293 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0d2f5-6b7d-4177-91da-01a379f4cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:45.501090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0d2f5-6b7d-4177-91da-01a379f4cb6c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:45.501369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0d2f5-6b7d-4177-91da-01a379f4cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:45.501641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0d2f5-6b7d-4177-91da-01a379f4cb6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:45.511834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0d2f5-6b7d-4177-91da-01a379f4cb6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:45.514010 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0d2f5-6b7d-4177-91da-01a379f4cb6c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-81c0d2f5-6b7d-4177-91da-01a379f4cb6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:45.532406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:45.534336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:45.539913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:45.539913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:45.539913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:45.539913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:45.539913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 412/837] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:45.540543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6b577-62eb-476e-97f5-3a5bd03c59ab None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:45.651148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6b577-62eb-476e-97f5-3a5bd03c59ab None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:45.687959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e17e6e-7e6f-4be8-bb82-0de802a1cf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:45.688649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e17e6e-7e6f-4be8-bb82-0de802a1cf24 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:45.688932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e17e6e-7e6f-4be8-bb82-0de802a1cf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:45.689209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e17e6e-7e6f-4be8-bb82-0de802a1cf24 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:45.689933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e17e6e-7e6f-4be8-bb82-0de802a1cf24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:45.690238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e17e6e-7e6f-4be8-bb82-0de802a1cf24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:45.691639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e17e6e-7e6f-4be8-bb82-0de802a1cf24 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:45.704191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 426/838] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:45.709627 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0d2f5-6b7d-4177-91da-01a379f4cb6c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:45.819466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0d2f5-6b7d-4177-91da-01a379f4cb6c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:45.853961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb2116-712e-4a35-8856-563b820e80f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:45.854861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb2116-712e-4a35-8856-563b820e80f0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:45.855147 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb2116-712e-4a35-8856-563b820e80f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:45.855421 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb2116-712e-4a35-8856-563b820e80f0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:45.863140 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb2116-712e-4a35-8856-563b820e80f0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:45.864572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb2116-712e-4a35-8856-563b820e80f0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-33cb2116-712e-4a35-8856-563b820e80f0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:45.879484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:45.881729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:45.884042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:45.884042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:45.884042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:45.884042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:45.884042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:45.884042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:45.884042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:45.884042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:45.884042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:13:45.884042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:45.884042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 413/839] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:13:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:45.890309 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e17e6e-7e6f-4be8-bb82-0de802a1cf24 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:45.976765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee6f5a-8575-469b-b55a-fcd6061b0047 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:45.977398 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee6f5a-8575-469b-b55a-fcd6061b0047 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:45.977398 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee6f5a-8575-469b-b55a-fcd6061b0047 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:45.982986 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 414/840] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:45.985399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca89c3-8972-4118-a094-cd208c31362a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:45.985689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca89c3-8972-4118-a094-cd208c31362a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:45.985970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca89c3-8972-4118-a094-cd208c31362a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:45.991624 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e17e6e-7e6f-4be8-bb82-0de802a1cf24 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:46.003802 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c3ca89c3-8972-4118-a094-cd208c31362a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:46.005124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c3ca89c3-8972-4118-a094-cd208c31362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:46.035347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d011b38-6ab6-4292-84b6-2c87e3387087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:46.036035 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d011b38-6ab6-4292-84b6-2c87e3387087 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:46.036571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d011b38-6ab6-4292-84b6-2c87e3387087 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:46.036848 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d011b38-6ab6-4292-84b6-2c87e3387087 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:46.037685 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d011b38-6ab6-4292-84b6-2c87e3387087 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:46.037991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d011b38-6ab6-4292-84b6-2c87e3387087 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:46.039452 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d011b38-6ab6-4292-84b6-2c87e3387087 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:46.063822 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 427/841] 10.222.0.44 () {56 vars in 1135 bytes} [Thu May 5 15:13:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:46.065191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d011b38-6ab6-4292-84b6-2c87e3387087 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:46.086489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 415/842] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:13:46.115248 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca89c3-8972-4118-a094-cd208c31362a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:46.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d011b38-6ab6-4292-84b6-2c87e3387087 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:46.223055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca89c3-8972-4118-a094-cd208c31362a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:46.233480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dcb9d-4184-498f-a60b-a5fe45da48ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:46.234088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dcb9d-4184-498f-a60b-a5fe45da48ee None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:46.234748 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dcb9d-4184-498f-a60b-a5fe45da48ee None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:46.235089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dcb9d-4184-498f-a60b-a5fe45da48ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:46.260221 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4b318-d1b9-4ec4-90ea-15f7c9395744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:46.261025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4b318-d1b9-4ec4-90ea-15f7c9395744 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:46.261306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4b318-d1b9-4ec4-90ea-15f7c9395744 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:46.261584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4b318-d1b9-4ec4-90ea-15f7c9395744 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:46.272235 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4b318-d1b9-4ec4-90ea-15f7c9395744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c1e4b318-d1b9-4ec4-90ea-15f7c9395744 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:46.280269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:46.282428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:46.284404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:46.284404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:46.284404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:46.284404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:46.284404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:46.284404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:46.284404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:46.284404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:46.284404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:46.284404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:46.284404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:13:46.284404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:46.290388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 416/843] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:13:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:46.290388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4b318-d1b9-4ec4-90ea-15f7c9395744 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:46.316638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12dcb9d-4184-498f-a60b-a5fe45da48ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:46.318227 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12dcb9d-4184-498f-a60b-a5fe45da48ee None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:46.415978 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4b318-d1b9-4ec4-90ea-15f7c9395744 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:46.426328 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 428/844] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 15:13:46.432867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dcb9d-4184-498f-a60b-a5fe45da48ee None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:46.459866 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff57c6-4524-4a88-a476-139a7ac0dac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:46.460418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff57c6-4524-4a88-a476-139a7ac0dac3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:46.460707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff57c6-4524-4a88-a476-139a7ac0dac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:46.460989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff57c6-4524-4a88-a476-139a7ac0dac3 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:46.461741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff57c6-4524-4a88-a476-139a7ac0dac3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:46.462051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff57c6-4524-4a88-a476-139a7ac0dac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:46.463455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff57c6-4524-4a88-a476-139a7ac0dac3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:46.477458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 417/845] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:13:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:46.478853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff57c6-4524-4a88-a476-139a7ac0dac3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:46.540692 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dcb9d-4184-498f-a60b-a5fe45da48ee None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:46.577152 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26496fd-85d8-480f-bb4a-69efadfdd977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:46.578335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26496fd-85d8-480f-bb4a-69efadfdd977 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:46.578815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26496fd-85d8-480f-bb4a-69efadfdd977 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:46.579273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26496fd-85d8-480f-bb4a-69efadfdd977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:46.582966 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff57c6-4524-4a88-a476-139a7ac0dac3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:46.590110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26496fd-85d8-480f-bb4a-69efadfdd977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:46.592136 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26496fd-85d8-480f-bb4a-69efadfdd977 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-d26496fd-85d8-480f-bb4a-69efadfdd977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:46.610557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:46.611509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:46.612433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:46.612433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:46.612433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:46.612433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:46.612433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 429/846] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:46.613144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e5156-6ffc-4d43-a3b6-9778c07cb7e0 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:46.613599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e5156-6ffc-4d43-a3b6-9778c07cb7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:46.613710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e5156-6ffc-4d43-a3b6-9778c07cb7e0 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:46.615278 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 430/847] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:46.617010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e5156-6ffc-4d43-a3b6-9778c07cb7e0 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:46.624433 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9cb28-3567-4fde-93d9-32d151d105b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:46.625253 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9cb28-3567-4fde-93d9-32d151d105b6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:46.625536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9cb28-3567-4fde-93d9-32d151d105b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:46.625814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9cb28-3567-4fde-93d9-32d151d105b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:46.636453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9cb28-3567-4fde-93d9-32d151d105b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:46.639183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9cb28-3567-4fde-93d9-32d151d105b6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6bd9cb28-3567-4fde-93d9-32d151d105b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:46.656659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:46.657583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:46.658501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:46.658501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:46.658501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:46.658501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:46.658501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 418/848] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:46.659055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3953e-9f34-43bb-91ac-9f51835b46ab None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:46.659336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3953e-9f34-43bb-91ac-9f51835b46ab None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:46.659633 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3953e-9f34-43bb-91ac-9f51835b46ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:46.678580 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bea3953e-9f34-43bb-91ac-9f51835b46ab None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:46.679774 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bea3953e-9f34-43bb-91ac-9f51835b46ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:46.724411 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e5156-6ffc-4d43-a3b6-9778c07cb7e0 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:46.746546 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 419/849] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:46.749204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a670d6-818c-4f93-8374-0f86d1d35521 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:46.749496 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a670d6-818c-4f93-8374-0f86d1d35521 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:46.749774 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a670d6-818c-4f93-8374-0f86d1d35521 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:46.753632 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 420/850] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:46.753632 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a670d6-818c-4f93-8374-0f86d1d35521 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:46.767118 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f4be5-1655-46e4-9e8b-6c5f96d9de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:46.767796 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f4be5-1655-46e4-9e8b-6c5f96d9de40 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:46.768084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f4be5-1655-46e4-9e8b-6c5f96d9de40 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:46.768366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f4be5-1655-46e4-9e8b-6c5f96d9de40 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:46.769096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f4be5-1655-46e4-9e8b-6c5f96d9de40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:46.769408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f4be5-1655-46e4-9e8b-6c5f96d9de40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:46.770907 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f4be5-1655-46e4-9e8b-6c5f96d9de40 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:46.782724 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 431/851] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:46.784096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012517d1-a5e9-41f2-b1ef-b76aaa2f1f57 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:46.784392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012517d1-a5e9-41f2-b1ef-b76aaa2f1f57 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:46.784676 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012517d1-a5e9-41f2-b1ef-b76aaa2f1f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:46.801125 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-012517d1-a5e9-41f2-b1ef-b76aaa2f1f57 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:46.802244 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-012517d1-a5e9-41f2-b1ef-b76aaa2f1f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:46.852896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a670d6-818c-4f93-8374-0f86d1d35521 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:46.865353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 432/852] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:46.866186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012517d1-a5e9-41f2-b1ef-b76aaa2f1f57 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:46.896117 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d2c94-2b69-40e0-b117-fc72e5e1c403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:46.896787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2c94-2b69-40e0-b117-fc72e5e1c403 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:46.897073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2c94-2b69-40e0-b117-fc72e5e1c403 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:46.897354 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2c94-2b69-40e0-b117-fc72e5e1c403 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:46.898070 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d2c94-2b69-40e0-b117-fc72e5e1c403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:46.898412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d2c94-2b69-40e0-b117-fc72e5e1c403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:46.899780 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d2c94-2b69-40e0-b117-fc72e5e1c403 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:46.910974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 421/853] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:46.912026 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d2c94-2b69-40e0-b117-fc72e5e1c403 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:46.961524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012517d1-a5e9-41f2-b1ef-b76aaa2f1f57 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:46.996076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea07dc8-4cf5-42da-b996-c254a82d33cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:46.996888 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07dc8-4cf5-42da-b996-c254a82d33cb None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:46.998121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07dc8-4cf5-42da-b996-c254a82d33cb None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:46.998435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07dc8-4cf5-42da-b996-c254a82d33cb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:46.999090 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea07dc8-4cf5-42da-b996-c254a82d33cb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.000443 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea07dc8-4cf5-42da-b996-c254a82d33cb None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.011048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d2c94-2b69-40e0-b117-fc72e5e1c403 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-fea07dc8-4cf5-42da-b996-c254a82d33cb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:47.012225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:47.013468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:47.014409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 433/854] 10.222.0.44 () {56 vars in 1132 bytes} [Thu May 5 15:13:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:47.016134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea07dc8-4cf5-42da-b996-c254a82d33cb None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.043368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98b5a5-43d7-41dc-997c-49a3802b1e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.044864 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b5a5-43d7-41dc-997c-49a3802b1e50 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.045146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b5a5-43d7-41dc-997c-49a3802b1e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.045422 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b5a5-43d7-41dc-997c-49a3802b1e50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.051908 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98b5a5-43d7-41dc-997c-49a3802b1e50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.053286 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98b5a5-43d7-41dc-997c-49a3802b1e50 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-bd98b5a5-43d7-41dc-997c-49a3802b1e50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:47.068128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:47.069203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:47.070510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:47.070510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:47.070510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:47.070510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:47.070510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:47.070510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:47.070510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:47.070510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:47.070510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 422/855] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:47.071147 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98b5a5-43d7-41dc-997c-49a3802b1e50 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.116462 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea07dc8-4cf5-42da-b996-c254a82d33cb None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.148111 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fdc5d-16fe-45b8-97c2-1673054a3bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.148912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fdc5d-16fe-45b8-97c2-1673054a3bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.149199 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fdc5d-16fe-45b8-97c2-1673054a3bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.149479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fdc5d-16fe-45b8-97c2-1673054a3bd0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.150133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fdc5d-16fe-45b8-97c2-1673054a3bd0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.151608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fdc5d-16fe-45b8-97c2-1673054a3bd0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.163967 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98b5a5-43d7-41dc-997c-49a3802b1e50 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-834fdc5d-16fe-45b8-97c2-1673054a3bd0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:47.164192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:47.165238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:47.166063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 434/856] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:47.167254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fdc5d-16fe-45b8-97c2-1673054a3bd0 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.196627 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc9ca7-ac25-4807-a1ad-d08f78f67c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.197426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc9ca7-ac25-4807-a1ad-d08f78f67c2b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.197703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc9ca7-ac25-4807-a1ad-d08f78f67c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.197976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc9ca7-ac25-4807-a1ad-d08f78f67c2b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.205335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc9ca7-ac25-4807-a1ad-d08f78f67c2b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.206828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc9ca7-ac25-4807-a1ad-d08f78f67c2b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c1bc9ca7-ac25-4807-a1ad-d08f78f67c2b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:47.221989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:47.222955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:47.223870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:47.223870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:47.223870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:47.223870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:47.223870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:47.223870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:47.223870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:47.223870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:47.223870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:13:47.223870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:47.223870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 423/857] 10.222.0.44 () {56 vars in 1117 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:47.224479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc9ca7-ac25-4807-a1ad-d08f78f67c2b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.266345 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fdc5d-16fe-45b8-97c2-1673054a3bd0 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.301228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c746e3-f05e-4fb3-877f-4d7039231a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.301887 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c746e3-f05e-4fb3-877f-4d7039231a9b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.302220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c746e3-f05e-4fb3-877f-4d7039231a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.302475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c746e3-f05e-4fb3-877f-4d7039231a9b None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.303179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c746e3-f05e-4fb3-877f-4d7039231a9b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:47.303487 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c746e3-f05e-4fb3-877f-4d7039231a9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.304859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c746e3-f05e-4fb3-877f-4d7039231a9b None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.309160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 435/858] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:47.311139 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c746e3-f05e-4fb3-877f-4d7039231a9b None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.324279 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc9ca7-ac25-4807-a1ad-d08f78f67c2b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.357940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7c930-5d3b-4625-9207-887c8df53898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.358634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7c930-5d3b-4625-9207-887c8df53898 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.358918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7c930-5d3b-4625-9207-887c8df53898 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.359199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7c930-5d3b-4625-9207-887c8df53898 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.359980 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7c930-5d3b-4625-9207-887c8df53898 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:47.360289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7c930-5d3b-4625-9207-887c8df53898 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.361714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7c930-5d3b-4625-9207-887c8df53898 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.373417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 424/859] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:47.374214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7c930-5d3b-4625-9207-887c8df53898 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.408130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c746e3-f05e-4fb3-877f-4d7039231a9b None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.440943 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d38f8-7547-4a13-930a-3e1b589a97ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.441611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d38f8-7547-4a13-930a-3e1b589a97ea None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.441895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d38f8-7547-4a13-930a-3e1b589a97ea None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.442170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d38f8-7547-4a13-930a-3e1b589a97ea None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.442897 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d38f8-7547-4a13-930a-3e1b589a97ea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:47.443208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d38f8-7547-4a13-930a-3e1b589a97ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.444569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d38f8-7547-4a13-930a-3e1b589a97ea None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.448834 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 436/860] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:47.449609 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d38f8-7547-4a13-930a-3e1b589a97ea None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.474620 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7c930-5d3b-4625-9207-887c8df53898 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.506809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893bee3-ae71-4d8d-8398-2f03c08241c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.507472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893bee3-ae71-4d8d-8398-2f03c08241c8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.507757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893bee3-ae71-4d8d-8398-2f03c08241c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.508033 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893bee3-ae71-4d8d-8398-2f03c08241c8 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.508857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893bee3-ae71-4d8d-8398-2f03c08241c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:47.509171 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893bee3-ae71-4d8d-8398-2f03c08241c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.510623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893bee3-ae71-4d8d-8398-2f03c08241c8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.527691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 425/861] 10.222.0.44 () {56 vars in 1149 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:47.529082 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893bee3-ae71-4d8d-8398-2f03c08241c8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.546836 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d38f8-7547-4a13-930a-3e1b589a97ea None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.579733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca63357-eab9-4ecc-af2e-e2f9f8363add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.580337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca63357-eab9-4ecc-af2e-e2f9f8363add None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.580622 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca63357-eab9-4ecc-af2e-e2f9f8363add None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.580903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca63357-eab9-4ecc-af2e-e2f9f8363add None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.581608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca63357-eab9-4ecc-af2e-e2f9f8363add None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:47.581917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca63357-eab9-4ecc-af2e-e2f9f8363add None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.583320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca63357-eab9-4ecc-af2e-e2f9f8363add None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.587658 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 437/862] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:47.588434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca63357-eab9-4ecc-af2e-e2f9f8363add None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.627454 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893bee3-ae71-4d8d-8398-2f03c08241c8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.668096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed817f-1669-4427-b03d-de970bc9a1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.668769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed817f-1669-4427-b03d-de970bc9a1cb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.669088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed817f-1669-4427-b03d-de970bc9a1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.669370 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed817f-1669-4427-b03d-de970bc9a1cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.670208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed817f-1669-4427-b03d-de970bc9a1cb None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=27e0b470f6b84df38565abf006dd8ba1) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:47.670560 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed817f-1669-4427-b03d-de970bc9a1cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.672349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed817f-1669-4427-b03d-de970bc9a1cb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.689942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 426/863] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/role_assignments?user.id=27e0b470f6b84df38565abf006dd8ba1&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:47.689942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed817f-1669-4427-b03d-de970bc9a1cb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:47.727051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca63357-eab9-4ecc-af2e-e2f9f8363add None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.775938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b36654-b510-4164-bcf9-ec299ba5fc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.776696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b36654-b510-4164-bcf9-ec299ba5fc0c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.777718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b36654-b510-4164-bcf9-ec299ba5fc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.777718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b36654-b510-4164-bcf9-ec299ba5fc0c None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.778109 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b36654-b510-4164-bcf9-ec299ba5fc0c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:47.779153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b36654-b510-4164-bcf9-ec299ba5fc0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.780754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b36654-b510-4164-bcf9-ec299ba5fc0c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:47.790803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 438/864] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:47.814798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed817f-1669-4427-b03d-de970bc9a1cb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:47.857181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a14e-9ce7-4894-a7d9-d25f6bc15403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:47.857802 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a14e-9ce7-4894-a7d9-d25f6bc15403 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:47.858090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a14e-9ce7-4894-a7d9-d25f6bc15403 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:47.858407 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a14e-9ce7-4894-a7d9-d25f6bc15403 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:47.939933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370a14e-9ce7-4894-a7d9-d25f6bc15403 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:47.941436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370a14e-9ce7-4894-a7d9-d25f6bc15403 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:48.046541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 427/865] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:13:48.052069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b36654-b510-4164-bcf9-ec299ba5fc0c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:48.152109 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b36654-b510-4164-bcf9-ec299ba5fc0c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:48.191708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5e1f2-d94b-4b5b-8abc-170ef9e6d177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:48.192525 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5e1f2-d94b-4b5b-8abc-170ef9e6d177 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:48.192809 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5e1f2-d94b-4b5b-8abc-170ef9e6d177 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:48.193090 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5e1f2-d94b-4b5b-8abc-170ef9e6d177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:48.204497 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5e1f2-d94b-4b5b-8abc-170ef9e6d177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:48.205945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5e1f2-d94b-4b5b-8abc-170ef9e6d177 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-f6a5e1f2-d94b-4b5b-8abc-170ef9e6d177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:48.223775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:48.224671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:48.225539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:48.225539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:48.225539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:48.225539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:48.225539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 439/866] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:48.230494 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a14e-9ce7-4894-a7d9-d25f6bc15403 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:48.337023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a14e-9ce7-4894-a7d9-d25f6bc15403 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:48.375743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65d620-2420-44eb-a2d7-53b66bcdf6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:48.376777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65d620-2420-44eb-a2d7-53b66bcdf6cb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:48.377257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65d620-2420-44eb-a2d7-53b66bcdf6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:48.377751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65d620-2420-44eb-a2d7-53b66bcdf6cb None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:48.378693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65d620-2420-44eb-a2d7-53b66bcdf6cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:48.379211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65d620-2420-44eb-a2d7-53b66bcdf6cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:48.380858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65d620-2420-44eb-a2d7-53b66bcdf6cb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:48.392893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 428/867] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:48.402363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5e1f2-d94b-4b5b-8abc-170ef9e6d177 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:48.501284 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5e1f2-d94b-4b5b-8abc-170ef9e6d177 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:48.536628 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3695c5-02e8-42f7-b36a-5ffebe580e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:48.537440 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3695c5-02e8-42f7-b36a-5ffebe580e9d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:48.537731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3695c5-02e8-42f7-b36a-5ffebe580e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:48.538008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3695c5-02e8-42f7-b36a-5ffebe580e9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:48.545256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3695c5-02e8-42f7-b36a-5ffebe580e9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:48.546740 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3695c5-02e8-42f7-b36a-5ffebe580e9d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-ee3695c5-02e8-42f7-b36a-5ffebe580e9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:48.561933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:48.562911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:48.563785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:48.563785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:48.563785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:48.563785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:48.563785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:48.563785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:48.563785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:48.563785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:48.563785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 440/868] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:48.569139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65d620-2420-44eb-a2d7-53b66bcdf6cb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:48.674585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65d620-2420-44eb-a2d7-53b66bcdf6cb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:48.708721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72639c-ed67-4f34-885c-f692da512cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:48.709756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72639c-ed67-4f34-885c-f692da512cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:48.710252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72639c-ed67-4f34-885c-f692da512cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:48.710768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72639c-ed67-4f34-885c-f692da512cd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:48.711751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72639c-ed67-4f34-885c-f692da512cd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:48.712252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72639c-ed67-4f34-885c-f692da512cd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:48.713857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72639c-ed67-4f34-885c-f692da512cd1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:48.727345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 429/869] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:48.738343 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3695c5-02e8-42f7-b36a-5ffebe580e9d None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:48.849032 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3695c5-02e8-42f7-b36a-5ffebe580e9d None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:48.884264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a509c8e-4938-41da-99d4-989b67042197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:48.884927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a509c8e-4938-41da-99d4-989b67042197 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:48.885209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a509c8e-4938-41da-99d4-989b67042197 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:48.885485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a509c8e-4938-41da-99d4-989b67042197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:48.886343 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a509c8e-4938-41da-99d4-989b67042197 None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=6d5886d3fdab4730828183bd6204c6ef) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:48.886667 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a509c8e-4938-41da-99d4-989b67042197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:48.888214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a509c8e-4938-41da-99d4-989b67042197 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:48.894557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 441/870] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:48 2022] GET /identity/v3/role_assignments?user.id=6d5886d3fdab4730828183bd6204c6ef&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:49.984797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979bafb-ef4b-4090-9259-d60ca35aedcc None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:49.985359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979bafb-ef4b-4090-9259-d60ca35aedcc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:49.985359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979bafb-ef4b-4090-9259-d60ca35aedcc None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:49.987088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 430/871] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:49.992911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e4168-284f-4df4-b4f7-84997f8cacb5 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:49.993471 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e4168-284f-4df4-b4f7-84997f8cacb5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:49.993471 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e4168-284f-4df4-b4f7-84997f8cacb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:50.011166 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-c21e4168-284f-4df4-b4f7-84997f8cacb5 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:50.012423 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c21e4168-284f-4df4-b4f7-84997f8cacb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:50.059085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2aea8-a442-4d75-9778-78be4ea0d7f9 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:50.059470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2aea8-a442-4d75-9778-78be4ea0d7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:50.060222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2aea8-a442-4d75-9778-78be4ea0d7f9 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:50.063157 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 431/872] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:50.067276 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb4c1d-58bf-4fa7-b531-585cc5da798d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:50.067562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb4c1d-58bf-4fa7-b531-585cc5da798d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:50.067839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb4c1d-58bf-4fa7-b531-585cc5da798d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:50.083052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 442/873] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:50.084926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-dacb4c1d-58bf-4fa7-b531-585cc5da798d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:50.086208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dacb4c1d-58bf-4fa7-b531-585cc5da798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:50.107099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e4168-284f-4df4-b4f7-84997f8cacb5 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:50.162405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 432/874] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:13:50.167016 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980868-c0e4-4b72-9a08-e8d89f49d9dd None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:50.167311 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980868-c0e4-4b72-9a08-e8d89f49d9dd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:50.167594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980868-c0e4-4b72-9a08-e8d89f49d9dd None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:50.169298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 433/875] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:13:50.174051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902d728-af1d-457d-89b8-63361986bebf None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:50.174366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902d728-af1d-457d-89b8-63361986bebf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:50.174650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902d728-af1d-457d-89b8-63361986bebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:50.193511 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0902d728-af1d-457d-89b8-63361986bebf None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:50.194739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0902d728-af1d-457d-89b8-63361986bebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:50.212106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e4168-284f-4df4-b4f7-84997f8cacb5 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:50.249784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405631a7-246f-4742-beec-0626f2024b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:50.250484 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405631a7-246f-4742-beec-0626f2024b90 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:50.250937 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405631a7-246f-4742-beec-0626f2024b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:50.251219 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405631a7-246f-4742-beec-0626f2024b90 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:50.252511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405631a7-246f-4742-beec-0626f2024b90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:50.254359 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405631a7-246f-4742-beec-0626f2024b90 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:50.260982 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 434/876] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:13:50.261816 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902d728-af1d-457d-89b8-63361986bebf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:50.332158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 443/877] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:13:50 2022] POST /identity/v3/services => generated 269 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:50.334080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405631a7-246f-4742-beec-0626f2024b90 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:50.381249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902d728-af1d-457d-89b8-63361986bebf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:50.439711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53761d41-df34-4780-afc5-05bb8bdd5d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:50.440565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53761d41-df34-4780-afc5-05bb8bdd5d91 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:50.440850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53761d41-df34-4780-afc5-05bb8bdd5d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:50.441124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53761d41-df34-4780-afc5-05bb8bdd5d91 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:50.441796 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53761d41-df34-4780-afc5-05bb8bdd5d91 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:50.443713 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53761d41-df34-4780-afc5-05bb8bdd5d91 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-53761d41-df34-4780-afc5-05bb8bdd5d91 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:50.459308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:50.460420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:50.461325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 435/878] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 5 15:13:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:50.468174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53761d41-df34-4780-afc5-05bb8bdd5d91 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:50.479357 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405631a7-246f-4742-beec-0626f2024b90 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:50.519094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80828e-eae0-44c1-951e-c8b6599f9839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:50.519094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80828e-eae0-44c1-951e-c8b6599f9839 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:50.519410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80828e-eae0-44c1-951e-c8b6599f9839 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:50.519640 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80828e-eae0-44c1-951e-c8b6599f9839 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:50.520347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80828e-eae0-44c1-951e-c8b6599f9839 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:50.521725 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80828e-eae0-44c1-951e-c8b6599f9839 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:50.593253 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53761d41-df34-4780-afc5-05bb8bdd5d91 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:50.624671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 444/879] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:13:50 2022] POST /identity/v3/services => generated 251 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:50.637470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba87d6-911f-4683-a924-2be17dedc3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:50.638856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba87d6-911f-4683-a924-2be17dedc3cb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:50.639698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba87d6-911f-4683-a924-2be17dedc3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:50.639698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba87d6-911f-4683-a924-2be17dedc3cb None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:50.640232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba87d6-911f-4683-a924-2be17dedc3cb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:50.640547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba87d6-911f-4683-a924-2be17dedc3cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:50.642071 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba87d6-911f-4683-a924-2be17dedc3cb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:50.648465 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 436/880] 10.222.0.44 () {56 vars in 1122 bytes} [Thu May 5 15:13:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:50.655590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80828e-eae0-44c1-951e-c8b6599f9839 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:50.776185 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80828e-eae0-44c1-951e-c8b6599f9839 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:50.813337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00d9f6-dbeb-4a3e-ad94-5000db0569e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:50.814031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d9f6-dbeb-4a3e-ad94-5000db0569e9 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:50.814342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d9f6-dbeb-4a3e-ad94-5000db0569e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:50.814628 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d9f6-dbeb-4a3e-ad94-5000db0569e9 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:50.815353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00d9f6-dbeb-4a3e-ad94-5000db0569e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:50.815665 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00d9f6-dbeb-4a3e-ad94-5000db0569e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:50.817056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00d9f6-dbeb-4a3e-ad94-5000db0569e9 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:50.822580 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 445/881] 10.222.0.44 () {56 vars in 1122 bytes} [Thu May 5 15:13:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:51.303609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5c1ae-d290-4e6a-9bae-ea7411e355ae None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:51.304125 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5c1ae-d290-4e6a-9bae-ea7411e355ae None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:51.304234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5c1ae-d290-4e6a-9bae-ea7411e355ae None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:51.305833 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 437/882] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:51.310938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3acc4-f301-425d-95a2-06c2753b054f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:51.311755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3acc4-f301-425d-95a2-06c2753b054f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:51.312248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3acc4-f301-425d-95a2-06c2753b054f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:51.329932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-7ea3acc4-f301-425d-95a2-06c2753b054f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:51.331484 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7ea3acc4-f301-425d-95a2-06c2753b054f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:51.398679 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 446/883] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:13:51.422697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5c1ae-d290-4e6a-9bae-ea7411e355ae None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:51.528052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5c1ae-d290-4e6a-9bae-ea7411e355ae None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:51.564829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520fced-c65f-4128-a826-81b7ee21b6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:51.565987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520fced-c65f-4128-a826-81b7ee21b6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:51.566545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520fced-c65f-4128-a826-81b7ee21b6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:51.567051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520fced-c65f-4128-a826-81b7ee21b6a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:51.578351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520fced-c65f-4128-a826-81b7ee21b6a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-0520fced-c65f-4128-a826-81b7ee21b6a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:51.586805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:51.587756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:51.588590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:51.588590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:51.588590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:51.588590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:51.588590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:51.588590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:51.588590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:51.588590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:51.588590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:51.588590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:51.588590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:13:51.588590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:51.588590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 438/884] 10.222.0.44 () {56 vars in 1120 bytes} [Thu May 5 15:13:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:51.595839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3acc4-f301-425d-95a2-06c2753b054f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:51.695273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3acc4-f301-425d-95a2-06c2753b054f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:51.732793 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c62a75-5020-49f3-ac6f-3bfb31dc358c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:51.733869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c62a75-5020-49f3-ac6f-3bfb31dc358c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:51.734415 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c62a75-5020-49f3-ac6f-3bfb31dc358c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:51.734913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c62a75-5020-49f3-ac6f-3bfb31dc358c None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:51.735864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c62a75-5020-49f3-ac6f-3bfb31dc358c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:51.736371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c62a75-5020-49f3-ac6f-3bfb31dc358c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:51.737943 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c62a75-5020-49f3-ac6f-3bfb31dc358c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:51.750648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 447/885] 10.222.0.44 () {56 vars in 1115 bytes} [Thu May 5 15:13:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:51.752476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520fced-c65f-4128-a826-81b7ee21b6a4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:51.864279 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520fced-c65f-4128-a826-81b7ee21b6a4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:51.897942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ac442-d1e6-4de7-9acd-84c19ac8c237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:51.898775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ac442-d1e6-4de7-9acd-84c19ac8c237 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:51.899063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ac442-d1e6-4de7-9acd-84c19ac8c237 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:51.899342 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ac442-d1e6-4de7-9acd-84c19ac8c237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:51.911073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ac442-d1e6-4de7-9acd-84c19ac8c237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:51.912783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ac442-d1e6-4de7-9acd-84c19ac8c237 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-8e3ac442-d1e6-4de7-9acd-84c19ac8c237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:51.930186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:51.931132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:51.932003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:51.932003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:51.932003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:51.932003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:51.932003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 439/886] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:51.937584 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c62a75-5020-49f3-ac6f-3bfb31dc358c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:52.041884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c62a75-5020-49f3-ac6f-3bfb31dc358c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:52.076811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d0186-ea93-4182-acdf-025831746d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:52.077487 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d0186-ea93-4182-acdf-025831746d64 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:52.077773 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d0186-ea93-4182-acdf-025831746d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:52.078051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d0186-ea93-4182-acdf-025831746d64 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:52.078810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d0186-ea93-4182-acdf-025831746d64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:52.079116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d0186-ea93-4182-acdf-025831746d64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:52.080497 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d0186-ea93-4182-acdf-025831746d64 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:52.093380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 448/887] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:52.098815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ac442-d1e6-4de7-9acd-84c19ac8c237 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:52.200486 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ac442-d1e6-4de7-9acd-84c19ac8c237 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:52.237208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdeded-334a-4cba-8289-6d3ef5a125c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:52.238029 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdeded-334a-4cba-8289-6d3ef5a125c5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:52.238327 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdeded-334a-4cba-8289-6d3ef5a125c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:52.238609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdeded-334a-4cba-8289-6d3ef5a125c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:52.246420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdeded-334a-4cba-8289-6d3ef5a125c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:52.248477 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdeded-334a-4cba-8289-6d3ef5a125c5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f6bdeded-334a-4cba-8289-6d3ef5a125c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:52.263695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:52.265885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:52.268132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:52.268132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:52.268132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:52.268132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:52.268132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:52.268132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:52.268132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:52.268132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:52.268132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:13:52.268132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:52.268132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 440/888] 10.222.0.44 () {56 vars in 1117 bytes} [Thu May 5 15:13:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:52.274306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d0186-ea93-4182-acdf-025831746d64 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:52.371356 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d0186-ea93-4182-acdf-025831746d64 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:52.406150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13464a8-47ee-4542-8ede-0430f2d18f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:52.406862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13464a8-47ee-4542-8ede-0430f2d18f64 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:52.407149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13464a8-47ee-4542-8ede-0430f2d18f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:52.407427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13464a8-47ee-4542-8ede-0430f2d18f64 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:52.408271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13464a8-47ee-4542-8ede-0430f2d18f64 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:52.408581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13464a8-47ee-4542-8ede-0430f2d18f64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:52.410019 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13464a8-47ee-4542-8ede-0430f2d18f64 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:52.428745 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 449/889] 10.222.0.44 () {56 vars in 1149 bytes} [Thu May 5 15:13:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:52.434231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdeded-334a-4cba-8289-6d3ef5a125c5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:52.541093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdeded-334a-4cba-8289-6d3ef5a125c5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:52.576839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817b478-499c-4859-bc82-fd8cc3a093e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:52.577498 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817b478-499c-4859-bc82-fd8cc3a093e3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:52.577780 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817b478-499c-4859-bc82-fd8cc3a093e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:52.578056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817b478-499c-4859-bc82-fd8cc3a093e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:52.647868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817b478-499c-4859-bc82-fd8cc3a093e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:52.649490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817b478-499c-4859-bc82-fd8cc3a093e3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:52.713792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756051e-aa1d-4ef8-b03b-55ef3a7f357d None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:52.714148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756051e-aa1d-4ef8-b03b-55ef3a7f357d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:52.714390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756051e-aa1d-4ef8-b03b-55ef3a7f357d None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:52.715935 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 450/890] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:13:52.721655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f37104-fe89-4d80-bae2-66d06dfe4e41 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:52.721947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f37104-fe89-4d80-bae2-66d06dfe4e41 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:52.722229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f37104-fe89-4d80-bae2-66d06dfe4e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:52.739689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-d2f37104-fe89-4d80-bae2-66d06dfe4e41 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:52.740885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d2f37104-fe89-4d80-bae2-66d06dfe4e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:52.757230 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 441/891] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:13:52 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:13:52.763490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817b478-499c-4859-bc82-fd8cc3a093e3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:52.834416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 451/892] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:52.856745 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f37104-fe89-4d80-bae2-66d06dfe4e41 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:52.890683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817b478-499c-4859-bc82-fd8cc3a093e3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:52.934017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb315a65-6107-4f24-84d9-a3e5755a334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:52.934967 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb315a65-6107-4f24-84d9-a3e5755a334d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:52.935247 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb315a65-6107-4f24-84d9-a3e5755a334d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:52.935532 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb315a65-6107-4f24-84d9-a3e5755a334d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:52.953616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb315a65-6107-4f24-84d9-a3e5755a334d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:52.957032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb315a65-6107-4f24-84d9-a3e5755a334d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:52.961128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f37104-fe89-4d80-bae2-66d06dfe4e41 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-bb315a65-6107-4f24-84d9-a3e5755a334d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:52.980199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:52.981826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:52.982974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:52.982974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:52.982974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:52.982974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:52.989980 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 442/893] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:52.991519 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb315a65-6107-4f24-84d9-a3e5755a334d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.002023 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15efcd2-530d-4100-849d-798ca05eb4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.003027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15efcd2-530d-4100-849d-798ca05eb4fb None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.003216 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15efcd2-530d-4100-849d-798ca05eb4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.003496 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15efcd2-530d-4100-849d-798ca05eb4fb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.004161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15efcd2-530d-4100-849d-798ca05eb4fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.005534 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15efcd2-530d-4100-849d-798ca05eb4fb None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-b15efcd2-530d-4100-849d-798ca05eb4fb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:53.019193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:53.020235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:53.021070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 452/894] 10.222.0.44 () {56 vars in 1132 bytes} [Thu May 5 15:13:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:53.022739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddf922-edf8-46e7-a5aa-f39ca38c070b None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.022739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddf922-edf8-46e7-a5aa-f39ca38c070b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.022739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddf922-edf8-46e7-a5aa-f39ca38c070b None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.028500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 453/895] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:53.028500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddf922-edf8-46e7-a5aa-f39ca38c070b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.105492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb315a65-6107-4f24-84d9-a3e5755a334d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:53.130581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddf922-edf8-46e7-a5aa-f39ca38c070b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:53.140289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09f2d7-1477-4164-85cc-26a17f36ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.140957 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09f2d7-1477-4164-85cc-26a17f36ae7a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.141246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09f2d7-1477-4164-85cc-26a17f36ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.141524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09f2d7-1477-4164-85cc-26a17f36ae7a None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.142247 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09f2d7-1477-4164-85cc-26a17f36ae7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:53.142586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09f2d7-1477-4164-85cc-26a17f36ae7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.143950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09f2d7-1477-4164-85cc-26a17f36ae7a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.160387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 443/896] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:53.160387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba048c-f609-4910-ac7b-42e67d6a1576 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.160387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba048c-f609-4910-ac7b-42e67d6a1576 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.160387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba048c-f609-4910-ac7b-42e67d6a1576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.170402 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d969be2-b1ff-4eed-a4f1-48e6e1ad8ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.171074 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d969be2-b1ff-4eed-a4f1-48e6e1ad8ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.171360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d969be2-b1ff-4eed-a4f1-48e6e1ad8ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.171632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d969be2-b1ff-4eed-a4f1-48e6e1ad8ff7 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.172338 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d969be2-b1ff-4eed-a4f1-48e6e1ad8ff7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:53.172643 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d969be2-b1ff-4eed-a4f1-48e6e1ad8ff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.173997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d969be2-b1ff-4eed-a4f1-48e6e1ad8ff7 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.176863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0eba048c-f609-4910-ac7b-42e67d6a1576 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:53.178049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0eba048c-f609-4910-ac7b-42e67d6a1576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:53.183337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 454/897] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 5 15:13:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:53.183337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d969be2-b1ff-4eed-a4f1-48e6e1ad8ff7 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.249399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 444/898] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:53.250252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba048c-f609-4910-ac7b-42e67d6a1576 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.281540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d969be2-b1ff-4eed-a4f1-48e6e1ad8ff7 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:53.314124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287103ee-6e8a-4d15-9753-aa6d489ff01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.315046 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287103ee-6e8a-4d15-9753-aa6d489ff01e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.315329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287103ee-6e8a-4d15-9753-aa6d489ff01e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.315610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287103ee-6e8a-4d15-9753-aa6d489ff01e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.322128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287103ee-6e8a-4d15-9753-aa6d489ff01e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.323595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287103ee-6e8a-4d15-9753-aa6d489ff01e None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-287103ee-6e8a-4d15-9753-aa6d489ff01e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:53.338052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:53.339000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:53.339889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:53.339889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:53.339889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:53.339889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:53.339889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:53.339889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:53.339889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:53.339889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:53.339889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 455/899] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:53.341009 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610c369-7bba-4024-b164-6abb6af17b55 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.341111 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610c369-7bba-4024-b164-6abb6af17b55 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.341510 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610c369-7bba-4024-b164-6abb6af17b55 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.342788 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 456/900] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:53.343486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610c369-7bba-4024-b164-6abb6af17b55 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.348041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba048c-f609-4910-ac7b-42e67d6a1576 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:53.381497 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7648cb8-c2ca-401d-92ca-0f671aaf494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.382087 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7648cb8-c2ca-401d-92ca-0f671aaf494d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.382404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7648cb8-c2ca-401d-92ca-0f671aaf494d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.382680 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7648cb8-c2ca-401d-92ca-0f671aaf494d None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.383372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7648cb8-c2ca-401d-92ca-0f671aaf494d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:53.383673 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7648cb8-c2ca-401d-92ca-0f671aaf494d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.385021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7648cb8-c2ca-401d-92ca-0f671aaf494d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.389972 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 445/901] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 5 15:13:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:53.390918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7648cb8-c2ca-401d-92ca-0f671aaf494d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.439238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610c369-7bba-4024-b164-6abb6af17b55 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:53.471347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1a1a1-9a31-4345-8e0f-4fea85add2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.472138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1a1a1-9a31-4345-8e0f-4fea85add2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.472419 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1a1a1-9a31-4345-8e0f-4fea85add2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.472688 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1a1a1-9a31-4345-8e0f-4fea85add2e5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.473331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1a1a1-9a31-4345-8e0f-4fea85add2e5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.474721 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1a1a1-9a31-4345-8e0f-4fea85add2e5 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.486521 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7648cb8-c2ca-401d-92ca-0f671aaf494d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-9ae1a1a1-9a31-4345-8e0f-4fea85add2e5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:53.486956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:53.488030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:53.488879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 457/902] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:13:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:53.491115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310d213-22d9-4754-a1ae-ce0ad39584f2 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.491403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310d213-22d9-4754-a1ae-ce0ad39584f2 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.491678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310d213-22d9-4754-a1ae-ce0ad39584f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.507341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-5310d213-22d9-4754-a1ae-ce0ad39584f2 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:53.508513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-5310d213-22d9-4754-a1ae-ce0ad39584f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:53.520445 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e855186-d41f-4be1-a5ae-f5de92f1ee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.521103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e855186-d41f-4be1-a5ae-f5de92f1ee06 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.521384 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e855186-d41f-4be1-a5ae-f5de92f1ee06 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.521661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e855186-d41f-4be1-a5ae-f5de92f1ee06 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.522464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e855186-d41f-4be1-a5ae-f5de92f1ee06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:53.522774 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e855186-d41f-4be1-a5ae-f5de92f1ee06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.524194 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e855186-d41f-4be1-a5ae-f5de92f1ee06 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.535679 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 446/903] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:53.536721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e855186-d41f-4be1-a5ae-f5de92f1ee06 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.573827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 458/904] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:53.574706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310d213-22d9-4754-a1ae-ce0ad39584f2 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.633152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e855186-d41f-4be1-a5ae-f5de92f1ee06 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:53.665979 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938044df-81d5-46cf-b988-c4cf4d46f9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.666668 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938044df-81d5-46cf-b988-c4cf4d46f9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.666953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938044df-81d5-46cf-b988-c4cf4d46f9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.667225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938044df-81d5-46cf-b988-c4cf4d46f9a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.667995 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938044df-81d5-46cf-b988-c4cf4d46f9a5 None admin] RBAC: Adding query filter params (interface=public, service_id=b12ba6697874401abe48048199eb8f20, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:53.668303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938044df-81d5-46cf-b988-c4cf4d46f9a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.670376 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938044df-81d5-46cf-b988-c4cf4d46f9a5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.675742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 447/905] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 5 15:13:53 2022] GET /identity/v3/endpoints?service_id=b12ba6697874401abe48048199eb8f20&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:53.675980 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938044df-81d5-46cf-b988-c4cf4d46f9a5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.677853 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310d213-22d9-4754-a1ae-ce0ad39584f2 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:53.711763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f535b54-eb7e-41ff-92a6-efc4593ec745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.712430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f535b54-eb7e-41ff-92a6-efc4593ec745 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.712714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f535b54-eb7e-41ff-92a6-efc4593ec745 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.712995 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f535b54-eb7e-41ff-92a6-efc4593ec745 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.717034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f535b54-eb7e-41ff-92a6-efc4593ec745 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:53.717406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f535b54-eb7e-41ff-92a6-efc4593ec745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.718819 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f535b54-eb7e-41ff-92a6-efc4593ec745 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.723354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 459/906] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:13:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:53.724110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f535b54-eb7e-41ff-92a6-efc4593ec745 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.776114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938044df-81d5-46cf-b988-c4cf4d46f9a5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:53.808700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c37c91-ef3d-420f-9589-2852093ddf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.809470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c37c91-ef3d-420f-9589-2852093ddf68 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.810324 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c37c91-ef3d-420f-9589-2852093ddf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.810466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c37c91-ef3d-420f-9589-2852093ddf68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.811282 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c37c91-ef3d-420f-9589-2852093ddf68 None admin] RBAC: Adding query filter params (role.id=72ca4f6781fe43929329bb5827880242, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=6d5886d3fdab4730828183bd6204c6ef) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:53.811598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c37c91-ef3d-420f-9589-2852093ddf68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.813017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c37c91-ef3d-420f-9589-2852093ddf68 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.818273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 448/907] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:13:53 2022] GET /identity/v3/role_assignments?user.id=6d5886d3fdab4730828183bd6204c6ef&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=72ca4f6781fe43929329bb5827880242 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:53.819061 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c37c91-ef3d-420f-9589-2852093ddf68 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.821665 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f535b54-eb7e-41ff-92a6-efc4593ec745 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:53.859928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace8551-4f65-4711-9cc6-740107fc8049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.860622 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace8551-4f65-4711-9cc6-740107fc8049 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.860899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace8551-4f65-4711-9cc6-740107fc8049 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.861171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace8551-4f65-4711-9cc6-740107fc8049 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.861908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace8551-4f65-4711-9cc6-740107fc8049 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.863339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace8551-4f65-4711-9cc6-740107fc8049 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.928645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c37c91-ef3d-420f-9589-2852093ddf68 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:53.964333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22ed9-627c-408f-9c5f-f21e2cdb6f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:53.965030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22ed9-627c-408f-9c5f-f21e2cdb6f13 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:53.965316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22ed9-627c-408f-9c5f-f21e2cdb6f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:53.966156 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22ed9-627c-408f-9c5f-f21e2cdb6f13 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:53.966897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c22ed9-627c-408f-9c5f-f21e2cdb6f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:53.968391 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c22ed9-627c-408f-9c5f-f21e2cdb6f13 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:53.974804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 460/908] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:13:53 2022] POST /identity/v3/services => generated 241 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:53.975564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace8551-4f65-4711-9cc6-740107fc8049 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:53.986690 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 449/909] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 5 15:13:53 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:13:54.117885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace8551-4f65-4711-9cc6-740107fc8049 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:54.160039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f23b7d-82c0-4ac9-a43a-eaab6156f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:54.161130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23b7d-82c0-4ac9-a43a-eaab6156f9ad None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:54.161897 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23b7d-82c0-4ac9-a43a-eaab6156f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:54.162403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23b7d-82c0-4ac9-a43a-eaab6156f9ad None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:54.163347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f23b7d-82c0-4ac9-a43a-eaab6156f9ad None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:54.163859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f23b7d-82c0-4ac9-a43a-eaab6156f9ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:54.165538 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f23b7d-82c0-4ac9-a43a-eaab6156f9ad None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:54.172363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 461/910] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:13:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:54.178896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22ed9-627c-408f-9c5f-f21e2cdb6f13 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:54.288447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22ed9-627c-408f-9c5f-f21e2cdb6f13 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:54.322528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f28f8-4343-4ed4-bec3-c7b453b2b64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:54.323196 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f28f8-4343-4ed4-bec3-c7b453b2b64b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:54.323483 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f28f8-4343-4ed4-bec3-c7b453b2b64b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:54.323767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f28f8-4343-4ed4-bec3-c7b453b2b64b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:54.324551 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f28f8-4343-4ed4-bec3-c7b453b2b64b None admin] RBAC: Adding query filter params (interface=public, service_id=25262e21546b42d59071bc67d7cc0978, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:54.324864 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f28f8-4343-4ed4-bec3-c7b453b2b64b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:54.326271 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f28f8-4343-4ed4-bec3-c7b453b2b64b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:54.331672 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 450/911] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 5 15:13:54 2022] GET /identity/v3/endpoints?service_id=25262e21546b42d59071bc67d7cc0978&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:54.337122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f23b7d-82c0-4ac9-a43a-eaab6156f9ad None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:54.439617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f23b7d-82c0-4ac9-a43a-eaab6156f9ad None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:54.475229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac55775-00b5-4201-afcf-e29dcf7c01ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:54.476239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac55775-00b5-4201-afcf-e29dcf7c01ee None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:54.476755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac55775-00b5-4201-afcf-e29dcf7c01ee None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:54.477235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac55775-00b5-4201-afcf-e29dcf7c01ee None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:54.478117 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac55775-00b5-4201-afcf-e29dcf7c01ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:54.479719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac55775-00b5-4201-afcf-e29dcf7c01ee None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:54.490415 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 462/912] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 5 15:13:54 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:13:56.142067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd85517-6f9e-41c3-8b27-c15ab6c5c01c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.142628 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd85517-6f9e-41c3-8b27-c15ab6c5c01c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.142734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd85517-6f9e-41c3-8b27-c15ab6c5c01c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.144393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 451/913] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:56.150143 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98515ee-e21d-4153-9854-c049801a677c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.150670 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98515ee-e21d-4153-9854-c049801a677c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.150748 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98515ee-e21d-4153-9854-c049801a677c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.170848 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-d98515ee-e21d-4153-9854-c049801a677c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:56.172128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d98515ee-e21d-4153-9854-c049801a677c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:56.243266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 463/914] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:56.266023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd85517-6f9e-41c3-8b27-c15ab6c5c01c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.317887 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00743ff2-8da8-45f7-add2-8471a01bc862 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.318201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00743ff2-8da8-45f7-add2-8471a01bc862 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.318474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00743ff2-8da8-45f7-add2-8471a01bc862 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.319961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 464/915] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:13:56.325713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d508a1-e77e-4e96-871f-436edc3f89c0 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.326418 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d508a1-e77e-4e96-871f-436edc3f89c0 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.326925 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d508a1-e77e-4e96-871f-436edc3f89c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.344373 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-c6d508a1-e77e-4e96-871f-436edc3f89c0 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:56.345937 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c6d508a1-e77e-4e96-871f-436edc3f89c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:56.375217 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd85517-6f9e-41c3-8b27-c15ab6c5c01c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:56.409480 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5229c-9efa-49e4-bbf6-552ef849c1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:56.410225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5229c-9efa-49e4-bbf6-552ef849c1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.410536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5229c-9efa-49e4-bbf6-552ef849c1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.410812 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5229c-9efa-49e4-bbf6-552ef849c1c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.413502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 465/916] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:56.414940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823b4bc-f2f1-4603-84c0-ffa441135c20 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.415229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823b4bc-f2f1-4603-84c0-ffa441135c20 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.415504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823b4bc-f2f1-4603-84c0-ffa441135c20 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.416743 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 466/917] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:56.423978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e855a-ddf5-47b6-8163-8ef7b88a9b1d None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.424265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e855a-ddf5-47b6-8163-8ef7b88a9b1d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.424548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e855a-ddf5-47b6-8163-8ef7b88a9b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.431920 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5229c-9efa-49e4-bbf6-552ef849c1c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-35b5229c-9efa-49e4-bbf6-552ef849c1c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:13:56.440887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:56.441839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:56.442731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:56.442731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:56.442731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:56.442731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:56.442731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:13:56.442731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:13:56.442731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:13:56.442731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:13:56.442731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:13:56.442731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:13:56.442731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:13:56.442731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:56.443369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-c74e855a-ddf5-47b6-8163-8ef7b88a9b1d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:56.443444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 452/918] 10.222.0.44 () {56 vars in 1120 bytes} [Thu May 5 15:13:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:56.443444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5229c-9efa-49e4-bbf6-552ef849c1c9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.444357 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c74e855a-ddf5-47b6-8163-8ef7b88a9b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:56.516274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 467/919] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:13:56.521797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e855a-ddf5-47b6-8163-8ef7b88a9b1d None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.551634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5229c-9efa-49e4-bbf6-552ef849c1c9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:56.586362 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917e81b-3d9e-4ca2-b626-5275bd79b2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:56.587174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917e81b-3d9e-4ca2-b626-5275bd79b2ce None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.587456 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917e81b-3d9e-4ca2-b626-5275bd79b2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.587738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917e81b-3d9e-4ca2-b626-5275bd79b2ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.588409 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917e81b-3d9e-4ca2-b626-5275bd79b2ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:56.589839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917e81b-3d9e-4ca2-b626-5275bd79b2ce None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-4917e81b-3d9e-4ca2-b626-5275bd79b2ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:56.603251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:56.604505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:56.605406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 453/920] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 5 15:13:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:56.606469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917e81b-3d9e-4ca2-b626-5275bd79b2ce None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.626547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e855a-ddf5-47b6-8163-8ef7b88a9b1d None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:56.662839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2bb91-56f3-4594-b805-6e0f1a8eef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:56.663870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2bb91-56f3-4594-b805-6e0f1a8eef81 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.664332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2bb91-56f3-4594-b805-6e0f1a8eef81 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.664785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2bb91-56f3-4594-b805-6e0f1a8eef81 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.665729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2bb91-56f3-4594-b805-6e0f1a8eef81 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:56.666209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2bb91-56f3-4594-b805-6e0f1a8eef81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:56.667828 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2bb91-56f3-4594-b805-6e0f1a8eef81 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:56.676370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 468/921] 10.222.0.44 () {56 vars in 1115 bytes} [Thu May 5 15:13:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:56.678401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2bb91-56f3-4594-b805-6e0f1a8eef81 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.722714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917e81b-3d9e-4ca2-b626-5275bd79b2ce None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:56.755283 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37930597-3db2-4cd1-98f3-520784ce14ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:56.756105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37930597-3db2-4cd1-98f3-520784ce14ee None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.756386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37930597-3db2-4cd1-98f3-520784ce14ee None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.756662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37930597-3db2-4cd1-98f3-520784ce14ee None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.757355 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37930597-3db2-4cd1-98f3-520784ce14ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:56.760488 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37930597-3db2-4cd1-98f3-520784ce14ee None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-37930597-3db2-4cd1-98f3-520784ce14ee None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:56.772559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:56.773562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:13:56.774677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:56.778790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 454/922] 10.222.0.44 () {56 vars in 1132 bytes} [Thu May 5 15:13:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:56.779846 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37930597-3db2-4cd1-98f3-520784ce14ee None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.793680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2bb91-56f3-4594-b805-6e0f1a8eef81 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:56.826290 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50f91d-6215-4b47-bb20-09df78974796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:56.826970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f91d-6215-4b47-bb20-09df78974796 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.827258 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f91d-6215-4b47-bb20-09df78974796 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.827529 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f91d-6215-4b47-bb20-09df78974796 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.828224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50f91d-6215-4b47-bb20-09df78974796 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:56.828529 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50f91d-6215-4b47-bb20-09df78974796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:56.829877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50f91d-6215-4b47-bb20-09df78974796 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:56.834366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 469/923] 10.222.0.44 () {56 vars in 1122 bytes} [Thu May 5 15:13:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:56.835128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50f91d-6215-4b47-bb20-09df78974796 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.876269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37930597-3db2-4cd1-98f3-520784ce14ee None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:56.908787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a75693-3d80-4648-b679-8aa7451db1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:56.909582 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a75693-3d80-4648-b679-8aa7451db1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.909861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a75693-3d80-4648-b679-8aa7451db1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.910133 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a75693-3d80-4648-b679-8aa7451db1e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.921128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a75693-3d80-4648-b679-8aa7451db1e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:56.922694 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a75693-3d80-4648-b679-8aa7451db1e9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:56.930786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50f91d-6215-4b47-bb20-09df78974796 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-36a75693-3d80-4648-b679-8aa7451db1e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:56.939799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:56.940705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:56.941581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:56.941581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:56.941581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:56.941581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:56.941581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 455/924] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:56.942244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acde0f0-6eb6-4ecb-82c1-7d07de340828 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.942479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acde0f0-6eb6-4ecb-82c1-7d07de340828 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.942759 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acde0f0-6eb6-4ecb-82c1-7d07de340828 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.944149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 456/925] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:56.944686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acde0f0-6eb6-4ecb-82c1-7d07de340828 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:56.964159 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022335e7-c398-42fd-bfdd-203b4beeee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:56.964822 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022335e7-c398-42fd-bfdd-203b4beeee0d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.965103 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022335e7-c398-42fd-bfdd-203b4beeee0d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.965377 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022335e7-c398-42fd-bfdd-203b4beeee0d None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.966219 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022335e7-c398-42fd-bfdd-203b4beeee0d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:56.966552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022335e7-c398-42fd-bfdd-203b4beeee0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:56.967905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022335e7-c398-42fd-bfdd-203b4beeee0d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:56.972351 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 470/926] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 5 15:13:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:56.973501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb8e51-a0d0-4773-a960-b8f4b413fcca None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:56.973788 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb8e51-a0d0-4773-a960-b8f4b413fcca None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:56.974063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb8e51-a0d0-4773-a960-b8f4b413fcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:56.989653 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6dfb8e51-a0d0-4773-a960-b8f4b413fcca None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:56.990851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6dfb8e51-a0d0-4773-a960-b8f4b413fcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:13:57.044415 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acde0f0-6eb6-4ecb-82c1-7d07de340828 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.052836 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 471/927] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:13:57.053650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb8e51-a0d0-4773-a960-b8f4b413fcca None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.078583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bca5bd-2f30-42a4-9bc3-06898a6d5837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.079252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bca5bd-2f30-42a4-9bc3-06898a6d5837 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.079532 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bca5bd-2f30-42a4-9bc3-06898a6d5837 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.079807 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bca5bd-2f30-42a4-9bc3-06898a6d5837 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.080501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bca5bd-2f30-42a4-9bc3-06898a6d5837 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:57.080805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bca5bd-2f30-42a4-9bc3-06898a6d5837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.082152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bca5bd-2f30-42a4-9bc3-06898a6d5837 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.086799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 457/928] 10.222.0.44 () {56 vars in 1122 bytes} [Thu May 5 15:13:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:57.087785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bca5bd-2f30-42a4-9bc3-06898a6d5837 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.149593 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb8e51-a0d0-4773-a960-b8f4b413fcca None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.180510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bca5bd-2f30-42a4-9bc3-06898a6d5837 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.182093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f70215-c3fb-45c8-bb2c-0a39b9fc3dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.182788 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f70215-c3fb-45c8-bb2c-0a39b9fc3dce None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.183069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f70215-c3fb-45c8-bb2c-0a39b9fc3dce None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.183341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f70215-c3fb-45c8-bb2c-0a39b9fc3dce None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.184059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f70215-c3fb-45c8-bb2c-0a39b9fc3dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:57.184894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f70215-c3fb-45c8-bb2c-0a39b9fc3dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.186370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f70215-c3fb-45c8-bb2c-0a39b9fc3dce None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.197080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 472/929] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:57.197864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f70215-c3fb-45c8-bb2c-0a39b9fc3dce None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.212824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb35070-166a-4aae-ba5b-569854d08c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.213486 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb35070-166a-4aae-ba5b-569854d08c03 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.213768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb35070-166a-4aae-ba5b-569854d08c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.214046 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb35070-166a-4aae-ba5b-569854d08c03 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.214765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb35070-166a-4aae-ba5b-569854d08c03 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:57.215068 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb35070-166a-4aae-ba5b-569854d08c03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.216723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb35070-166a-4aae-ba5b-569854d08c03 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.221448 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 458/930] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:57.222033 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb35070-166a-4aae-ba5b-569854d08c03 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.297984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f70215-c3fb-45c8-bb2c-0a39b9fc3dce None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.318703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb35070-166a-4aae-ba5b-569854d08c03 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.329735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba7289-5d3b-47a9-9cdb-ec3c5527b5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.330562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba7289-5d3b-47a9-9cdb-ec3c5527b5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.330848 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba7289-5d3b-47a9-9cdb-ec3c5527b5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.331125 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba7289-5d3b-47a9-9cdb-ec3c5527b5b7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.331782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba7289-5d3b-47a9-9cdb-ec3c5527b5b7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.333139 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba7289-5d3b-47a9-9cdb-ec3c5527b5b7 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-f0ba7289-5d3b-47a9-9cdb-ec3c5527b5b7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:57.344647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:57.345826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:57.352170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 473/931] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:57.352983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba7289-5d3b-47a9-9cdb-ec3c5527b5b7 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.354650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42a6ec-7210-44e3-9d80-e5b7bd5d24d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.355308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42a6ec-7210-44e3-9d80-e5b7bd5d24d5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.355589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42a6ec-7210-44e3-9d80-e5b7bd5d24d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.355866 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42a6ec-7210-44e3-9d80-e5b7bd5d24d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.357197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42a6ec-7210-44e3-9d80-e5b7bd5d24d5 None admin] RBAC: Adding query filter params (interface=public, service_id=5808e05a427f4ebb9ddab00aa51165e1, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:57.357512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42a6ec-7210-44e3-9d80-e5b7bd5d24d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.358902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42a6ec-7210-44e3-9d80-e5b7bd5d24d5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.363969 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 459/932] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/endpoints?service_id=5808e05a427f4ebb9ddab00aa51165e1&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:57.364909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42a6ec-7210-44e3-9d80-e5b7bd5d24d5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.442855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba7289-5d3b-47a9-9cdb-ec3c5527b5b7 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.462239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42a6ec-7210-44e3-9d80-e5b7bd5d24d5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.474256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160da367-522a-4a9f-9314-73247889efec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.475093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160da367-522a-4a9f-9314-73247889efec None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.475382 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160da367-522a-4a9f-9314-73247889efec None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.475659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160da367-522a-4a9f-9314-73247889efec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.483515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160da367-522a-4a9f-9314-73247889efec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.484954 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160da367-522a-4a9f-9314-73247889efec None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.494217 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31071bef-5bdc-437d-b492-e665c43dc974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.494893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31071bef-5bdc-437d-b492-e665c43dc974 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.495176 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31071bef-5bdc-437d-b492-e665c43dc974 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.495453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31071bef-5bdc-437d-b492-e665c43dc974 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.496182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31071bef-5bdc-437d-b492-e665c43dc974 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.498203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31071bef-5bdc-437d-b492-e665c43dc974 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-160da367-522a-4a9f-9314-73247889efec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:13:57.499878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:57.500956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:57.502146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:57.502146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:57.502146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:13:57.502146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:13:57.502146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:13:57.502146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:13:57.502146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:13:57.502146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:13:57.502146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:13:57.502146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:57.502146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 474/933] 10.222.0.44 () {56 vars in 1117 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:57.502146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160da367-522a-4a9f-9314-73247889efec None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.598820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160da367-522a-4a9f-9314-73247889efec None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.599580 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 460/934] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 5 15:13:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:57.600397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31071bef-5bdc-437d-b492-e665c43dc974 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.643809 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c3d36-6443-437c-b1db-9af6e450712f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.644566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c3d36-6443-437c-b1db-9af6e450712f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.644849 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c3d36-6443-437c-b1db-9af6e450712f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.645121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c3d36-6443-437c-b1db-9af6e450712f None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.645828 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c3d36-6443-437c-b1db-9af6e450712f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:57.646143 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c3d36-6443-437c-b1db-9af6e450712f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.647644 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c3d36-6443-437c-b1db-9af6e450712f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.658066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 475/935] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:57.658066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c3d36-6443-437c-b1db-9af6e450712f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.711513 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31071bef-5bdc-437d-b492-e665c43dc974 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.745884 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765e851-40ca-4d41-a477-ae54e72617f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.747332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765e851-40ca-4d41-a477-ae54e72617f0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.747724 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765e851-40ca-4d41-a477-ae54e72617f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.748073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765e851-40ca-4d41-a477-ae54e72617f0 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.748929 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765e851-40ca-4d41-a477-ae54e72617f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.750455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765e851-40ca-4d41-a477-ae54e72617f0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.762479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 461/936] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:13:57.762479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765e851-40ca-4d41-a477-ae54e72617f0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.763279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c3d36-6443-437c-b1db-9af6e450712f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.805243 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da691691-5181-41e4-9a1c-c456d226ce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.805935 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da691691-5181-41e4-9a1c-c456d226ce5a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.806214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da691691-5181-41e4-9a1c-c456d226ce5a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.806555 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da691691-5181-41e4-9a1c-c456d226ce5a None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.807403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da691691-5181-41e4-9a1c-c456d226ce5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:57.807708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da691691-5181-41e4-9a1c-c456d226ce5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.809164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da691691-5181-41e4-9a1c-c456d226ce5a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.830169 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 476/937] 10.222.0.44 () {56 vars in 1149 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:57.836131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da691691-5181-41e4-9a1c-c456d226ce5a None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.875804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765e851-40ca-4d41-a477-ae54e72617f0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.912942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b4615-1036-4a16-a06c-eff874a9178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.913630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b4615-1036-4a16-a06c-eff874a9178b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.913914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b4615-1036-4a16-a06c-eff874a9178b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.914191 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b4615-1036-4a16-a06c-eff874a9178b None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.914942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b4615-1036-4a16-a06c-eff874a9178b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:57.915251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b4615-1036-4a16-a06c-eff874a9178b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:57.916645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b4615-1036-4a16-a06c-eff874a9178b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:57.923218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 462/938] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:57.935767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b4615-1036-4a16-a06c-eff874a9178b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:57.946427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da691691-5181-41e4-9a1c-c456d226ce5a None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:57.985133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b7ff1-ac71-42bb-b835-2c9ea77f222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:57.985911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b7ff1-ac71-42bb-b835-2c9ea77f222e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:57.986198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b7ff1-ac71-42bb-b835-2c9ea77f222e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:57.986509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b7ff1-ac71-42bb-b835-2c9ea77f222e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:57.999523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b7ff1-ac71-42bb-b835-2c9ea77f222e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:58.001000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b7ff1-ac71-42bb-b835-2c9ea77f222e None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-554b7ff1-ac71-42bb-b835-2c9ea77f222e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:13:58.019344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:58.020310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:58.021210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:13:58.021210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:13:58.021210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:13:58.021210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:13:58.021210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 477/939] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:13:58.027246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b7ff1-ac71-42bb-b835-2c9ea77f222e None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:58.044577 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b4615-1036-4a16-a06c-eff874a9178b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:58.079412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a567025-1722-4a56-9580-54bcb1a0be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:58.080172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a567025-1722-4a56-9580-54bcb1a0be40 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:58.080396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a567025-1722-4a56-9580-54bcb1a0be40 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:58.080675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a567025-1722-4a56-9580-54bcb1a0be40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:58.081474 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a567025-1722-4a56-9580-54bcb1a0be40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:58.082928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a567025-1722-4a56-9580-54bcb1a0be40 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:58.134157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b7ff1-ac71-42bb-b835-2c9ea77f222e None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:58.168144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c29da-09e5-4bcd-987f-7184db2bd191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:58.171960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c29da-09e5-4bcd-987f-7184db2bd191 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:58.172241 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c29da-09e5-4bcd-987f-7184db2bd191 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:58.172518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c29da-09e5-4bcd-987f-7184db2bd191 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:58.173298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c29da-09e5-4bcd-987f-7184db2bd191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:58.173606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c29da-09e5-4bcd-987f-7184db2bd191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:58.175340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c29da-09e5-4bcd-987f-7184db2bd191 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:58.184168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 463/940] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 5 15:13:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:13:58.189172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 478/941] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:13:58.195600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a567025-1722-4a56-9580-54bcb1a0be40 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:58.315955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a567025-1722-4a56-9580-54bcb1a0be40 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:58.353088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8105e-467d-4796-acda-75d1f92483b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:58.354051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8105e-467d-4796-acda-75d1f92483b0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:58.354352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8105e-467d-4796-acda-75d1f92483b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:58.354627 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8105e-467d-4796-acda-75d1f92483b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:58.363270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8105e-467d-4796-acda-75d1f92483b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:58.364730 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8105e-467d-4796-acda-75d1f92483b0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-67a8105e-467d-4796-acda-75d1f92483b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:13:58.379906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:13:58.380811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:13:58.382656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:13:58.382656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:13:58.382656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:13:58.382656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:13:58.382656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:13:58.382656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:13:58.382656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:13:58.382656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:13:58.382656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 464/942] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:13:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:13:58.387947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c29da-09e5-4bcd-987f-7184db2bd191 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:58.495959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c29da-09e5-4bcd-987f-7184db2bd191 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:58.530178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261287f5-8caa-4fd9-ac38-8333a482e2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:58.530871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261287f5-8caa-4fd9-ac38-8333a482e2af None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:58.531153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261287f5-8caa-4fd9-ac38-8333a482e2af None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:58.531431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261287f5-8caa-4fd9-ac38-8333a482e2af None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:58.532216 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261287f5-8caa-4fd9-ac38-8333a482e2af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:13:58.532523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261287f5-8caa-4fd9-ac38-8333a482e2af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:58.534057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261287f5-8caa-4fd9-ac38-8333a482e2af None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:58.548324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 479/943] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:13:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:13:58.554353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8105e-467d-4796-acda-75d1f92483b0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:13:58.657624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8105e-467d-4796-acda-75d1f92483b0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:13:58.692709 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3766773-e7a5-4f11-b127-4eda279dc66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:13:58.693605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3766773-e7a5-4f11-b127-4eda279dc66b None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:58.693888 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3766773-e7a5-4f11-b127-4eda279dc66b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:58.694168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3766773-e7a5-4f11-b127-4eda279dc66b None admin] PATH_INFO: `/v3/projects/587280a3c4c54bffb4d769e406af3689/users/6d5886d3fdab4730828183bd6204c6ef/roles/72ca4f6781fe43929329bb5827880242` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:58.696431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3766773-e7a5-4f11-b127-4eda279dc66b None admin] RBAC: Authorizing `identity:create_grant(project_id=587280a3c4c54bffb4d769e406af3689, user_id=6d5886d3fdab4730828183bd6204c6ef, role_id=72ca4f6781fe43929329bb5827880242)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:13:58.697862 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3766773-e7a5-4f11-b127-4eda279dc66b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:13:58.770101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 465/944] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:13:58 2022] PUT /identity/v3/projects/587280a3c4c54bffb4d769e406af3689/users/6d5886d3fdab4730828183bd6204c6ef/roles/72ca4f6781fe43929329bb5827880242 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:13:59.969131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7502be9-de9f-48a9-829f-ada7db26200f None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:59.969650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7502be9-de9f-48a9-829f-ada7db26200f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:59.969650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7502be9-de9f-48a9-829f-ada7db26200f None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:59.971363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 480/945] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:13:59.976620 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77e4ec-b35c-4a67-ba26-9a1a3a8db26f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:13:59.977035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77e4ec-b35c-4a67-ba26-9a1a3a8db26f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:13:59.977210 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77e4ec-b35c-4a67-ba26-9a1a3a8db26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:13:59.995252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9f77e4ec-b35c-4a67-ba26-9a1a3a8db26f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:13:59.996435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9f77e4ec-b35c-4a67-ba26-9a1a3a8db26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:00.067193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 466/946] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:13:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:00.088690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9235048-d183-452c-94bf-98e517f048dc None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.088867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77e4ec-b35c-4a67-ba26-9a1a3a8db26f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.089419 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9235048-d183-452c-94bf-98e517f048dc None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.089915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9235048-d183-452c-94bf-98e517f048dc None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.093496 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 481/947] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:00.098034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151a966-be88-42ac-a05b-44ff81030ce9 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.098597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151a966-be88-42ac-a05b-44ff81030ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.099081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151a966-be88-42ac-a05b-44ff81030ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.116498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-3151a966-be88-42ac-a05b-44ff81030ce9 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:00.118021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-3151a966-be88-42ac-a05b-44ff81030ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:00.190075 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77e4ec-b35c-4a67-ba26-9a1a3a8db26f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.202347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 482/948] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:00.227265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151a966-be88-42ac-a05b-44ff81030ce9 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.230263 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8e18a-9137-4acd-89b1-5bd7ab0d23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.232523 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8e18a-9137-4acd-89b1-5bd7ab0d23a4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.233033 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8e18a-9137-4acd-89b1-5bd7ab0d23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.233522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8e18a-9137-4acd-89b1-5bd7ab0d23a4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.234405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8e18a-9137-4acd-89b1-5bd7ab0d23a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:00.235992 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8e18a-9137-4acd-89b1-5bd7ab0d23a4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c7f8e18a-9137-4acd-89b1-5bd7ab0d23a4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:00.251141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:00.252131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:14:00.253007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:00.255842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 467/949] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:14:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:00.261716 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8e18a-9137-4acd-89b1-5bd7ab0d23a4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.345937 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151a966-be88-42ac-a05b-44ff81030ce9 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.382124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd88f-96ed-4555-bfbb-ed862ea0c792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.383357 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd88f-96ed-4555-bfbb-ed862ea0c792 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.383845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd88f-96ed-4555-bfbb-ed862ea0c792 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.384344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd88f-96ed-4555-bfbb-ed862ea0c792 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.385212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cd88f-96ed-4555-bfbb-ed862ea0c792 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:00.386837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cd88f-96ed-4555-bfbb-ed862ea0c792 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:00.389330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8e18a-9137-4acd-89b1-5bd7ab0d23a4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-ab2cd88f-96ed-4555-bfbb-ed862ea0c792 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:00.400505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:00.401527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:14:00.402410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:00.406556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 483/950] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 5 15:14:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:00.413015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd88f-96ed-4555-bfbb-ed862ea0c792 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.430051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e09713-2ca1-4d96-ad06-6c9a08cf012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.431134 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e09713-2ca1-4d96-ad06-6c9a08cf012f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.431618 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e09713-2ca1-4d96-ad06-6c9a08cf012f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.432115 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e09713-2ca1-4d96-ad06-6c9a08cf012f None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.433018 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e09713-2ca1-4d96-ad06-6c9a08cf012f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:00.433538 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e09713-2ca1-4d96-ad06-6c9a08cf012f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:00.435906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e09713-2ca1-4d96-ad06-6c9a08cf012f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:00.441560 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 468/951] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 5 15:14:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:00.447745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e09713-2ca1-4d96-ad06-6c9a08cf012f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.535719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd88f-96ed-4555-bfbb-ed862ea0c792 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.567188 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e09713-2ca1-4d96-ad06-6c9a08cf012f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.570628 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6855cb-801b-4240-b879-6dcd146e6f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.571305 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6855cb-801b-4240-b879-6dcd146e6f4a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.571598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6855cb-801b-4240-b879-6dcd146e6f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.571872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6855cb-801b-4240-b879-6dcd146e6f4a None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.572579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6855cb-801b-4240-b879-6dcd146e6f4a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:00.572948 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6855cb-801b-4240-b879-6dcd146e6f4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:00.574403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6855cb-801b-4240-b879-6dcd146e6f4a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:00.584428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 484/952] 10.222.0.44 () {56 vars in 1122 bytes} [Thu May 5 15:14:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:00.584428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c823c90-3f97-4b00-b42e-f9868739c194 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.584428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c823c90-3f97-4b00-b42e-f9868739c194 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.584428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c823c90-3f97-4b00-b42e-f9868739c194 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.584428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 485/953] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:00.587184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c823c90-3f97-4b00-b42e-f9868739c194 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.607515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a140d3-4e39-4290-9e58-f2e7146395f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.607798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a140d3-4e39-4290-9e58-f2e7146395f0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.608075 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a140d3-4e39-4290-9e58-f2e7146395f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.608352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a140d3-4e39-4290-9e58-f2e7146395f0 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.609053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a140d3-4e39-4290-9e58-f2e7146395f0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:00.609358 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a140d3-4e39-4290-9e58-f2e7146395f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:00.610757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a140d3-4e39-4290-9e58-f2e7146395f0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:00.615286 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 469/954] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 5 15:14:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:00.616449 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba353343-53d7-4cc1-84f8-b3907f1bdba8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.616744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba353343-53d7-4cc1-84f8-b3907f1bdba8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.617032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba353343-53d7-4cc1-84f8-b3907f1bdba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.635789 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ba353343-53d7-4cc1-84f8-b3907f1bdba8 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:00.637143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ba353343-53d7-4cc1-84f8-b3907f1bdba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:00.724924 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c823c90-3f97-4b00-b42e-f9868739c194 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.738966 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 470/955] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:00.770706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba353343-53d7-4cc1-84f8-b3907f1bdba8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.791717 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228f522-2bf9-4c62-93a9-6820f1081061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.793070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228f522-2bf9-4c62-93a9-6820f1081061 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.793563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228f522-2bf9-4c62-93a9-6820f1081061 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.795420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228f522-2bf9-4c62-93a9-6820f1081061 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.796366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228f522-2bf9-4c62-93a9-6820f1081061 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:00.797420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228f522-2bf9-4c62-93a9-6820f1081061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:00.799378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228f522-2bf9-4c62-93a9-6820f1081061 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:00.807530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 486/956] 10.222.0.44 () {56 vars in 1122 bytes} [Thu May 5 15:14:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:00.814192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228f522-2bf9-4c62-93a9-6820f1081061 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:00.886366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba353343-53d7-4cc1-84f8-b3907f1bdba8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.922448 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d7351-139d-4651-9c5e-627dfbd205b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.923117 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d7351-139d-4651-9c5e-627dfbd205b9 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.923400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d7351-139d-4651-9c5e-627dfbd205b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.923672 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d7351-139d-4651-9c5e-627dfbd205b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.924569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d7351-139d-4651-9c5e-627dfbd205b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:00.925801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d7351-139d-4651-9c5e-627dfbd205b9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:00.927178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: WARNING keystone.server.flask.common [None req-843d7351-139d-4651-9c5e-627dfbd205b9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 05 15:14:00.934024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228f522-2bf9-4c62-93a9-6820f1081061 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:00.975657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.sql.core [None req-843d7351-139d-4651-9c5e-627dfbd205b9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 15:14:00.975657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 05 15:14:00.975657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [parameters: {'id': '7d01ffbc454b42e7b21bf292943b97ff', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 05 15:14:00.975657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80059) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 15:14:00.979225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2430e1-a1fb-4e0c-83cf-1a208a972a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:00.980687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2430e1-a1fb-4e0c-83cf-1a208a972a46 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:00.981770 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2430e1-a1fb-4e0c-83cf-1a208a972a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:00.982889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2430e1-a1fb-4e0c-83cf-1a208a972a46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:00.983885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2430e1-a1fb-4e0c-83cf-1a208a972a46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:00.985606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2430e1-a1fb-4e0c-83cf-1a208a972a46 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:00.992385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-843d7351-139d-4651-9c5e-627dfbd205b9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7d01ffbc454b42e7b21bf292943b97ff.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7d01ffbc454b42e7b21bf292943b97ff. May 05 15:14:00.992385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:00.992385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:14:00.992385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:14:00.992385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:14:00.992385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:14:00.992385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:14:00.992385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:14:00.992385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:14:00.992385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application conn.query(q) May 05 15:14:00.992385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:14:00.992385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:14:00.992385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application result.read() May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 05 15:14:00.993541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return project_ref.to_dict() May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application next(self.gen) May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application yield resource May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application next(self.gen) May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.session.rollback() May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.force_reraise() May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise self.value May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application session.commit() May 05 15:14:00.994536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._prepare_impl() May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.session.flush() May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._flush(objects) May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application compat.raise_( May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application flush_context.execute() May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 15:14:00.995503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rec.execute(self) May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application c = connection._execute_20( May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 15:14:00.996460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application conn.query(q) May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application result.read() May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:14:00.999386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [parameters: {'id': '7d01ffbc454b42e7b21bf292943b97ff', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:01.000260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:01.001926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:01.004121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:01.004121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 05 15:14:01.004121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 05 15:14:01.004121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:01.004121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:01.004121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 05 15:14:01.004121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.Conflict( May 05 15:14:01.004121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7d01ffbc454b42e7b21bf292943b97ff. May 05 15:14:01.004121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:01.004121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 471/957] 10.222.0.44 () {60 vars in 1140 bytes} [Thu May 5 15:14:00 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:01.004121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d7351-139d-4651-9c5e-627dfbd205b9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:01.098238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 487/958] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 5 15:14:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:14:01.113173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d7351-139d-4651-9c5e-627dfbd205b9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:01.149672 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c36f5a-16dc-4edc-9a70-b9936c25eaf6 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:01.149982 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c36f5a-16dc-4edc-9a70-b9936c25eaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:01.150161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c36f5a-16dc-4edc-9a70-b9936c25eaf6 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:01.156650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 488/959] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:14:01.158199 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a903b4d-2046-48d9-b698-3ac837f01fdf None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:01.158607 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a903b4d-2046-48d9-b698-3ac837f01fdf None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:01.158893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a903b4d-2046-48d9-b698-3ac837f01fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:01.168929 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e58e2-14dc-48bf-9d5f-06de2383badd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:01.170160 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e58e2-14dc-48bf-9d5f-06de2383badd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:01.170737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e58e2-14dc-48bf-9d5f-06de2383badd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:01.171207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e58e2-14dc-48bf-9d5f-06de2383badd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:01.179176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-9a903b4d-2046-48d9-b698-3ac837f01fdf None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:01.179408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e58e2-14dc-48bf-9d5f-06de2383badd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:01.180444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9a903b4d-2046-48d9-b698-3ac837f01fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:01.181465 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e58e2-14dc-48bf-9d5f-06de2383badd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-973e58e2-14dc-48bf-9d5f-06de2383badd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:14:01.197432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:01.198453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:01.199322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:14:01.199322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:14:01.199322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:14:01.199322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:14:01.199322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:14:01.199322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:14:01.199322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:01.199322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:01.202628 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 472/960] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:01.211408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e58e2-14dc-48bf-9d5f-06de2383badd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:01.254205 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 489/961] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:01.279664 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a903b4d-2046-48d9-b698-3ac837f01fdf None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:01.334256 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e58e2-14dc-48bf-9d5f-06de2383badd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:01.373345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e21ec-4758-44c3-bd11-feedbf16b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:01.374702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e21ec-4758-44c3-bd11-feedbf16b157 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:01.375251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e21ec-4758-44c3-bd11-feedbf16b157 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:01.375860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e21ec-4758-44c3-bd11-feedbf16b157 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:01.377328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e21ec-4758-44c3-bd11-feedbf16b157 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:01.377896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e21ec-4758-44c3-bd11-feedbf16b157 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:01.379976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e21ec-4758-44c3-bd11-feedbf16b157 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:01.394627 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a903b4d-2046-48d9-b698-3ac837f01fdf None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:01.408254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 473/962] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 5 15:14:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:01.437744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa406ce3-7329-4c98-a541-22363f63b07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:01.438630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa406ce3-7329-4c98-a541-22363f63b07e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:01.438913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa406ce3-7329-4c98-a541-22363f63b07e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:01.439192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa406ce3-7329-4c98-a541-22363f63b07e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:01.452181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa406ce3-7329-4c98-a541-22363f63b07e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-aa406ce3-7329-4c98-a541-22363f63b07e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:14:01.460616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:01.461635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:01.462501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:01.462501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:01.462501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:01.462501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:01.462501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:14:01.462501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:14:01.462501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:14:01.462501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:14:01.462501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:14:01.462501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:14:01.462501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:14:01.462501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:01.462501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 490/963] 10.222.0.44 () {56 vars in 1120 bytes} [Thu May 5 15:14:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:01.468300 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e21ec-4758-44c3-bd11-feedbf16b157 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:01.577339 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e21ec-4758-44c3-bd11-feedbf16b157 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:01.619921 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a393f15-9453-4011-a50d-9d3cc9f73be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:01.620608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a393f15-9453-4011-a50d-9d3cc9f73be1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:01.620889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a393f15-9453-4011-a50d-9d3cc9f73be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:01.621160 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a393f15-9453-4011-a50d-9d3cc9f73be1 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:01.622461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a393f15-9453-4011-a50d-9d3cc9f73be1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:01.622769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a393f15-9453-4011-a50d-9d3cc9f73be1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:01.624136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a393f15-9453-4011-a50d-9d3cc9f73be1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:01.633429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 474/964] 10.222.0.44 () {56 vars in 1115 bytes} [Thu May 5 15:14:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:01.640199 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa406ce3-7329-4c98-a541-22363f63b07e None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:01.745365 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa406ce3-7329-4c98-a541-22363f63b07e None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:01.781398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb044a79-27ad-4a4e-91f0-3d5e5c439e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:01.782522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044a79-27ad-4a4e-91f0-3d5e5c439e13 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:01.782976 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044a79-27ad-4a4e-91f0-3d5e5c439e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:01.783401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044a79-27ad-4a4e-91f0-3d5e5c439e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:01.795644 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb044a79-27ad-4a4e-91f0-3d5e5c439e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:01.797389 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb044a79-27ad-4a4e-91f0-3d5e5c439e13 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-eb044a79-27ad-4a4e-91f0-3d5e5c439e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:01.816631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:01.817814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:01.818807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:01.818807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:01.818807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:01.818807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:01.818807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 491/965] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:01.825769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a393f15-9453-4011-a50d-9d3cc9f73be1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:01.928949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a393f15-9453-4011-a50d-9d3cc9f73be1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:01.964181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c02cc-c3d0-4ec2-956a-60468145c2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:01.965226 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c02cc-c3d0-4ec2-956a-60468145c2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:01.966347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c02cc-c3d0-4ec2-956a-60468145c2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:01.966839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c02cc-c3d0-4ec2-956a-60468145c2f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:01.967762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c02cc-c3d0-4ec2-956a-60468145c2f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:01.968303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c02cc-c3d0-4ec2-956a-60468145c2f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:01.969871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c02cc-c3d0-4ec2-956a-60468145c2f6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:01.983316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 475/966] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:01.989015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb044a79-27ad-4a4e-91f0-3d5e5c439e13 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:02.092685 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb044a79-27ad-4a4e-91f0-3d5e5c439e13 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:02.127806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0beb08-8f5f-4d39-a01f-69ae4951efff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:02.129005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0beb08-8f5f-4d39-a01f-69ae4951efff None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:02.129503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0beb08-8f5f-4d39-a01f-69ae4951efff None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:02.129990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0beb08-8f5f-4d39-a01f-69ae4951efff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:02.138598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0beb08-8f5f-4d39-a01f-69ae4951efff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:02.140288 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0beb08-8f5f-4d39-a01f-69ae4951efff None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-aa0beb08-8f5f-4d39-a01f-69ae4951efff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:14:02.155096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:02.156026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:02.156980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:02.156980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:02.156980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:14:02.156980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:14:02.156980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:14:02.156980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:14:02.156980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:14:02.156980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:14:02.156980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:14:02.156980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:02.160578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 492/967] 10.222.0.44 () {56 vars in 1117 bytes} [Thu May 5 15:14:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:02.166700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c02cc-c3d0-4ec2-956a-60468145c2f6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:02.270703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c02cc-c3d0-4ec2-956a-60468145c2f6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:02.307951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680e4b0-9f8a-427e-9f21-510b28cf56e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:02.309622 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680e4b0-9f8a-427e-9f21-510b28cf56e0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:02.310395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680e4b0-9f8a-427e-9f21-510b28cf56e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:02.310903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680e4b0-9f8a-427e-9f21-510b28cf56e0 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:02.311961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680e4b0-9f8a-427e-9f21-510b28cf56e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:02.312482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680e4b0-9f8a-427e-9f21-510b28cf56e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:02.314112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680e4b0-9f8a-427e-9f21-510b28cf56e0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:02.333458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 476/968] 10.222.0.44 () {56 vars in 1149 bytes} [Thu May 5 15:14:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:02.339587 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0beb08-8f5f-4d39-a01f-69ae4951efff None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:02.447201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0beb08-8f5f-4d39-a01f-69ae4951efff None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:02.482101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fc885-c592-4248-84c8-e10d1618b520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:02.483145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fc885-c592-4248-84c8-e10d1618b520 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:02.483644 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fc885-c592-4248-84c8-e10d1618b520 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:02.484182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fc885-c592-4248-84c8-e10d1618b520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:02.553634 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fc885-c592-4248-84c8-e10d1618b520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:02.555473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fc885-c592-4248-84c8-e10d1618b520 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:02.657262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 493/969] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:14:02 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:14:02.664088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680e4b0-9f8a-427e-9f21-510b28cf56e0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:02.770313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680e4b0-9f8a-427e-9f21-510b28cf56e0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:02.803665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d34b1-9c79-44b9-b619-5b640e4efa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:02.804496 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d34b1-9c79-44b9-b619-5b640e4efa70 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:02.804783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d34b1-9c79-44b9-b619-5b640e4efa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:02.805067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d34b1-9c79-44b9-b619-5b640e4efa70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:02.817543 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d34b1-9c79-44b9-b619-5b640e4efa70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:02.819072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d34b1-9c79-44b9-b619-5b640e4efa70 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ca6d34b1-9c79-44b9-b619-5b640e4efa70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:02.839261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:02.840491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:02.842461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:02.842461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:02.842461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:02.842461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:02.842461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 477/970] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:02.847342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fc885-c592-4248-84c8-e10d1618b520 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:02.953561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fc885-c592-4248-84c8-e10d1618b520 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:02.987940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9433b-29db-46d2-8837-e56a99666d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:02.988617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9433b-29db-46d2-8837-e56a99666d46 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:02.988903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9433b-29db-46d2-8837-e56a99666d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:02.989187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9433b-29db-46d2-8837-e56a99666d46 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:02.989916 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9433b-29db-46d2-8837-e56a99666d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:02.990229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9433b-29db-46d2-8837-e56a99666d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:02.991636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9433b-29db-46d2-8837-e56a99666d46 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:03.004632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 494/971] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:03.004961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c805-1898-4b4f-9add-ff01b0cc5c6b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:03.005255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c805-1898-4b4f-9add-ff01b0cc5c6b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:03.005542 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c805-1898-4b4f-9add-ff01b0cc5c6b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:03.007159 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 478/972] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:14:03.009867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9433b-29db-46d2-8837-e56a99666d46 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:03.011996 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344b97-450b-4a19-bcd6-0baaf8e3dbcd None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:03.012924 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344b97-450b-4a19-bcd6-0baaf8e3dbcd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:03.013213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344b97-450b-4a19-bcd6-0baaf8e3dbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:03.033470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a0344b97-450b-4a19-bcd6-0baaf8e3dbcd None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:03.034949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a0344b97-450b-4a19-bcd6-0baaf8e3dbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:03.114419 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 479/973] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:03.130149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9433b-29db-46d2-8837-e56a99666d46 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:03.141181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344b97-450b-4a19-bcd6-0baaf8e3dbcd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:03.165611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590e640-f30b-4519-96da-28ac1976ab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:03.166551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590e640-f30b-4519-96da-28ac1976ab63 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:03.166903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590e640-f30b-4519-96da-28ac1976ab63 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:03.167253 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590e640-f30b-4519-96da-28ac1976ab63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:03.174676 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590e640-f30b-4519-96da-28ac1976ab63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:03.176256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590e640-f30b-4519-96da-28ac1976ab63 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-c590e640-f30b-4519-96da-28ac1976ab63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:14:03.192124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:03.194154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:03.196485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:14:03.196485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:14:03.196485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:14:03.196485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:14:03.196485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:14:03.196485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:14:03.196485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:03.196485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:03.196485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 495/974] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:14:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:03.201404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590e640-f30b-4519-96da-28ac1976ab63 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:03.265758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344b97-450b-4a19-bcd6-0baaf8e3dbcd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:03.310545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6bf2b-0aba-4889-bee9-cc0310fc62c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:03.310812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590e640-f30b-4519-96da-28ac1976ab63 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:03.311202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6bf2b-0aba-4889-bee9-cc0310fc62c8 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:03.311486 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6bf2b-0aba-4889-bee9-cc0310fc62c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:03.311756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6bf2b-0aba-4889-bee9-cc0310fc62c8 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:03.312657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6bf2b-0aba-4889-bee9-cc0310fc62c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:03.314882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6bf2b-0aba-4889-bee9-cc0310fc62c8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:03.345755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b674925-5afe-44f1-9e60-8bcc1f334842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:03.346619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b674925-5afe-44f1-9e60-8bcc1f334842 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:03.346978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b674925-5afe-44f1-9e60-8bcc1f334842 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:03.347329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b674925-5afe-44f1-9e60-8bcc1f334842 None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:03.348237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b674925-5afe-44f1-9e60-8bcc1f334842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:03.348622 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b674925-5afe-44f1-9e60-8bcc1f334842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:03.350188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b674925-5afe-44f1-9e60-8bcc1f334842 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:03.364246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 496/975] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:14:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:03.370244 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b674925-5afe-44f1-9e60-8bcc1f334842 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:03.398576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 480/976] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:14:03 2022] POST /identity/v3/services => generated 242 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:14:03.494895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b674925-5afe-44f1-9e60-8bcc1f334842 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:03.542372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e388e7-ab1a-4254-a364-8a23405db834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:03.543317 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e388e7-ab1a-4254-a364-8a23405db834 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:03.544743 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e388e7-ab1a-4254-a364-8a23405db834 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:03.545053 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e388e7-ab1a-4254-a364-8a23405db834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:03.545239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33623-a847-4401-8a9b-b81e82042d50 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:03.545535 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33623-a847-4401-8a9b-b81e82042d50 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:03.545819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33623-a847-4401-8a9b-b81e82042d50 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:03.546308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e388e7-ab1a-4254-a364-8a23405db834 None admin] RBAC: Adding query filter params (role.id=72ca4f6781fe43929329bb5827880242, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=6d5886d3fdab4730828183bd6204c6ef) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:03.546747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e388e7-ab1a-4254-a364-8a23405db834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:03.547530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 481/977] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:14:03.548469 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e388e7-ab1a-4254-a364-8a23405db834 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:03.552903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46096e15-2b39-46a3-a3a7-af671464f07b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:03.553189 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46096e15-2b39-46a3-a3a7-af671464f07b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:03.553470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46096e15-2b39-46a3-a3a7-af671464f07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:03.556338 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 497/978] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:14:03 2022] GET /identity/v3/role_assignments?user.id=6d5886d3fdab4730828183bd6204c6ef&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=72ca4f6781fe43929329bb5827880242 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:03.579022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-46096e15-2b39-46a3-a3a7-af671464f07b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:03.580536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-46096e15-2b39-46a3-a3a7-af671464f07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:03.661023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 482/979] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:03.686225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e388e7-ab1a-4254-a364-8a23405db834 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:03.800050 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e388e7-ab1a-4254-a364-8a23405db834 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:03.835083 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3f3f0-98b8-4835-a023-33ebddb2b709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:03.835821 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3f3f0-98b8-4835-a023-33ebddb2b709 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:03.836107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3f3f0-98b8-4835-a023-33ebddb2b709 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:03.836386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3f3f0-98b8-4835-a023-33ebddb2b709 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:03.837044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3f3f0-98b8-4835-a023-33ebddb2b709 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:03.838533 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3f3f0-98b8-4835-a023-33ebddb2b709 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-2fa3f3f0-98b8-4835-a023-33ebddb2b709 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:03.851531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:03.852655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:03.853541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 498/980] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 5 15:14:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:03.859308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46096e15-2b39-46a3-a3a7-af671464f07b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:03.879039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f16778-0c75-4bbe-9663-389fdc98d57f None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:03.879338 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f16778-0c75-4bbe-9663-389fdc98d57f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:03.879606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f16778-0c75-4bbe-9663-389fdc98d57f None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:03.881224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 499/981] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:14:03.886708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42220c0-7945-4d97-9425-4501830db684 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:03.887604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42220c0-7945-4d97-9425-4501830db684 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:03.887999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42220c0-7945-4d97-9425-4501830db684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:03.910154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-d42220c0-7945-4d97-9425-4501830db684 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:03.911827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d42220c0-7945-4d97-9425-4501830db684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:03.970669 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46096e15-2b39-46a3-a3a7-af671464f07b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:03.987554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 500/982] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:04.006999 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7b686-e11a-4617-95bb-ae34ce6d1d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:04.007683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7b686-e11a-4617-95bb-ae34ce6d1d22 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:04.007970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7b686-e11a-4617-95bb-ae34ce6d1d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:04.008252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7b686-e11a-4617-95bb-ae34ce6d1d22 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:04.008964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7b686-e11a-4617-95bb-ae34ce6d1d22 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:04.009272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7b686-e11a-4617-95bb-ae34ce6d1d22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:04.009718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42220c0-7945-4d97-9425-4501830db684 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:04.010694 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7b686-e11a-4617-95bb-ae34ce6d1d22 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:04.016228 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 483/983] 10.222.0.44 () {56 vars in 1122 bytes} [Thu May 5 15:14:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:04.021483 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7b686-e11a-4617-95bb-ae34ce6d1d22 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:04.124840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7b686-e11a-4617-95bb-ae34ce6d1d22 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:04.131035 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42220c0-7945-4d97-9425-4501830db684 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:04.158673 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6050fcf-2d28-4847-bd2e-2e7c2646fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:04.159601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6050fcf-2d28-4847-bd2e-2e7c2646fe81 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:04.160046 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6050fcf-2d28-4847-bd2e-2e7c2646fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:04.160471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6050fcf-2d28-4847-bd2e-2e7c2646fe81 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:04.161575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6050fcf-2d28-4847-bd2e-2e7c2646fe81 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:04.162079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6050fcf-2d28-4847-bd2e-2e7c2646fe81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:04.163614 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6050fcf-2d28-4847-bd2e-2e7c2646fe81 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:04.169347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 484/984] 10.222.0.44 () {56 vars in 1122 bytes} [Thu May 5 15:14:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:04.173565 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbf32a-e053-487d-b898-ca4f95d4b4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:04.175399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6050fcf-2d28-4847-bd2e-2e7c2646fe81 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:04.176085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbf32a-e053-487d-b898-ca4f95d4b4eb None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:04.176858 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbf32a-e053-487d-b898-ca4f95d4b4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:04.177296 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbf32a-e053-487d-b898-ca4f95d4b4eb None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:04.178148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbf32a-e053-487d-b898-ca4f95d4b4eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:04.179768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbf32a-e053-487d-b898-ca4f95d4b4eb None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:04.181243 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: WARNING keystone.server.flask.common [None req-b6bbf32a-e053-487d-b898-ca4f95d4b4eb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 05 15:14:04.232841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.sql.core [None req-b6bbf32a-e053-487d-b898-ca4f95d4b4eb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 15:14:04.232841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 05 15:14:04.232841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [parameters: {'user_id': '862b79bc539e449595e58d9a996678de', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 05 15:14:04.232841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80060) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-b6bbf32a-e053-487d-b898-ca4f95d4b4eb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application conn.query(q) May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application result.read() May 05 15:14:04.240813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:14:04.248693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application next(self.gen) May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application yield resource May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application next(self.gen) May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self.session.rollback() May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self.force_reraise() May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise self.value May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application session.commit() May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 15:14:04.249910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._prepare_impl() May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self.session.flush() May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._flush(objects) May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application compat.raise_( May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application flush_context.execute() May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rec.execute(self) May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 15:14:04.251124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application result = connection._execute_20( May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:14:04.252388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application conn.query(q) May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application result.read() May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:14:04.253554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [parameters: {'user_id': '862b79bc539e449595e58d9a996678de', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:04.254666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 05 15:14:04.255787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 05 15:14:04.256909 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 05 15:14:04.256909 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 05 15:14:04.256909 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 15:14:04.256909 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 15:14:04.256909 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 05 15:14:04.256909 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:04.257490 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 501/985] 10.222.0.44 () {60 vars in 1131 bytes} [Thu May 5 15:14:04 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:04.259810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbf32a-e053-487d-b898-ca4f95d4b4eb None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:04.297958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6050fcf-2d28-4847-bd2e-2e7c2646fe81 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:04.342945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc6abc-f5d8-4e90-9472-300023295746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:04.344077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6abc-f5d8-4e90-9472-300023295746 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:04.344455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6abc-f5d8-4e90-9472-300023295746 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:04.344835 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6abc-f5d8-4e90-9472-300023295746 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:04.346050 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc6abc-f5d8-4e90-9472-300023295746 None admin] RBAC: Adding query filter params (interface=admin, service_id=5808e05a427f4ebb9ddab00aa51165e1, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:04.346488 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc6abc-f5d8-4e90-9472-300023295746 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:04.348494 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc6abc-f5d8-4e90-9472-300023295746 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:04.354792 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 485/986] 10.222.0.44 () {56 vars in 1249 bytes} [Thu May 5 15:14:04 2022] GET /identity/v3/endpoints?service_id=5808e05a427f4ebb9ddab00aa51165e1&interface=admin®ion_id=RegionOne => generated 193 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:04.361384 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc6abc-f5d8-4e90-9472-300023295746 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:04.373303 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbf32a-e053-487d-b898-ca4f95d4b4eb None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:04.414564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec6fff-6eb9-45dd-824c-3e1de28d61d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:04.416017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec6fff-6eb9-45dd-824c-3e1de28d61d0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:04.416431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec6fff-6eb9-45dd-824c-3e1de28d61d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:04.416812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec6fff-6eb9-45dd-824c-3e1de28d61d0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:04.429363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec6fff-6eb9-45dd-824c-3e1de28d61d0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:04.431206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec6fff-6eb9-45dd-824c-3e1de28d61d0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-b3ec6fff-6eb9-45dd-824c-3e1de28d61d0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:14:04.455846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:04.457076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:04.458248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:04.458248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:04.458248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:14:04.458248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:14:04.458248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:14:04.458248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:14:04.458248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:14:04.458248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:14:04.458248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:14:04.458248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:04.465009 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 502/987] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:14:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:04.466869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec6fff-6eb9-45dd-824c-3e1de28d61d0 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:04.491933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc6abc-f5d8-4e90-9472-300023295746 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:04.536859 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80495b-2440-4869-82a2-5d03b39dcc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:04.537858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80495b-2440-4869-82a2-5d03b39dcc58 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:04.538269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80495b-2440-4869-82a2-5d03b39dcc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:04.539416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80495b-2440-4869-82a2-5d03b39dcc58 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:04.540225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80495b-2440-4869-82a2-5d03b39dcc58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:04.541700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80495b-2440-4869-82a2-5d03b39dcc58 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:04.550438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 486/988] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 5 15:14:04 2022] GET /identity/v3/services => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:14:04.581081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec6fff-6eb9-45dd-824c-3e1de28d61d0 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:04.617502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd277f2e-de43-4e36-aed6-0b31818bffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:04.618483 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd277f2e-de43-4e36-aed6-0b31818bffd4 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:04.618908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd277f2e-de43-4e36-aed6-0b31818bffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:04.619353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd277f2e-de43-4e36-aed6-0b31818bffd4 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:04.620427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd277f2e-de43-4e36-aed6-0b31818bffd4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:04.620893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd277f2e-de43-4e36-aed6-0b31818bffd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:04.623517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd277f2e-de43-4e36-aed6-0b31818bffd4 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:04.674649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 503/989] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 5 15:14:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:05.772547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f235193-c6f0-407c-9e38-96918e3d316b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:05.773048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f235193-c6f0-407c-9e38-96918e3d316b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:05.773125 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f235193-c6f0-407c-9e38-96918e3d316b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:05.774723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 487/990] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:05.780091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df204cec-a51e-4389-b51d-97a2bdd944ec None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:05.780542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df204cec-a51e-4389-b51d-97a2bdd944ec None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:05.780630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df204cec-a51e-4389-b51d-97a2bdd944ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:05.798806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-df204cec-a51e-4389-b51d-97a2bdd944ec None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:05.800800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-df204cec-a51e-4389-b51d-97a2bdd944ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:05.866084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 504/991] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:05.888267 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f235193-c6f0-407c-9e38-96918e3d316b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:05.925742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7628a2-0ad9-4d22-ba1f-3f128a91217b None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:05.926111 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7628a2-0ad9-4d22-ba1f-3f128a91217b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:05.926502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7628a2-0ad9-4d22-ba1f-3f128a91217b None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:05.928013 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 505/992] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:14:05.932819 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9c432-0268-4549-a06b-9691812b5c50 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:05.933115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9c432-0268-4549-a06b-9691812b5c50 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:05.933394 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9c432-0268-4549-a06b-9691812b5c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:05.950197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-8fd9c432-0268-4549-a06b-9691812b5c50 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:05.951398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8fd9c432-0268-4549-a06b-9691812b5c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:05.998890 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f235193-c6f0-407c-9e38-96918e3d316b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:06.020371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 506/993] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:06.032361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca85a7-9483-48dd-8d58-60573decb875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:06.033213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca85a7-9483-48dd-8d58-60573decb875 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:06.033499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca85a7-9483-48dd-8d58-60573decb875 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:06.033772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca85a7-9483-48dd-8d58-60573decb875 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:06.034446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca85a7-9483-48dd-8d58-60573decb875 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:06.035804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca85a7-9483-48dd-8d58-60573decb875 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:06.042574 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9c432-0268-4549-a06b-9691812b5c50 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e4ca85a7-9483-48dd-8d58-60573decb875 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:06.048135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:06.049108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:06.049962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 488/994] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:14:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:06.055277 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca85a7-9483-48dd-8d58-60573decb875 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:06.143522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9c432-0268-4549-a06b-9691812b5c50 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:06.155684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca85a7-9483-48dd-8d58-60573decb875 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:06.180111 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26d593-a021-43cf-8d1a-3e0ade6472ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:06.181627 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26d593-a021-43cf-8d1a-3e0ade6472ef None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:06.182379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26d593-a021-43cf-8d1a-3e0ade6472ef None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:06.182829 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26d593-a021-43cf-8d1a-3e0ade6472ef None admin] PATH_INFO: `/v3/services/image` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:06.183792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26d593-a021-43cf-8d1a-3e0ade6472ef None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:06.186885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26d593-a021-43cf-8d1a-3e0ade6472ef None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:06.189763 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6348df-0369-42a1-8b25-d20cfebaf79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:06.190472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6348df-0369-42a1-8b25-d20cfebaf79e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:06.190761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6348df-0369-42a1-8b25-d20cfebaf79e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:06.191042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6348df-0369-42a1-8b25-d20cfebaf79e None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:06.191755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6348df-0369-42a1-8b25-d20cfebaf79e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:06.192066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6348df-0369-42a1-8b25-d20cfebaf79e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:06.193440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6348df-0369-42a1-8b25-d20cfebaf79e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:06.198138 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 489/995] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 5 15:14:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-1a26d593-a021-43cf-8d1a-3e0ade6472ef None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:06.201895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:06.203116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:14:06.204273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:06.205188 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6348df-0369-42a1-8b25-d20cfebaf79e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:06.206921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 507/996] 10.222.0.44 () {56 vars in 1105 bytes} [Thu May 5 15:14:06 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:06.212473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26d593-a021-43cf-8d1a-3e0ade6472ef None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:06.307192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6348df-0369-42a1-8b25-d20cfebaf79e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:06.321040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26d593-a021-43cf-8d1a-3e0ade6472ef None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:06.344039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e550658-1bab-4eec-ba5b-00bd1ebc9d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:06.344711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e550658-1bab-4eec-ba5b-00bd1ebc9d07 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:06.345148 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e550658-1bab-4eec-ba5b-00bd1ebc9d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:06.345436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e550658-1bab-4eec-ba5b-00bd1ebc9d07 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:06.346505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e550658-1bab-4eec-ba5b-00bd1ebc9d07 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:06.347146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e550658-1bab-4eec-ba5b-00bd1ebc9d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:06.349013 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e550658-1bab-4eec-ba5b-00bd1ebc9d07 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:06.354689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 490/997] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 5 15:14:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:06.361099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e550658-1bab-4eec-ba5b-00bd1ebc9d07 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:06.361769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db550d4-13f3-4e99-9c4d-f1b0da629caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:06.362612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db550d4-13f3-4e99-9c4d-f1b0da629caa None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:06.363020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db550d4-13f3-4e99-9c4d-f1b0da629caa None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:06.363419 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db550d4-13f3-4e99-9c4d-f1b0da629caa None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:06.364254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db550d4-13f3-4e99-9c4d-f1b0da629caa None admin] RBAC: Adding query filter params (name=image) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:06.364669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db550d4-13f3-4e99-9c4d-f1b0da629caa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:06.366145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db550d4-13f3-4e99-9c4d-f1b0da629caa None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:06.371380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 508/998] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:06.377712 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db550d4-13f3-4e99-9c4d-f1b0da629caa None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:06.464375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e550658-1bab-4eec-ba5b-00bd1ebc9d07 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:06.479499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db550d4-13f3-4e99-9c4d-f1b0da629caa None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:06.498750 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50506d-a8ef-4a2a-acbc-754e9c9d0fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:06.499418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50506d-a8ef-4a2a-acbc-754e9c9d0fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:06.499702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50506d-a8ef-4a2a-acbc-754e9c9d0fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:06.499985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50506d-a8ef-4a2a-acbc-754e9c9d0fe7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:06.500830 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50506d-a8ef-4a2a-acbc-754e9c9d0fe7 None admin] RBAC: Adding query filter params (interface=public, service_id=6750035d44ca4ba5849a18aee574c0a5, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:06.501143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50506d-a8ef-4a2a-acbc-754e9c9d0fe7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:06.502661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50506d-a8ef-4a2a-acbc-754e9c9d0fe7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:06.507708 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 491/999] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 5 15:14:06 2022] GET /identity/v3/endpoints?service_id=6750035d44ca4ba5849a18aee574c0a5&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:06.513540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50506d-a8ef-4a2a-acbc-754e9c9d0fe7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:06.514028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825af95-4992-4e89-a3f7-8d3f5a73e6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:06.514960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825af95-4992-4e89-a3f7-8d3f5a73e6db None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:06.515384 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825af95-4992-4e89-a3f7-8d3f5a73e6db None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:06.515920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825af95-4992-4e89-a3f7-8d3f5a73e6db None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:06.516780 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825af95-4992-4e89-a3f7-8d3f5a73e6db None admin] RBAC: Adding query filter params (type=image) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:06.517084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825af95-4992-4e89-a3f7-8d3f5a73e6db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:06.518544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825af95-4992-4e89-a3f7-8d3f5a73e6db None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:06.533766 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 509/1000] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:06.618498 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50506d-a8ef-4a2a-acbc-754e9c9d0fe7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:06.655685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab3a42-4cfe-4561-9ea0-ac1e26cd3a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:06.656380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3a42-4cfe-4561-9ea0-ac1e26cd3a11 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:06.656665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3a42-4cfe-4561-9ea0-ac1e26cd3a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:06.656941 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab3a42-4cfe-4561-9ea0-ac1e26cd3a11 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:06.657630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab3a42-4cfe-4561-9ea0-ac1e26cd3a11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:06.659146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab3a42-4cfe-4561-9ea0-ac1e26cd3a11 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:06.670573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 492/1001] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 5 15:14:06 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:14:06.897948 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c819e0-52a6-44ce-97b8-8d80a8a93ccf None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:06.898485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c819e0-52a6-44ce-97b8-8d80a8a93ccf None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:06.898589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c819e0-52a6-44ce-97b8-8d80a8a93ccf None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:06.900068 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 510/1002] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:06.905611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422ccd8-7059-46ab-8e7c-c90e5150c219 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:06.906033 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422ccd8-7059-46ab-8e7c-c90e5150c219 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:06.906273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422ccd8-7059-46ab-8e7c-c90e5150c219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:06.923421 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c422ccd8-7059-46ab-8e7c-c90e5150c219 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:06.924600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c422ccd8-7059-46ab-8e7c-c90e5150c219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:06.989156 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 493/1003] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:07.012232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c819e0-52a6-44ce-97b8-8d80a8a93ccf None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:07.108956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c819e0-52a6-44ce-97b8-8d80a8a93ccf None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:07.142267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b74a-51b7-4313-a67d-3d1ad1ae590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:07.143203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b74a-51b7-4313-a67d-3d1ad1ae590f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:07.143482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b74a-51b7-4313-a67d-3d1ad1ae590f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:07.143755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b74a-51b7-4313-a67d-3d1ad1ae590f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:07.144400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8b74a-51b7-4313-a67d-3d1ad1ae590f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:07.149988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8b74a-51b7-4313-a67d-3d1ad1ae590f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-91e8b74a-51b7-4313-a67d-3d1ad1ae590f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:07.166891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:07.167895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:14:07.169240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:07.173984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 511/1004] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 5 15:14:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:07.175353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422ccd8-7059-46ab-8e7c-c90e5150c219 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:07.270601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422ccd8-7059-46ab-8e7c-c90e5150c219 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:07.303275 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca617a94-35e0-45ca-aaf5-96981d5a548c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:07.303940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca617a94-35e0-45ca-aaf5-96981d5a548c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:07.304223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca617a94-35e0-45ca-aaf5-96981d5a548c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:07.304501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca617a94-35e0-45ca-aaf5-96981d5a548c None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:07.305198 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca617a94-35e0-45ca-aaf5-96981d5a548c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:07.305503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca617a94-35e0-45ca-aaf5-96981d5a548c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:07.306892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca617a94-35e0-45ca-aaf5-96981d5a548c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:07.316659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 494/1005] 10.222.0.44 () {56 vars in 1122 bytes} [Thu May 5 15:14:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:07.318215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b74a-51b7-4313-a67d-3d1ad1ae590f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:07.417511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b74a-51b7-4313-a67d-3d1ad1ae590f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:07.449899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777cc24-d870-43f6-85b1-2194bc567169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:07.450672 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777cc24-d870-43f6-85b1-2194bc567169 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:07.450958 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777cc24-d870-43f6-85b1-2194bc567169 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:07.451232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777cc24-d870-43f6-85b1-2194bc567169 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:07.451936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777cc24-d870-43f6-85b1-2194bc567169 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:07.452240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777cc24-d870-43f6-85b1-2194bc567169 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:07.453597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777cc24-d870-43f6-85b1-2194bc567169 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:07.462374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 512/1006] 10.222.0.44 () {56 vars in 1122 bytes} [Thu May 5 15:14:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:07.464439 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca617a94-35e0-45ca-aaf5-96981d5a548c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:07.563219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca617a94-35e0-45ca-aaf5-96981d5a548c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:07.596184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb7a5c-c80d-44ad-8c58-1202d304d457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:07.596849 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb7a5c-c80d-44ad-8c58-1202d304d457 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:07.597134 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb7a5c-c80d-44ad-8c58-1202d304d457 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:07.597413 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb7a5c-c80d-44ad-8c58-1202d304d457 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:07.598162 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb7a5c-c80d-44ad-8c58-1202d304d457 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:07.599584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb7a5c-c80d-44ad-8c58-1202d304d457 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:07.686400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 495/1007] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 5 15:14:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:14:08.835195 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107281f-e356-42ea-a082-3734a220c20a None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:08.835707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107281f-e356-42ea-a082-3734a220c20a None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:08.835785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107281f-e356-42ea-a082-3734a220c20a None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:08.837345 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 513/1008] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:08.844324 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d0d37-4aa3-460a-90a6-0d0b16b080bf None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:08.844820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d0d37-4aa3-460a-90a6-0d0b16b080bf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:08.844899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d0d37-4aa3-460a-90a6-0d0b16b080bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:08.862752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-eb8d0d37-4aa3-460a-90a6-0d0b16b080bf None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:08.863940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-eb8d0d37-4aa3-460a-90a6-0d0b16b080bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:08.936436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 496/1009] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:08.954627 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded66fe-1a22-4b7e-a1f9-ed647fb12153 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:08.954927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded66fe-1a22-4b7e-a1f9-ed647fb12153 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:08.955210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded66fe-1a22-4b7e-a1f9-ed647fb12153 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:08.956707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 514/1010] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:08.958524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d0d37-4aa3-460a-90a6-0d0b16b080bf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:08.961213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581b553-a050-4812-a12c-6d3310108ed8 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:08.961506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581b553-a050-4812-a12c-6d3310108ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:08.961786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581b553-a050-4812-a12c-6d3310108ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:08.978844 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-9581b553-a050-4812-a12c-6d3310108ed8 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:08.980038 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9581b553-a050-4812-a12c-6d3310108ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:09.044650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 515/1011] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:09.057055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d0d37-4aa3-460a-90a6-0d0b16b080bf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:09.067078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581b553-a050-4812-a12c-6d3310108ed8 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:09.091757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab47b9-135f-480f-a81e-48f5fad0bd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:09.092756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab47b9-135f-480f-a81e-48f5fad0bd67 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:09.093374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab47b9-135f-480f-a81e-48f5fad0bd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:09.093899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab47b9-135f-480f-a81e-48f5fad0bd67 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:09.094783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab47b9-135f-480f-a81e-48f5fad0bd67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:09.096182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab47b9-135f-480f-a81e-48f5fad0bd67 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:09.162161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581b553-a050-4812-a12c-6d3310108ed8 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:09.195165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fab157-7d24-4393-ad06-6cf20bc17943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:09.196021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fab157-7d24-4393-ad06-6cf20bc17943 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:09.196324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fab157-7d24-4393-ad06-6cf20bc17943 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:09.196622 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fab157-7d24-4393-ad06-6cf20bc17943 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:09.197278 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fab157-7d24-4393-ad06-6cf20bc17943 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:09.198730 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fab157-7d24-4393-ad06-6cf20bc17943 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:09.200076 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 497/1012] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:14:08 2022] POST /identity/v3/services => generated 242 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-f4fab157-7d24-4393-ad06-6cf20bc17943 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:09.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:09.213537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:09.214597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 516/1013] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:14:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:09.220676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab47b9-135f-480f-a81e-48f5fad0bd67 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:09.342609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab47b9-135f-480f-a81e-48f5fad0bd67 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:09.378517 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b73135-07d9-4091-9aba-2032c0a52934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:09.379655 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b73135-07d9-4091-9aba-2032c0a52934 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:09.379655 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b73135-07d9-4091-9aba-2032c0a52934 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:09.379868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b73135-07d9-4091-9aba-2032c0a52934 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:09.380398 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b73135-07d9-4091-9aba-2032c0a52934 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:09.380703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b73135-07d9-4091-9aba-2032c0a52934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:09.382823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b73135-07d9-4091-9aba-2032c0a52934 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:09.388822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 498/1014] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 5 15:14:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:09.394429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fab157-7d24-4393-ad06-6cf20bc17943 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:09.495754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fab157-7d24-4393-ad06-6cf20bc17943 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:09.528853 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087ea86-2090-4385-9f8d-a3b681fde81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:09.529555 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ea86-2090-4385-9f8d-a3b681fde81a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:09.529835 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ea86-2090-4385-9f8d-a3b681fde81a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:09.530109 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ea86-2090-4385-9f8d-a3b681fde81a None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:09.530837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087ea86-2090-4385-9f8d-a3b681fde81a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:09.531142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087ea86-2090-4385-9f8d-a3b681fde81a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:09.532603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087ea86-2090-4385-9f8d-a3b681fde81a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:09.537787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 517/1015] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 5 15:14:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:09.543608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b73135-07d9-4091-9aba-2032c0a52934 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:09.641751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b73135-07d9-4091-9aba-2032c0a52934 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:09.676849 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b9134-b6e5-4c4d-8d82-21392941026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:09.677512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b9134-b6e5-4c4d-8d82-21392941026f None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:09.677793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b9134-b6e5-4c4d-8d82-21392941026f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:09.678067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b9134-b6e5-4c4d-8d82-21392941026f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:09.678862 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b9134-b6e5-4c4d-8d82-21392941026f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:09.680204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b9134-b6e5-4c4d-8d82-21392941026f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:09.765053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 499/1016] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 5 15:14:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:14:10.014193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b0339-c6b0-4d87-a33c-f2b26840c4c9 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:10.014703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b0339-c6b0-4d87-a33c-f2b26840c4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:10.014703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b0339-c6b0-4d87-a33c-f2b26840c4c9 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:10.016064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 518/1017] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:10.022326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55440-3c72-45ac-96bd-7b06eacbe8fa None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:10.022326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55440-3c72-45ac-96bd-7b06eacbe8fa None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:10.022326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55440-3c72-45ac-96bd-7b06eacbe8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:10.041477 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8af55440-3c72-45ac-96bd-7b06eacbe8fa None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:10.042767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8af55440-3c72-45ac-96bd-7b06eacbe8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:10.124578 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 500/1018] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:10.151175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b0339-c6b0-4d87-a33c-f2b26840c4c9 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:10.255474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b0339-c6b0-4d87-a33c-f2b26840c4c9 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:10.287444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee939d5-a853-4c2d-8d21-0f8059ec546d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:10.288170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee939d5-a853-4c2d-8d21-0f8059ec546d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:10.288449 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee939d5-a853-4c2d-8d21-0f8059ec546d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:10.288755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee939d5-a853-4c2d-8d21-0f8059ec546d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:10.289884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee939d5-a853-4c2d-8d21-0f8059ec546d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:10.291339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee939d5-a853-4c2d-8d21-0f8059ec546d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:10.293116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 519/1019] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:10.299440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af55440-3c72-45ac-96bd-7b06eacbe8fa None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:10.396861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af55440-3c72-45ac-96bd-7b06eacbe8fa None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:10.430170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203645e-aaa2-4934-bc5e-6ffea0ad3782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:10.430862 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203645e-aaa2-4934-bc5e-6ffea0ad3782 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:10.431146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203645e-aaa2-4934-bc5e-6ffea0ad3782 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:10.431421 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203645e-aaa2-4934-bc5e-6ffea0ad3782 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:10.432129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203645e-aaa2-4934-bc5e-6ffea0ad3782 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:10.433548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203645e-aaa2-4934-bc5e-6ffea0ad3782 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:10.519871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 501/1020] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:14:10 2022] POST /identity/v3/projects => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:14:11.513120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd94a61-7651-4207-81f0-7e13fe254ec8 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:11.513647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd94a61-7651-4207-81f0-7e13fe254ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:11.513726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd94a61-7651-4207-81f0-7e13fe254ec8 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:11.515388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 520/1021] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:11.520476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf5e5d-7027-4353-aaa6-49cf91c0a2a3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:11.520881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf5e5d-7027-4353-aaa6-49cf91c0a2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:11.521095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf5e5d-7027-4353-aaa6-49cf91c0a2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:11.538584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f0bf5e5d-7027-4353-aaa6-49cf91c0a2a3 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:11.539759 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f0bf5e5d-7027-4353-aaa6-49cf91c0a2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:11.605601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 502/1022] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:11.628306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd94a61-7651-4207-81f0-7e13fe254ec8 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:11.730737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd94a61-7651-4207-81f0-7e13fe254ec8 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:11.764164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47b5d4-57d4-49eb-be75-ae8daa9f4e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:11.764909 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47b5d4-57d4-49eb-be75-ae8daa9f4e03 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:11.765199 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47b5d4-57d4-49eb-be75-ae8daa9f4e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:11.765478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47b5d4-57d4-49eb-be75-ae8daa9f4e03 None admin] PATH_INFO: `/v3/services/image` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:11.766130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47b5d4-57d4-49eb-be75-ae8daa9f4e03 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:11.767519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47b5d4-57d4-49eb-be75-ae8daa9f4e03 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-2a47b5d4-57d4-49eb-be75-ae8daa9f4e03 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:11.779504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:11.780491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:14:11.781324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:11.785628 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 521/1023] 10.222.0.44 () {56 vars in 1105 bytes} [Thu May 5 15:14:11 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:11.786748 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf5e5d-7027-4353-aaa6-49cf91c0a2a3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:11.882527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf5e5d-7027-4353-aaa6-49cf91c0a2a3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:11.916150 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aeaca-2b17-435f-8489-916a48199b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:11.916819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aeaca-2b17-435f-8489-916a48199b87 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:11.917102 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aeaca-2b17-435f-8489-916a48199b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:11.917381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aeaca-2b17-435f-8489-916a48199b87 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:11.918076 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aeaca-2b17-435f-8489-916a48199b87 None admin] RBAC: Adding query filter params (name=image) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:11.918957 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aeaca-2b17-435f-8489-916a48199b87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:11.920291 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aeaca-2b17-435f-8489-916a48199b87 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:11.929536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 503/1024] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:11.930631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47b5d4-57d4-49eb-be75-ae8daa9f4e03 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:12.026154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47b5d4-57d4-49eb-be75-ae8daa9f4e03 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:12.061358 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200fdd-4262-462e-a12f-1e136d99a8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:12.062064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200fdd-4262-462e-a12f-1e136d99a8ed None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:12.062379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200fdd-4262-462e-a12f-1e136d99a8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:12.062660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200fdd-4262-462e-a12f-1e136d99a8ed None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:12.063395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200fdd-4262-462e-a12f-1e136d99a8ed None admin] RBAC: Adding query filter params (type=image) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:12.063779 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200fdd-4262-462e-a12f-1e136d99a8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:12.065148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200fdd-4262-462e-a12f-1e136d99a8ed None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:12.076265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 522/1025] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:12.077398 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aeaca-2b17-435f-8489-916a48199b87 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:12.178181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aeaca-2b17-435f-8489-916a48199b87 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:12.211416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0cb3d-6fb6-4fd1-9a2a-4d93b118b612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:12.212085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0cb3d-6fb6-4fd1-9a2a-4d93b118b612 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:12.212369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0cb3d-6fb6-4fd1-9a2a-4d93b118b612 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:12.212645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0cb3d-6fb6-4fd1-9a2a-4d93b118b612 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:12.213438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0cb3d-6fb6-4fd1-9a2a-4d93b118b612 None admin] RBAC: Adding query filter params (interface=public, service_id=5598bbeff5c4475cafb2440d4191d080, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:12.213753 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0cb3d-6fb6-4fd1-9a2a-4d93b118b612 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:12.215340 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0cb3d-6fb6-4fd1-9a2a-4d93b118b612 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:12.225061 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 504/1026] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 5 15:14:12 2022] GET /identity/v3/endpoints?service_id=5598bbeff5c4475cafb2440d4191d080&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:12.226122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200fdd-4262-462e-a12f-1e136d99a8ed None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:12.260872 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b1e0-56c7-49da-80cf-6ff05efb01b5 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:12.261207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b1e0-56c7-49da-80cf-6ff05efb01b5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:12.261432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b1e0-56c7-49da-80cf-6ff05efb01b5 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:12.263098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 505/1027] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:14:12.268536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65948a3c-3bdd-48a2-a850-a8a6a13c3bc9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:12.268819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65948a3c-3bdd-48a2-a850-a8a6a13c3bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:12.269105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65948a3c-3bdd-48a2-a850-a8a6a13c3bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:12.285964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-65948a3c-3bdd-48a2-a850-a8a6a13c3bc9 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:12.287366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-65948a3c-3bdd-48a2-a850-a8a6a13c3bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:12.327270 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200fdd-4262-462e-a12f-1e136d99a8ed None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:12.354341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 506/1028] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:12.360904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b7848-e196-4aad-9549-ffa6c6f2cc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:12.361575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7848-e196-4aad-9549-ffa6c6f2cc25 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:12.361862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7848-e196-4aad-9549-ffa6c6f2cc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:12.362142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7848-e196-4aad-9549-ffa6c6f2cc25 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:12.362855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b7848-e196-4aad-9549-ffa6c6f2cc25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:12.364228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b7848-e196-4aad-9549-ffa6c6f2cc25 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:12.376819 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 523/1029] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 5 15:14:12 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:14:12.378007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65948a3c-3bdd-48a2-a850-a8a6a13c3bc9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:12.485167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65948a3c-3bdd-48a2-a850-a8a6a13c3bc9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:12.520211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab2b39-79c5-4ae0-a65e-9b2864dee2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:12.521049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2b39-79c5-4ae0-a65e-9b2864dee2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:12.521594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2b39-79c5-4ae0-a65e-9b2864dee2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:12.521594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2b39-79c5-4ae0-a65e-9b2864dee2f7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:12.532756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab2b39-79c5-4ae0-a65e-9b2864dee2f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ceab2b39-79c5-4ae0-a65e-9b2864dee2f7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:14:12.541588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:12.542836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:12.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:12.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:12.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:12.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:12.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:14:12.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:14:12.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:14:12.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:14:12.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:14:12.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:14:12.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:14:12.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:12.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 507/1030] 10.222.0.44 () {56 vars in 1120 bytes} [Thu May 5 15:14:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:12.551068 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b7848-e196-4aad-9549-ffa6c6f2cc25 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:12.654611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b7848-e196-4aad-9549-ffa6c6f2cc25 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:12.691800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6daf93-ba78-4690-8ae7-e836ad750140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:12.692878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6daf93-ba78-4690-8ae7-e836ad750140 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:12.693491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6daf93-ba78-4690-8ae7-e836ad750140 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:12.693967 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6daf93-ba78-4690-8ae7-e836ad750140 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:12.694941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6daf93-ba78-4690-8ae7-e836ad750140 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:12.695444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6daf93-ba78-4690-8ae7-e836ad750140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:12.697002 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6daf93-ba78-4690-8ae7-e836ad750140 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:12.710692 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 524/1031] 10.222.0.44 () {56 vars in 1115 bytes} [Thu May 5 15:14:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:12.712229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab2b39-79c5-4ae0-a65e-9b2864dee2f7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:12.823657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab2b39-79c5-4ae0-a65e-9b2864dee2f7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:12.840935 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3a613-e521-46c9-9e09-8caed5869816 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:12.841253 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3a613-e521-46c9-9e09-8caed5869816 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:12.841493 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3a613-e521-46c9-9e09-8caed5869816 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:12.843270 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 525/1032] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:14:12.848090 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa82b-cd83-4df1-8b4a-88c542e2f254 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:12.848379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa82b-cd83-4df1-8b4a-88c542e2f254 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:12.848660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa82b-cd83-4df1-8b4a-88c542e2f254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:12.859089 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fe37e-a53c-4e33-9192-9b18be49fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:12.859878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fe37e-a53c-4e33-9192-9b18be49fbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:12.860159 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fe37e-a53c-4e33-9192-9b18be49fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:12.860432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fe37e-a53c-4e33-9192-9b18be49fbb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:12.865692 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-0f3fa82b-cd83-4df1-8b4a-88c542e2f254 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:12.866915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-0f3fa82b-cd83-4df1-8b4a-88c542e2f254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:12.871103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fe37e-a53c-4e33-9192-9b18be49fbb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:12.872635 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fe37e-a53c-4e33-9192-9b18be49fbb2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-450fe37e-a53c-4e33-9192-9b18be49fbb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:12.889492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:12.890512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:12.891414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:12.891414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:12.891414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:12.891414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:12.891414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 508/1033] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:12.896152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fe37e-a53c-4e33-9192-9b18be49fbb2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:12.935720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 526/1034] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:12.960372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fa82b-cd83-4df1-8b4a-88c542e2f254 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:12.996155 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fe37e-a53c-4e33-9192-9b18be49fbb2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:13.030082 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901db6b3-4487-42a3-a3f8-1c5a3bef2039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:13.030783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901db6b3-4487-42a3-a3f8-1c5a3bef2039 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:13.031070 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901db6b3-4487-42a3-a3f8-1c5a3bef2039 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:13.031348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901db6b3-4487-42a3-a3f8-1c5a3bef2039 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:13.032067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901db6b3-4487-42a3-a3f8-1c5a3bef2039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:13.032376 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901db6b3-4487-42a3-a3f8-1c5a3bef2039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:13.033764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901db6b3-4487-42a3-a3f8-1c5a3bef2039 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:13.046127 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 509/1035] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:13.051520 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901db6b3-4487-42a3-a3f8-1c5a3bef2039 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:13.059539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fa82b-cd83-4df1-8b4a-88c542e2f254 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:13.096173 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae806c-8590-4a80-a598-adae9bc4012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:13.096900 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae806c-8590-4a80-a598-adae9bc4012c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:13.097183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae806c-8590-4a80-a598-adae9bc4012c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:13.097462 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae806c-8590-4a80-a598-adae9bc4012c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:13.098681 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae806c-8590-4a80-a598-adae9bc4012c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:13.100108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae806c-8590-4a80-a598-adae9bc4012c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:13.101863 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 527/1036] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:13.107899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae806c-8590-4a80-a598-adae9bc4012c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:13.149851 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901db6b3-4487-42a3-a3f8-1c5a3bef2039 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:13.185195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493ea45-b2ee-4e41-9de0-eb6371674fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:13.186154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493ea45-b2ee-4e41-9de0-eb6371674fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:13.186502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493ea45-b2ee-4e41-9de0-eb6371674fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:13.186946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493ea45-b2ee-4e41-9de0-eb6371674fb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:13.194812 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493ea45-b2ee-4e41-9de0-eb6371674fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:13.196247 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493ea45-b2ee-4e41-9de0-eb6371674fb5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:13.205001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae806c-8590-4a80-a598-adae9bc4012c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9493ea45-b2ee-4e41-9de0-eb6371674fb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:14:13.210762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:13.211721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:13.216933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:13.216933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:13.216933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:14:13.216933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:14:13.216933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:14:13.216933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:14:13.216933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:14:13.216933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:14:13.216933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:14:13.216933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:13.216933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 510/1037] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 5 15:14:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:13.218572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493ea45-b2ee-4e41-9de0-eb6371674fb5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:13.244102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264871f-cf1f-445d-8620-fe80fc14d2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:13.244781 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264871f-cf1f-445d-8620-fe80fc14d2e9 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:13.245061 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264871f-cf1f-445d-8620-fe80fc14d2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:13.245336 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264871f-cf1f-445d-8620-fe80fc14d2e9 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:13.246034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264871f-cf1f-445d-8620-fe80fc14d2e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:13.248359 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264871f-cf1f-445d-8620-fe80fc14d2e9 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:13.317662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493ea45-b2ee-4e41-9de0-eb6371674fb5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:13.351067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc49f40-111c-45b3-8e3d-295c0c84c07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:13.351712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49f40-111c-45b3-8e3d-295c0c84c07f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:13.351986 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49f40-111c-45b3-8e3d-295c0c84c07f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:13.352260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49f40-111c-45b3-8e3d-295c0c84c07f None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:13.353077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49f40-111c-45b3-8e3d-295c0c84c07f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:13.353383 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49f40-111c-45b3-8e3d-295c0c84c07f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:13.354883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49f40-111c-45b3-8e3d-295c0c84c07f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:13.365183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 528/1038] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:14:13 2022] POST /identity/v3/users => generated 285 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:14:13.374084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 511/1039] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 5 15:14:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:13.380164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264871f-cf1f-445d-8620-fe80fc14d2e9 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:13.486867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264871f-cf1f-445d-8620-fe80fc14d2e9 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:13.521405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8def-eb05-4acd-8d75-895c9b14f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:13.522132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8def-eb05-4acd-8d75-895c9b14f219 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:13.522456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8def-eb05-4acd-8d75-895c9b14f219 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:13.522732 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8def-eb05-4acd-8d75-895c9b14f219 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:13.594913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d8def-eb05-4acd-8d75-895c9b14f219 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:13.596427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d8def-eb05-4acd-8d75-895c9b14f219 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:13.701571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 529/1040] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:14:13 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:14:13.703276 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc49f40-111c-45b3-8e3d-295c0c84c07f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:13.804136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc49f40-111c-45b3-8e3d-295c0c84c07f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:13.837499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641972ab-e568-4c9b-9a5c-53d3eb6c41a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:13.838302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641972ab-e568-4c9b-9a5c-53d3eb6c41a4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:13.838594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641972ab-e568-4c9b-9a5c-53d3eb6c41a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:13.838867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641972ab-e568-4c9b-9a5c-53d3eb6c41a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:13.849284 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641972ab-e568-4c9b-9a5c-53d3eb6c41a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:13.850757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641972ab-e568-4c9b-9a5c-53d3eb6c41a4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-641972ab-e568-4c9b-9a5c-53d3eb6c41a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:13.867665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:13.868552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:13.874745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:13.874745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:13.874745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:13.874745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:13.874745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 512/1041] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:13.876613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8def-eb05-4acd-8d75-895c9b14f219 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:13.972158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8def-eb05-4acd-8d75-895c9b14f219 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:14.005496 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2008c-8406-4b36-b10b-f305e7bf2aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:14.006162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2008c-8406-4b36-b10b-f305e7bf2aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:14.006472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2008c-8406-4b36-b10b-f305e7bf2aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:14.006750 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2008c-8406-4b36-b10b-f305e7bf2aa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:14.007473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2008c-8406-4b36-b10b-f305e7bf2aa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:14.007777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2008c-8406-4b36-b10b-f305e7bf2aa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:14.009137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2008c-8406-4b36-b10b-f305e7bf2aa0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:14.020722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 530/1042] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:14.026212 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641972ab-e568-4c9b-9a5c-53d3eb6c41a4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:14.124668 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641972ab-e568-4c9b-9a5c-53d3eb6c41a4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:14.158065 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895ec5a-c8bf-4618-958b-bd7617c0d372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:14.158901 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895ec5a-c8bf-4618-958b-bd7617c0d372 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:14.159185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895ec5a-c8bf-4618-958b-bd7617c0d372 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:14.159466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895ec5a-c8bf-4618-958b-bd7617c0d372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:14.166303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895ec5a-c8bf-4618-958b-bd7617c0d372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:14.167757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895ec5a-c8bf-4618-958b-bd7617c0d372 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6895ec5a-c8bf-4618-958b-bd7617c0d372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:14:14.181764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:14.182946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:14.184572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:14:14.184572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:14:14.184572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:14:14.184572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:14:14.184572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:14:14.184572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:14:14.184572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:14.184572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:14.186362 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 513/1043] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:14:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:14.189804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2008c-8406-4b36-b10b-f305e7bf2aa0 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:14.289196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2008c-8406-4b36-b10b-f305e7bf2aa0 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:14.321796 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf5a26-1672-42c1-9e20-7e1dff2f0a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:14.322486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf5a26-1672-42c1-9e20-7e1dff2f0a1e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:14.322771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf5a26-1672-42c1-9e20-7e1dff2f0a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:14.323041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf5a26-1672-42c1-9e20-7e1dff2f0a1e None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:14.323826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf5a26-1672-42c1-9e20-7e1dff2f0a1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:14.324129 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf5a26-1672-42c1-9e20-7e1dff2f0a1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:14.325596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf5a26-1672-42c1-9e20-7e1dff2f0a1e None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:14.342712 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 531/1044] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:14:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:14.344512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895ec5a-c8bf-4618-958b-bd7617c0d372 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:14.443106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895ec5a-c8bf-4618-958b-bd7617c0d372 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:14.476373 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a598c-3625-49ee-9282-125d9c1a230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:14.477038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a598c-3625-49ee-9282-125d9c1a230d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:14.477322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a598c-3625-49ee-9282-125d9c1a230d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:14.477599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a598c-3625-49ee-9282-125d9c1a230d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:14.478459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a598c-3625-49ee-9282-125d9c1a230d None admin] RBAC: Adding query filter params (role.id=72ca4f6781fe43929329bb5827880242, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=eb4ff6ba4e17477d8787eaf1955bd1da) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:14.478775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a598c-3625-49ee-9282-125d9c1a230d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:14.480206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a598c-3625-49ee-9282-125d9c1a230d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:14.486043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 514/1045] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:14:14 2022] GET /identity/v3/role_assignments?user.id=eb4ff6ba4e17477d8787eaf1955bd1da&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=72ca4f6781fe43929329bb5827880242 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:14.725451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a51cc0-21b4-4621-8a41-8483ae71be14 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:14.725962 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a51cc0-21b4-4621-8a41-8483ae71be14 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:14.726041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a51cc0-21b4-4621-8a41-8483ae71be14 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:14.727568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 532/1046] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:14.733216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a538020-6493-454d-81b1-e849b921500c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:14.733657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a538020-6493-454d-81b1-e849b921500c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:14.733803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a538020-6493-454d-81b1-e849b921500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:14.753730 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8a538020-6493-454d-81b1-e849b921500c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:14.753730 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8a538020-6493-454d-81b1-e849b921500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:14.826335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 515/1047] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:14.848246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a51cc0-21b4-4621-8a41-8483ae71be14 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:14.949420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a51cc0-21b4-4621-8a41-8483ae71be14 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:14.984314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f38f85-4c1b-449d-b3f0-4120f5b282f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:14.985090 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f38f85-4c1b-449d-b3f0-4120f5b282f6 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:14.985370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f38f85-4c1b-449d-b3f0-4120f5b282f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:14.985656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f38f85-4c1b-449d-b3f0-4120f5b282f6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:14.986391 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f38f85-4c1b-449d-b3f0-4120f5b282f6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:14.987853 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f38f85-4c1b-449d-b3f0-4120f5b282f6 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-57f38f85-4c1b-449d-b3f0-4120f5b282f6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:14.999956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:15.000978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:15.001830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 533/1048] 10.222.0.44 () {56 vars in 1105 bytes} [Thu May 5 15:14:14 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:15.008742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a538020-6493-454d-81b1-e849b921500c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:15.104081 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a538020-6493-454d-81b1-e849b921500c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:15.137236 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0562f9-952d-4a87-b07e-d71a3eeb4130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:15.137908 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0562f9-952d-4a87-b07e-d71a3eeb4130 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:15.138187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0562f9-952d-4a87-b07e-d71a3eeb4130 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:15.138486 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0562f9-952d-4a87-b07e-d71a3eeb4130 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:15.139180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0562f9-952d-4a87-b07e-d71a3eeb4130 None admin] RBAC: Adding query filter params (name=image) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:15.139482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0562f9-952d-4a87-b07e-d71a3eeb4130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:15.140836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0562f9-952d-4a87-b07e-d71a3eeb4130 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:15.150316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 516/1049] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:15.151832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f38f85-4c1b-449d-b3f0-4120f5b282f6 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:15.253949 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f38f85-4c1b-449d-b3f0-4120f5b282f6 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:15.287342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06796c-489e-4bb0-acfe-64578d5ab324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:15.288015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06796c-489e-4bb0-acfe-64578d5ab324 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:15.288294 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06796c-489e-4bb0-acfe-64578d5ab324 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:15.288566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06796c-489e-4bb0-acfe-64578d5ab324 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:15.289267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06796c-489e-4bb0-acfe-64578d5ab324 None admin] RBAC: Adding query filter params (type=image) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:15.289569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06796c-489e-4bb0-acfe-64578d5ab324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:15.291040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06796c-489e-4bb0-acfe-64578d5ab324 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:15.300889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 534/1050] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:15.302788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0562f9-952d-4a87-b07e-d71a3eeb4130 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:15.400915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0562f9-952d-4a87-b07e-d71a3eeb4130 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:15.435603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f824e-499d-4e19-a390-d2538040960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:15.436444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f824e-499d-4e19-a390-d2538040960a None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:15.436733 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f824e-499d-4e19-a390-d2538040960a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:15.437079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f824e-499d-4e19-a390-d2538040960a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:15.437820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f824e-499d-4e19-a390-d2538040960a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:15.439304 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f824e-499d-4e19-a390-d2538040960a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:15.570101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 517/1051] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 5 15:14:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:14:15.703173 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e3f5-1746-4977-9779-58d2b82ca96d None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:15.703512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e3f5-1746-4977-9779-58d2b82ca96d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:15.703744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e3f5-1746-4977-9779-58d2b82ca96d None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:15.705151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 535/1052] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:15.710913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97851fa3-7cc7-4563-84a0-66f594624688 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:15.711224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97851fa3-7cc7-4563-84a0-66f594624688 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:15.711485 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97851fa3-7cc7-4563-84a0-66f594624688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:15.728837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-97851fa3-7cc7-4563-84a0-66f594624688 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:15.730063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-97851fa3-7cc7-4563-84a0-66f594624688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:15.812752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 518/1053] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:15.836291 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5e3f5-1746-4977-9779-58d2b82ca96d None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:15.940724 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5e3f5-1746-4977-9779-58d2b82ca96d None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:15.975265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70069a1-1003-4f1f-8b97-ede83ad4ff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:15.976414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70069a1-1003-4f1f-8b97-ede83ad4ff5b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:15.976938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70069a1-1003-4f1f-8b97-ede83ad4ff5b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:15.977414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70069a1-1003-4f1f-8b97-ede83ad4ff5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:15.988326 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70069a1-1003-4f1f-8b97-ede83ad4ff5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-a70069a1-1003-4f1f-8b97-ede83ad4ff5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:14:15.995869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:15.997718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:15.998889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:15.998889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:15.998889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:15.998889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:15.998889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:14:15.998889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:14:15.998889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:14:15.998889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:14:15.998889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:14:15.998889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:14:15.998889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:15.998889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:15.998889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 536/1054] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:14:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:16.003088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97851fa3-7cc7-4563-84a0-66f594624688 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:16.099250 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97851fa3-7cc7-4563-84a0-66f594624688 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:16.131136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ecb67-8234-466b-bfa0-d44d123a5544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:16.131786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ecb67-8234-466b-bfa0-d44d123a5544 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:16.132065 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ecb67-8234-466b-bfa0-d44d123a5544 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:16.132338 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ecb67-8234-466b-bfa0-d44d123a5544 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:16.133072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ecb67-8234-466b-bfa0-d44d123a5544 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:16.133370 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ecb67-8234-466b-bfa0-d44d123a5544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:16.135103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ecb67-8234-466b-bfa0-d44d123a5544 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:16.144102 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 519/1055] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:14:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:16.149542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70069a1-1003-4f1f-8b97-ede83ad4ff5b None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:16.245045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70069a1-1003-4f1f-8b97-ede83ad4ff5b None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:16.278868 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2e72d-505a-4200-9fad-ac5c6f0248f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:16.279749 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2e72d-505a-4200-9fad-ac5c6f0248f1 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:16.280029 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2e72d-505a-4200-9fad-ac5c6f0248f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:16.280300 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2e72d-505a-4200-9fad-ac5c6f0248f1 None admin] PATH_INFO: `/v3/users/5db36a4085be47b5bbcf3046ad754ff5` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:16.294401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2e72d-505a-4200-9fad-ac5c6f0248f1 None admin] RBAC: Authorizing `identity:get_user(user_id=5db36a4085be47b5bbcf3046ad754ff5)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:16.295816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2e72d-505a-4200-9fad-ac5c6f0248f1 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:16.297718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 537/1056] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:14:16 2022] GET /identity/v3/users/5db36a4085be47b5bbcf3046ad754ff5 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:16.305027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ecb67-8234-466b-bfa0-d44d123a5544 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:16.410414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ecb67-8234-466b-bfa0-d44d123a5544 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:16.445354 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ff943-f61e-43eb-b585-0040f26afaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:16.446007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ff943-f61e-43eb-b585-0040f26afaaf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:16.446313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ff943-f61e-43eb-b585-0040f26afaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:16.446590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ff943-f61e-43eb-b585-0040f26afaaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:16.511801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ff943-f61e-43eb-b585-0040f26afaaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:16.513232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ff943-f61e-43eb-b585-0040f26afaaf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:16.612701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 520/1057] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:14:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:14:16.618380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2e72d-505a-4200-9fad-ac5c6f0248f1 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:16.718002 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2e72d-505a-4200-9fad-ac5c6f0248f1 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:16.755959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de2b19-8ee4-4d01-8c2b-ac8b45709531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:16.755959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de2b19-8ee4-4d01-8c2b-ac8b45709531 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:16.755959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de2b19-8ee4-4d01-8c2b-ac8b45709531 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:16.755959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de2b19-8ee4-4d01-8c2b-ac8b45709531 None admin] PATH_INFO: `/v3/projects/6dfa83f7378044e389f598f4af9a5aaa` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:16.758346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de2b19-8ee4-4d01-8c2b-ac8b45709531 None admin] RBAC: Authorizing `identity:get_project(project_id=6dfa83f7378044e389f598f4af9a5aaa)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:16.760190 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de2b19-8ee4-4d01-8c2b-ac8b45709531 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:16.766785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 538/1058] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:14:16 2022] GET /identity/v3/projects/6dfa83f7378044e389f598f4af9a5aaa => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:16.768491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ff943-f61e-43eb-b585-0040f26afaaf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:16.776653 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126097f1-262f-4b4d-991c-c4c6a1b1baee None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:16.776952 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126097f1-262f-4b4d-991c-c4c6a1b1baee None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:16.777251 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126097f1-262f-4b4d-991c-c4c6a1b1baee None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:16.779171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 539/1059] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:14:16.784473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d5866-4997-4bcf-90df-b8412949268c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:16.784759 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d5866-4997-4bcf-90df-b8412949268c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:16.785037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d5866-4997-4bcf-90df-b8412949268c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:16.801488 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e31d5866-4997-4bcf-90df-b8412949268c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:16.804014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e31d5866-4997-4bcf-90df-b8412949268c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:16.866708 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ff943-f61e-43eb-b585-0040f26afaaf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:16.878333 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 540/1060] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:16.894366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d5866-4997-4bcf-90df-b8412949268c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:16.900600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2959ec-2169-4010-bee4-e5319a96f3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:16.901311 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2959ec-2169-4010-bee4-e5319a96f3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:16.901596 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2959ec-2169-4010-bee4-e5319a96f3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:16.901873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2959ec-2169-4010-bee4-e5319a96f3d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:16.903405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2959ec-2169-4010-bee4-e5319a96f3d7 None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=6dfa83f7378044e389f598f4af9a5aaa, user.id=5db36a4085be47b5bbcf3046ad754ff5) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:16.903720 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2959ec-2169-4010-bee4-e5319a96f3d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:16.905149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2959ec-2169-4010-bee4-e5319a96f3d7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:16.919182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 521/1061] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:14:16 2022] GET /identity/v3/role_assignments?user.id=5db36a4085be47b5bbcf3046ad754ff5&scope.project.id=6dfa83f7378044e389f598f4af9a5aaa&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:16.999026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d5866-4997-4bcf-90df-b8412949268c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:17.034113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe20cb0-9a9d-4e50-b0d2-b208d25d5e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:17.034989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe20cb0-9a9d-4e50-b0d2-b208d25d5e7d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:17.035275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe20cb0-9a9d-4e50-b0d2-b208d25d5e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:17.035556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe20cb0-9a9d-4e50-b0d2-b208d25d5e7d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:17.047677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe20cb0-9a9d-4e50-b0d2-b208d25d5e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-7fe20cb0-9a9d-4e50-b0d2-b208d25d5e7d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:14:17.056094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:17.057281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:17.064097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:17.064097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:17.064097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:17.064097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:17.064097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:14:17.064097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:14:17.064097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:14:17.064097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:14:17.064097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:14:17.064097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:14:17.064097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:14:17.064097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:17.064097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 541/1062] 10.222.0.44 () {56 vars in 1120 bytes} [Thu May 5 15:14:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:17.066469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2959ec-2169-4010-bee4-e5319a96f3d7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:17.167467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2959ec-2169-4010-bee4-e5319a96f3d7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:17.208695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c876bc-723a-4d5e-872c-fbb1c62196d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:17.210685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c876bc-723a-4d5e-872c-fbb1c62196d4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:17.210685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c876bc-723a-4d5e-872c-fbb1c62196d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:17.210685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c876bc-723a-4d5e-872c-fbb1c62196d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:17.210685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c876bc-723a-4d5e-872c-fbb1c62196d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:17.210950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c876bc-723a-4d5e-872c-fbb1c62196d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:17.212305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c876bc-723a-4d5e-872c-fbb1c62196d4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:17.225600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 522/1063] 10.222.0.44 () {56 vars in 1115 bytes} [Thu May 5 15:14:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:17.226920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe20cb0-9a9d-4e50-b0d2-b208d25d5e7d None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:17.326980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe20cb0-9a9d-4e50-b0d2-b208d25d5e7d None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:17.360131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a4827-b300-4d61-882d-39c9f8cdb145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:17.360926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a4827-b300-4d61-882d-39c9f8cdb145 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:17.361209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a4827-b300-4d61-882d-39c9f8cdb145 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:17.361485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a4827-b300-4d61-882d-39c9f8cdb145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:17.371863 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a4827-b300-4d61-882d-39c9f8cdb145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:17.373305 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a4827-b300-4d61-882d-39c9f8cdb145 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-a52a4827-b300-4d61-882d-39c9f8cdb145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:17.390080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:17.390997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:17.391911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:17.391911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:17.391911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:17.391911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:17.392763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 542/1064] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:17.396978 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c876bc-723a-4d5e-872c-fbb1c62196d4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:17.499721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c876bc-723a-4d5e-872c-fbb1c62196d4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:17.539288 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48f618-8370-48f5-86f8-3b7aeecdf86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:17.539955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f618-8370-48f5-86f8-3b7aeecdf86b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:17.540234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f618-8370-48f5-86f8-3b7aeecdf86b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:17.540507 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f618-8370-48f5-86f8-3b7aeecdf86b None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:17.541212 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48f618-8370-48f5-86f8-3b7aeecdf86b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:17.541515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48f618-8370-48f5-86f8-3b7aeecdf86b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:17.542911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48f618-8370-48f5-86f8-3b7aeecdf86b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:17.559763 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 523/1065] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:17.561160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a4827-b300-4d61-882d-39c9f8cdb145 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:17.661053 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a4827-b300-4d61-882d-39c9f8cdb145 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:17.695019 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257959fb-cbba-4d92-aab5-1af34c14ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:17.695836 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257959fb-cbba-4d92-aab5-1af34c14ccfa None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:17.696122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257959fb-cbba-4d92-aab5-1af34c14ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:17.696396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257959fb-cbba-4d92-aab5-1af34c14ccfa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:17.706091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257959fb-cbba-4d92-aab5-1af34c14ccfa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:17.707618 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257959fb-cbba-4d92-aab5-1af34c14ccfa None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-257959fb-cbba-4d92-aab5-1af34c14ccfa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:14:17.724018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:17.725088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:17.726059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:17.726059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:17.726059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:14:17.726059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:14:17.726059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:14:17.726059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:14:17.726059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:14:17.726059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:14:17.726059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:14:17.726059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:17.726059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 543/1066] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 5 15:14:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:17.733370 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48f618-8370-48f5-86f8-3b7aeecdf86b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:17.841559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48f618-8370-48f5-86f8-3b7aeecdf86b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:17.874928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7917f62-0867-4341-ad9b-694030e37065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:17.875687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7917f62-0867-4341-ad9b-694030e37065 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:17.875958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7917f62-0867-4341-ad9b-694030e37065 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:17.876154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7917f62-0867-4341-ad9b-694030e37065 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:17.876982 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7917f62-0867-4341-ad9b-694030e37065 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:17.877289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7917f62-0867-4341-ad9b-694030e37065 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:17.878752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7917f62-0867-4341-ad9b-694030e37065 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:17.896311 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 524/1067] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 5 15:14:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:17.898102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49dcda-c45c-437d-bfa9-d71cf64ebf65 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:17.898601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49dcda-c45c-437d-bfa9-d71cf64ebf65 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:17.898739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49dcda-c45c-437d-bfa9-d71cf64ebf65 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:17.900299 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 544/1068] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:17.901614 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7917f62-0867-4341-ad9b-694030e37065 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:17.905335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c6ab8-e0ac-46aa-8fb3-566f2b06e788 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:17.905645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c6ab8-e0ac-46aa-8fb3-566f2b06e788 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:17.905898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c6ab8-e0ac-46aa-8fb3-566f2b06e788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:17.923549 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-435c6ab8-e0ac-46aa-8fb3-566f2b06e788 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:17.924645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-435c6ab8-e0ac-46aa-8fb3-566f2b06e788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:17.994565 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 545/1069] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:18.005431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7917f62-0867-4341-ad9b-694030e37065 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:18.014007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c6ab8-e0ac-46aa-8fb3-566f2b06e788 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:18.042786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f04eb7-72ec-4efa-9794-f6cbeae3c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:18.044209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f04eb7-72ec-4efa-9794-f6cbeae3c0cc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.045342 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f04eb7-72ec-4efa-9794-f6cbeae3c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.045342 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f04eb7-72ec-4efa-9794-f6cbeae3c0cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.056829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f04eb7-72ec-4efa-9794-f6cbeae3c0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:18.058669 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f04eb7-72ec-4efa-9794-f6cbeae3c0cc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-44f04eb7-72ec-4efa-9794-f6cbeae3c0cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:18.077974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:18.079152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:18.080270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:18.080270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:18.080270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:18.080270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:18.086531 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 525/1070] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:18.087541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f04eb7-72ec-4efa-9794-f6cbeae3c0cc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:18.125268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c6ab8-e0ac-46aa-8fb3-566f2b06e788 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:18.159258 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d7cf5-47a7-4be0-ba16-f418957973dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:18.159915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d7cf5-47a7-4be0-ba16-f418957973dc None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.160201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d7cf5-47a7-4be0-ba16-f418957973dc None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.160481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d7cf5-47a7-4be0-ba16-f418957973dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.191662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f04eb7-72ec-4efa-9794-f6cbeae3c0cc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:18.225500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18280951-c7a5-4887-925c-cd464d534abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:18.225698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d7cf5-47a7-4be0-ba16-f418957973dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:18.226167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18280951-c7a5-4887-925c-cd464d534abe None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.226481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18280951-c7a5-4887-925c-cd464d534abe None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.226760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18280951-c7a5-4887-925c-cd464d534abe None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.227012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d7cf5-47a7-4be0-ba16-f418957973dc None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:18.227465 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18280951-c7a5-4887-925c-cd464d534abe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:18.227770 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18280951-c7a5-4887-925c-cd464d534abe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:18.229116 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18280951-c7a5-4887-925c-cd464d534abe None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:18.242464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 526/1071] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:18.247568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18280951-c7a5-4887-925c-cd464d534abe None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:18.325291 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 546/1072] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:14:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 15:14:18.331624 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d7cf5-47a7-4be0-ba16-f418957973dc None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:18.346088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18280951-c7a5-4887-925c-cd464d534abe None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:18.379614 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53079bd-4a2a-45f9-97ad-cf36ab2db9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:18.380411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53079bd-4a2a-45f9-97ad-cf36ab2db9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.380695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53079bd-4a2a-45f9-97ad-cf36ab2db9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.380973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53079bd-4a2a-45f9-97ad-cf36ab2db9a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.389514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53079bd-4a2a-45f9-97ad-cf36ab2db9a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:18.390998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53079bd-4a2a-45f9-97ad-cf36ab2db9a8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b53079bd-4a2a-45f9-97ad-cf36ab2db9a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:14:18.406558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:18.407548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:18.408479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:14:18.408479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:14:18.408479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:14:18.408479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:14:18.408479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:14:18.408479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:14:18.408479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:18.408479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:18.412813 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 527/1073] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:18.413654 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53079bd-4a2a-45f9-97ad-cf36ab2db9a8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:18.439721 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d7cf5-47a7-4be0-ba16-f418957973dc None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:18.481352 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77487a7a-01a6-431d-b1d7-f3681cffff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:18.482163 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77487a7a-01a6-431d-b1d7-f3681cffff92 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.482485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77487a7a-01a6-431d-b1d7-f3681cffff92 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.482762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77487a7a-01a6-431d-b1d7-f3681cffff92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.493101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77487a7a-01a6-431d-b1d7-f3681cffff92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:18.494899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77487a7a-01a6-431d-b1d7-f3681cffff92 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:18.515585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53079bd-4a2a-45f9-97ad-cf36ab2db9a8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-77487a7a-01a6-431d-b1d7-f3681cffff92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:18.516898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:18.517762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:18.519101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:18.519101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:18.519101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:18.519101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:18.519101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 547/1074] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:18.523880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77487a7a-01a6-431d-b1d7-f3681cffff92 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:18.554021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52687fc1-3f2b-45b6-92d0-a70f0e8fc477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:18.554765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687fc1-3f2b-45b6-92d0-a70f0e8fc477 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.555053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687fc1-3f2b-45b6-92d0-a70f0e8fc477 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.555330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687fc1-3f2b-45b6-92d0-a70f0e8fc477 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.556114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52687fc1-3f2b-45b6-92d0-a70f0e8fc477 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:18.556425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52687fc1-3f2b-45b6-92d0-a70f0e8fc477 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:18.557858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52687fc1-3f2b-45b6-92d0-a70f0e8fc477 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:18.574200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 528/1075] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:18.575836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52687fc1-3f2b-45b6-92d0-a70f0e8fc477 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:18.628556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77487a7a-01a6-431d-b1d7-f3681cffff92 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:18.663927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097d162-98d3-4299-88fb-a70f518e99a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:18.664611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097d162-98d3-4299-88fb-a70f518e99a0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.664883 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097d162-98d3-4299-88fb-a70f518e99a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.665156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097d162-98d3-4299-88fb-a70f518e99a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.665879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097d162-98d3-4299-88fb-a70f518e99a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:18.666187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097d162-98d3-4299-88fb-a70f518e99a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:18.667578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097d162-98d3-4299-88fb-a70f518e99a0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:18.679812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 548/1076] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:18.681026 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52687fc1-3f2b-45b6-92d0-a70f0e8fc477 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:18.727061 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e56b-7477-4a59-9821-40e6ec513d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:18.727962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e56b-7477-4a59-9821-40e6ec513d81 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:18.728243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e56b-7477-4a59-9821-40e6ec513d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:18.728519 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e56b-7477-4a59-9821-40e6ec513d81 None admin] PATH_INFO: `/v3/projects/587280a3c4c54bffb4d769e406af3689/users/eb4ff6ba4e17477d8787eaf1955bd1da/roles/72ca4f6781fe43929329bb5827880242` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:18.731460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e56b-7477-4a59-9821-40e6ec513d81 None admin] RBAC: Authorizing `identity:create_grant(project_id=587280a3c4c54bffb4d769e406af3689, user_id=eb4ff6ba4e17477d8787eaf1955bd1da, role_id=72ca4f6781fe43929329bb5827880242)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:18.733038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e56b-7477-4a59-9821-40e6ec513d81 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:18.803951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 529/1077] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:14:18 2022] PUT /identity/v3/projects/587280a3c4c54bffb4d769e406af3689/users/eb4ff6ba4e17477d8787eaf1955bd1da/roles/72ca4f6781fe43929329bb5827880242 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:14:19.231610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481d080-70bf-4c4d-bd2d-ada6b4fecd8e None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:19.232172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481d080-70bf-4c4d-bd2d-ada6b4fecd8e None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:19.232172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481d080-70bf-4c4d-bd2d-ada6b4fecd8e None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:19.233496 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 549/1078] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:19.238905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3774836-6fa0-48de-9ee7-704684acea2a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:19.239298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3774836-6fa0-48de-9ee7-704684acea2a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:19.239466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3774836-6fa0-48de-9ee7-704684acea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:19.256252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d3774836-6fa0-48de-9ee7-704684acea2a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:19.257412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d3774836-6fa0-48de-9ee7-704684acea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:19.320970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 530/1079] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:19.344069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481d080-70bf-4c4d-bd2d-ada6b4fecd8e None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:19.442112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481d080-70bf-4c4d-bd2d-ada6b4fecd8e None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:19.474479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b1ab-71d7-43ae-b1fb-04cba555c90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:19.475271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b1ab-71d7-43ae-b1fb-04cba555c90c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:19.475548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b1ab-71d7-43ae-b1fb-04cba555c90c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:19.475817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b1ab-71d7-43ae-b1fb-04cba555c90c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:19.486849 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516b1ab-71d7-43ae-b1fb-04cba555c90c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-3516b1ab-71d7-43ae-b1fb-04cba555c90c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:14:19.494639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:19.495632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:19.497156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:19.497156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:19.497156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:19.497156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:19.497156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:14:19.497156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:14:19.497156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:14:19.497156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:14:19.497156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:14:19.497156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:14:19.497156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:19.497156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:19.497156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 550/1080] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:14:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:19.502113 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3774836-6fa0-48de-9ee7-704684acea2a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:19.597409 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3774836-6fa0-48de-9ee7-704684acea2a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:19.630108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b6d47-304c-4338-b086-454b0f004781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:19.630799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b6d47-304c-4338-b086-454b0f004781 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:19.631081 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b6d47-304c-4338-b086-454b0f004781 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:19.631355 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b6d47-304c-4338-b086-454b0f004781 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:19.632085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b6d47-304c-4338-b086-454b0f004781 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:19.632388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b6d47-304c-4338-b086-454b0f004781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:19.633746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b6d47-304c-4338-b086-454b0f004781 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:19.641724 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 531/1081] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:14:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:19.647862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b1ab-71d7-43ae-b1fb-04cba555c90c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:19.747277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b1ab-71d7-43ae-b1fb-04cba555c90c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:19.782071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d1d72-4cc7-4ca2-862a-7bc9b48178e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:19.782971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d1d72-4cc7-4ca2-862a-7bc9b48178e5 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:19.783253 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d1d72-4cc7-4ca2-862a-7bc9b48178e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:19.783529 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d1d72-4cc7-4ca2-862a-7bc9b48178e5 None admin] PATH_INFO: `/v3/users/5db36a4085be47b5bbcf3046ad754ff5` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:19.784700 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d1d72-4cc7-4ca2-862a-7bc9b48178e5 None admin] RBAC: Authorizing `identity:get_user(user_id=5db36a4085be47b5bbcf3046ad754ff5)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:19.786125 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d1d72-4cc7-4ca2-862a-7bc9b48178e5 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:19.788253 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 551/1082] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:14:19 2022] GET /identity/v3/users/5db36a4085be47b5bbcf3046ad754ff5 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:19.794469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b6d47-304c-4338-b086-454b0f004781 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:19.901234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b6d47-304c-4338-b086-454b0f004781 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:19.933563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1ccf0-788c-49e1-8c36-a3154d34dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:19.934870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1ccf0-788c-49e1-8c36-a3154d34dec6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:19.935149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1ccf0-788c-49e1-8c36-a3154d34dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:19.935419 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1ccf0-788c-49e1-8c36-a3154d34dec6 None admin] PATH_INFO: `/v3/projects/6dfa83f7378044e389f598f4af9a5aaa` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:19.936606 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1ccf0-788c-49e1-8c36-a3154d34dec6 None admin] RBAC: Authorizing `identity:get_project(project_id=6dfa83f7378044e389f598f4af9a5aaa)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:19.938046 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1ccf0-788c-49e1-8c36-a3154d34dec6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:19.939932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 532/1083] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:14:19 2022] GET /identity/v3/projects/6dfa83f7378044e389f598f4af9a5aaa => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:19.946032 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d1d72-4cc7-4ca2-862a-7bc9b48178e5 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:20.041951 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d1d72-4cc7-4ca2-862a-7bc9b48178e5 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:20.072376 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac2c20-d663-4a7c-800d-d9741bf30509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:20.073249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac2c20-d663-4a7c-800d-d9741bf30509 None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:20.073529 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac2c20-d663-4a7c-800d-d9741bf30509 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:20.073800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac2c20-d663-4a7c-800d-d9741bf30509 None admin] PATH_INFO: `/v3/projects/6dfa83f7378044e389f598f4af9a5aaa/users/5db36a4085be47b5bbcf3046ad754ff5/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:20.076326 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac2c20-d663-4a7c-800d-d9741bf30509 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dfa83f7378044e389f598f4af9a5aaa, user_id=5db36a4085be47b5bbcf3046ad754ff5, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:20.077734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac2c20-d663-4a7c-800d-d9741bf30509 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:20.146366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 552/1084] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:14:19 2022] PUT /identity/v3/projects/6dfa83f7378044e389f598f4af9a5aaa/users/5db36a4085be47b5bbcf3046ad754ff5/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:14:21.103764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b12cf2-9b4a-4b63-a421-da33606e6920 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:21.104277 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b12cf2-9b4a-4b63-a421-da33606e6920 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:21.104277 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b12cf2-9b4a-4b63-a421-da33606e6920 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:21.106194 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 533/1085] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:21.111521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548312-044c-4862-8ef1-7491b4994433 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:21.111956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548312-044c-4862-8ef1-7491b4994433 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:21.112091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548312-044c-4862-8ef1-7491b4994433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:21.128857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-51548312-044c-4862-8ef1-7491b4994433 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:21.130044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-51548312-044c-4862-8ef1-7491b4994433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:21.195348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 553/1086] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:21.219090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b12cf2-9b4a-4b63-a421-da33606e6920 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:21.319580 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b12cf2-9b4a-4b63-a421-da33606e6920 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:21.350582 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535f3a3-1935-494f-9ece-8b2feffea416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:21.351383 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535f3a3-1935-494f-9ece-8b2feffea416 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:21.351660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535f3a3-1935-494f-9ece-8b2feffea416 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:21.351933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535f3a3-1935-494f-9ece-8b2feffea416 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:21.362485 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535f3a3-1935-494f-9ece-8b2feffea416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-7535f3a3-1935-494f-9ece-8b2feffea416 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:14:21.370272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:21.371927 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:21.372795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:21.372795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:21.372795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:21.372795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:21.372795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:14:21.372795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:14:21.372795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:14:21.372795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:14:21.372795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:14:21.372795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:14:21.372795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:14:21.372795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:21.372795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 534/1087] 10.222.0.44 () {56 vars in 1120 bytes} [Thu May 5 15:14:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:21.378116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51548312-044c-4862-8ef1-7491b4994433 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:21.473296 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51548312-044c-4862-8ef1-7491b4994433 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:21.506102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2181-b74e-461a-b9ee-ad88b5d3379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:21.506808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2181-b74e-461a-b9ee-ad88b5d3379b None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:21.507095 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2181-b74e-461a-b9ee-ad88b5d3379b None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:21.507375 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2181-b74e-461a-b9ee-ad88b5d3379b None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:21.508125 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b2181-b74e-461a-b9ee-ad88b5d3379b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:21.508435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b2181-b74e-461a-b9ee-ad88b5d3379b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:21.509809 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b2181-b74e-461a-b9ee-ad88b5d3379b None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:21.519984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 554/1088] 10.222.0.44 () {56 vars in 1115 bytes} [Thu May 5 15:14:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:21.525510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535f3a3-1935-494f-9ece-8b2feffea416 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:21.622342 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535f3a3-1935-494f-9ece-8b2feffea416 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:21.656022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb58a8-14a0-4039-9543-5bb32a6d3507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:21.656822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb58a8-14a0-4039-9543-5bb32a6d3507 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:21.657104 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb58a8-14a0-4039-9543-5bb32a6d3507 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:21.657380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb58a8-14a0-4039-9543-5bb32a6d3507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:21.667466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb58a8-14a0-4039-9543-5bb32a6d3507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:21.669476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb58a8-14a0-4039-9543-5bb32a6d3507 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-12bb58a8-14a0-4039-9543-5bb32a6d3507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:21.687600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:21.688499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:21.689395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:21.689395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:21.689395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:21.689395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:21.689395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 535/1089] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:21.694512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2181-b74e-461a-b9ee-ad88b5d3379b None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:21.795905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2181-b74e-461a-b9ee-ad88b5d3379b None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:21.827494 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a58a7-52bf-4d7e-8ca1-96cf6c7410a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:21.828160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a58a7-52bf-4d7e-8ca1-96cf6c7410a7 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:21.828448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a58a7-52bf-4d7e-8ca1-96cf6c7410a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:21.828731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a58a7-52bf-4d7e-8ca1-96cf6c7410a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:21.829458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a58a7-52bf-4d7e-8ca1-96cf6c7410a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:21.829765 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a58a7-52bf-4d7e-8ca1-96cf6c7410a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:21.831165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a58a7-52bf-4d7e-8ca1-96cf6c7410a7 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:21.843408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 555/1090] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:21.848763 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb58a8-14a0-4039-9543-5bb32a6d3507 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:21.944413 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb58a8-14a0-4039-9543-5bb32a6d3507 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:21.977820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fbd75-fa05-42c6-aed4-68cb37b5ce29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:21.978649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fbd75-fa05-42c6-aed4-68cb37b5ce29 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:21.978937 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fbd75-fa05-42c6-aed4-68cb37b5ce29 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:21.979217 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fbd75-fa05-42c6-aed4-68cb37b5ce29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:21.986393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fbd75-fa05-42c6-aed4-68cb37b5ce29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:21.987826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fbd75-fa05-42c6-aed4-68cb37b5ce29 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-1b9fbd75-fa05-42c6-aed4-68cb37b5ce29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:14:22.002049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:22.003231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:22.004259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:22.004259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:22.004259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:14:22.004259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:14:22.004259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:14:22.004259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:14:22.004259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:14:22.004259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:14:22.004259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:14:22.004259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:22.004259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 536/1091] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 5 15:14:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:22.008923 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a58a7-52bf-4d7e-8ca1-96cf6c7410a7 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:22.108074 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a58a7-52bf-4d7e-8ca1-96cf6c7410a7 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:22.140850 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4187ef3-7687-488c-b8c9-a1ca440520a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:22.141526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187ef3-7687-488c-b8c9-a1ca440520a7 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:22.141785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187ef3-7687-488c-b8c9-a1ca440520a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:22.142065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187ef3-7687-488c-b8c9-a1ca440520a7 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:22.142928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4187ef3-7687-488c-b8c9-a1ca440520a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:22.143240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4187ef3-7687-488c-b8c9-a1ca440520a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:22.144651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4187ef3-7687-488c-b8c9-a1ca440520a7 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:22.162585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 556/1092] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 5 15:14:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:22.168731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fbd75-fa05-42c6-aed4-68cb37b5ce29 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:22.270547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fbd75-fa05-42c6-aed4-68cb37b5ce29 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:22.303785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2a32d-8014-4c91-8916-5a058efa7770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:22.304435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2a32d-8014-4c91-8916-5a058efa7770 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:22.304719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2a32d-8014-4c91-8916-5a058efa7770 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:22.304996 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2a32d-8014-4c91-8916-5a058efa7770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:22.369813 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2a32d-8014-4c91-8916-5a058efa7770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:22.371312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2a32d-8014-4c91-8916-5a058efa7770 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:22.381066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066b340-ff4d-4340-b085-a57941000525 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:22.381362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066b340-ff4d-4340-b085-a57941000525 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:22.381670 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066b340-ff4d-4340-b085-a57941000525 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:22.383192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 557/1093] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:14:22.388044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7638e-4058-4dec-b6fe-19ddd49a145f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:22.388332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7638e-4058-4dec-b6fe-19ddd49a145f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:22.388613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7638e-4058-4dec-b6fe-19ddd49a145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:22.404907 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-c3f7638e-4058-4dec-b6fe-19ddd49a145f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:22.406096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c3f7638e-4058-4dec-b6fe-19ddd49a145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:22.467506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 537/1094] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:14:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:14:22.472965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 558/1095] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:22.473108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2a32d-8014-4c91-8916-5a058efa7770 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:22.496970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7638e-4058-4dec-b6fe-19ddd49a145f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:22.572034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2a32d-8014-4c91-8916-5a058efa7770 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:22.593746 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7638e-4058-4dec-b6fe-19ddd49a145f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:22.604472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35538c95-8534-4a93-8e5c-ca5faee72a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:22.605258 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35538c95-8534-4a93-8e5c-ca5faee72a8b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:22.606269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35538c95-8534-4a93-8e5c-ca5faee72a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:22.606588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35538c95-8534-4a93-8e5c-ca5faee72a8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:22.616198 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35538c95-8534-4a93-8e5c-ca5faee72a8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:22.617629 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35538c95-8534-4a93-8e5c-ca5faee72a8b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:22.626152 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c3abf-8cbc-4ee6-a9a0-6528a77b14ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:22.626973 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c3abf-8cbc-4ee6-a9a0-6528a77b14ec None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:22.627256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c3abf-8cbc-4ee6-a9a0-6528a77b14ec None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:22.627532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c3abf-8cbc-4ee6-a9a0-6528a77b14ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-35538c95-8534-4a93-8e5c-ca5faee72a8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:22.634298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:22.635292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:22.636195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:14:22.636195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:22.636195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:14:22.636195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:22.636195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 538/1096] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:22.637891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c3abf-8cbc-4ee6-a9a0-6528a77b14ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:14:22.641377 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35538c95-8534-4a93-8e5c-ca5faee72a8b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-819c3abf-8cbc-4ee6-a9a0-6528a77b14ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:14:22.645500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:22.653789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 559/1097] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:14:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:22.654698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c3abf-8cbc-4ee6-a9a0-6528a77b14ec None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:22.738234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35538c95-8534-4a93-8e5c-ca5faee72a8b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:22.749295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c3abf-8cbc-4ee6-a9a0-6528a77b14ec None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:22.773066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1221c1-45fb-4d44-b7a0-8e27fa640261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:22.773809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1221c1-45fb-4d44-b7a0-8e27fa640261 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:22.774135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1221c1-45fb-4d44-b7a0-8e27fa640261 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:22.774482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1221c1-45fb-4d44-b7a0-8e27fa640261 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:22.775298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1221c1-45fb-4d44-b7a0-8e27fa640261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:22.775638 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1221c1-45fb-4d44-b7a0-8e27fa640261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:22.777319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1221c1-45fb-4d44-b7a0-8e27fa640261 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:22.784108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a4f46-0e45-4d9c-880e-30eb2f7b8cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:22.784810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a4f46-0e45-4d9c-880e-30eb2f7b8cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:22.785070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a4f46-0e45-4d9c-880e-30eb2f7b8cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:22.785350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a4f46-0e45-4d9c-880e-30eb2f7b8cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:22.786095 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a4f46-0e45-4d9c-880e-30eb2f7b8cc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:22.786680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a4f46-0e45-4d9c-880e-30eb2f7b8cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:22.788046 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a4f46-0e45-4d9c-880e-30eb2f7b8cc0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:22.790172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 539/1098] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:22.796346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 560/1099] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:14:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:22.796509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1221c1-45fb-4d44-b7a0-8e27fa640261 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:22.801521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a4f46-0e45-4d9c-880e-30eb2f7b8cc0 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:22.892461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1221c1-45fb-4d44-b7a0-8e27fa640261 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:22.903291 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a4f46-0e45-4d9c-880e-30eb2f7b8cc0 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:22.924921 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a144039-4db1-4cd2-9bdd-1f28585dca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:22.925713 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a144039-4db1-4cd2-9bdd-1f28585dca81 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:22.925989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a144039-4db1-4cd2-9bdd-1f28585dca81 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:22.926254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a144039-4db1-4cd2-9bdd-1f28585dca81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:22.932706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a144039-4db1-4cd2-9bdd-1f28585dca81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:22.934185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a144039-4db1-4cd2-9bdd-1f28585dca81 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:22.935684 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d638a0-e469-47ff-8acd-c874001aa1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:22.936564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d638a0-e469-47ff-8acd-c874001aa1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:22.936848 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d638a0-e469-47ff-8acd-c874001aa1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:22.937127 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d638a0-e469-47ff-8acd-c874001aa1e8 None admin] PATH_INFO: `/v3/users/5db36a4085be47b5bbcf3046ad754ff5` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:22.938355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d638a0-e469-47ff-8acd-c874001aa1e8 None admin] RBAC: Authorizing `identity:get_user(user_id=5db36a4085be47b5bbcf3046ad754ff5)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:22.939796 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d638a0-e469-47ff-8acd-c874001aa1e8 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:22.941437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 561/1100] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:14:22 2022] GET /identity/v3/users/5db36a4085be47b5bbcf3046ad754ff5 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:22.947027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d638a0-e469-47ff-8acd-c874001aa1e8 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-2a144039-4db1-4cd2-9bdd-1f28585dca81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:14:22.948036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:22.949048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:22.950799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:14:22.950799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:14:22.950799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:14:22.950799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:14:22.950799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:14:22.950799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:14:22.950799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:14:22.950799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:22.950799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 540/1101] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:14:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:14:22.955468 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a144039-4db1-4cd2-9bdd-1f28585dca81 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:23.043803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d638a0-e469-47ff-8acd-c874001aa1e8 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:23.050232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a144039-4db1-4cd2-9bdd-1f28585dca81 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:23.075537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89437971-d6cd-4148-bd34-39ed1819563a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:23.076181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437971-d6cd-4148-bd34-39ed1819563a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:23.076472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437971-d6cd-4148-bd34-39ed1819563a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:23.076753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437971-d6cd-4148-bd34-39ed1819563a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:23.082899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8620b8-4131-45a9-af12-0bf6b2a64e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:23.083555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8620b8-4131-45a9-af12-0bf6b2a64e5c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:23.083843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8620b8-4131-45a9-af12-0bf6b2a64e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:23.084123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8620b8-4131-45a9-af12-0bf6b2a64e5c None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:23.084922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8620b8-4131-45a9-af12-0bf6b2a64e5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:23.085234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8620b8-4131-45a9-af12-0bf6b2a64e5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:23.086776 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8620b8-4131-45a9-af12-0bf6b2a64e5c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:23.098635 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 541/1102] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:14:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:23.104507 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8620b8-4131-45a9-af12-0bf6b2a64e5c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:23.142965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89437971-d6cd-4148-bd34-39ed1819563a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:23.144345 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89437971-d6cd-4148-bd34-39ed1819563a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:23.198908 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8620b8-4131-45a9-af12-0bf6b2a64e5c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:23.230974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a282cb7-fc28-4299-bea1-8bf6a468ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:23.231644 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a282cb7-fc28-4299-bea1-8bf6a468ebaf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:23.231926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a282cb7-fc28-4299-bea1-8bf6a468ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:23.232200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a282cb7-fc28-4299-bea1-8bf6a468ebaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:23.233008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a282cb7-fc28-4299-bea1-8bf6a468ebaf None admin] RBAC: Adding query filter params (role.id=72ca4f6781fe43929329bb5827880242, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=eb4ff6ba4e17477d8787eaf1955bd1da) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:23.233315 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a282cb7-fc28-4299-bea1-8bf6a468ebaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:23.234773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a282cb7-fc28-4299-bea1-8bf6a468ebaf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:23.237585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 562/1103] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:14:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 15:14:23.240859 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 542/1104] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:14:23 2022] GET /identity/v3/role_assignments?user.id=eb4ff6ba4e17477d8787eaf1955bd1da&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=72ca4f6781fe43929329bb5827880242 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:23.243340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89437971-d6cd-4148-bd34-39ed1819563a None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:23.346196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89437971-d6cd-4148-bd34-39ed1819563a None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:23.380629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fc171-d27e-46d8-89bc-861ba9eda85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:23.381508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fc171-d27e-46d8-89bc-861ba9eda85c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:23.381791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fc171-d27e-46d8-89bc-861ba9eda85c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:23.382072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fc171-d27e-46d8-89bc-861ba9eda85c None admin] PATH_INFO: `/v3/projects/6dfa83f7378044e389f598f4af9a5aaa` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:23.383308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fc171-d27e-46d8-89bc-861ba9eda85c None admin] RBAC: Authorizing `identity:get_project(project_id=6dfa83f7378044e389f598f4af9a5aaa)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:23.384756 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fc171-d27e-46d8-89bc-861ba9eda85c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:23.386733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 563/1105] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:14:23 2022] GET /identity/v3/projects/6dfa83f7378044e389f598f4af9a5aaa => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:23.393399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a282cb7-fc28-4299-bea1-8bf6a468ebaf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:23.493985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a282cb7-fc28-4299-bea1-8bf6a468ebaf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:23.528665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708353b-d557-41b0-80e7-bd237a918afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:23.529330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708353b-d557-41b0-80e7-bd237a918afd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:23.529930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708353b-d557-41b0-80e7-bd237a918afd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:23.529930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708353b-d557-41b0-80e7-bd237a918afd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:23.530733 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708353b-d557-41b0-80e7-bd237a918afd None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=6dfa83f7378044e389f598f4af9a5aaa, user.id=5db36a4085be47b5bbcf3046ad754ff5) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:23.531043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708353b-d557-41b0-80e7-bd237a918afd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:23.532819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708353b-d557-41b0-80e7-bd237a918afd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:23.539205 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 543/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:14:23 2022] GET /identity/v3/role_assignments?user.id=5db36a4085be47b5bbcf3046ad754ff5&scope.project.id=6dfa83f7378044e389f598f4af9a5aaa&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:25.927219 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9938c2-209d-4f20-8c35-004df7b38be8 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:25.927785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9938c2-209d-4f20-8c35-004df7b38be8 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:25.927785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9938c2-209d-4f20-8c35-004df7b38be8 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:25.929160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 564/1107] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:25.934374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7471e-acb6-446b-b836-585f592a1a25 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:25.934799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7471e-acb6-446b-b836-585f592a1a25 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:25.937141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7471e-acb6-446b-b836-585f592a1a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:25.951771 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-66e7471e-acb6-446b-b836-585f592a1a25 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:25.952961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-66e7471e-acb6-446b-b836-585f592a1a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:26.016739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 544/1108] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:26.043675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9938c2-209d-4f20-8c35-004df7b38be8 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:26.143288 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9938c2-209d-4f20-8c35-004df7b38be8 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:26.175747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a64b7-9088-4fa2-b0e1-610b7ddc0f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:26.176530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a64b7-9088-4fa2-b0e1-610b7ddc0f45 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:26.176809 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a64b7-9088-4fa2-b0e1-610b7ddc0f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:26.177080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a64b7-9088-4fa2-b0e1-610b7ddc0f45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:26.178231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a64b7-9088-4fa2-b0e1-610b7ddc0f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:26.179722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a64b7-9088-4fa2-b0e1-610b7ddc0f45 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:26.181328 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 565/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:26.187591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7471e-acb6-446b-b836-585f592a1a25 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:26.281710 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7471e-acb6-446b-b836-585f592a1a25 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:26.313831 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea60201-cbd1-4dd1-9ddf-5a2366552376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:26.314522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea60201-cbd1-4dd1-9ddf-5a2366552376 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:26.314805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea60201-cbd1-4dd1-9ddf-5a2366552376 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:26.315080 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea60201-cbd1-4dd1-9ddf-5a2366552376 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:26.315789 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea60201-cbd1-4dd1-9ddf-5a2366552376 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:26.317214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea60201-cbd1-4dd1-9ddf-5a2366552376 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:26.403070 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 545/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:14:26 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:14:28.694559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb388-4000-42c5-beb2-140ae50f4a77 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:28.695107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb388-4000-42c5-beb2-140ae50f4a77 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:28.695107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb388-4000-42c5-beb2-140ae50f4a77 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:28.696465 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 566/1111] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:28.702210 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13cf7b-c9a6-4e9f-8272-cdd6972621f2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:28.702613 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13cf7b-c9a6-4e9f-8272-cdd6972621f2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:28.702793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13cf7b-c9a6-4e9f-8272-cdd6972621f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:28.719612 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5a13cf7b-c9a6-4e9f-8272-cdd6972621f2 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:28.720786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5a13cf7b-c9a6-4e9f-8272-cdd6972621f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:28.786381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 546/1112] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:28.811947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb388-4000-42c5-beb2-140ae50f4a77 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:28.910479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb388-4000-42c5-beb2-140ae50f4a77 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:28.942131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ef76c-d597-4d0c-b348-c340b6d6dfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:28.943014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ef76c-d597-4d0c-b348-c340b6d6dfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:28.943299 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ef76c-d597-4d0c-b348-c340b6d6dfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:28.943576 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ef76c-d597-4d0c-b348-c340b6d6dfa3 None admin] PATH_INFO: `/v3/roles/44468cf4511643498cf7830993b8c9e5` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:28.945086 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ef76c-d597-4d0c-b348-c340b6d6dfa3 None admin] RBAC: Authorizing `identity:get_role(role_id=44468cf4511643498cf7830993b8c9e5)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:28.946460 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ef76c-d597-4d0c-b348-c340b6d6dfa3 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:28.951499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 567/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:14:28 2022] GET /identity/v3/roles/44468cf4511643498cf7830993b8c9e5 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:28.954096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13cf7b-c9a6-4e9f-8272-cdd6972621f2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:29.048662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13cf7b-c9a6-4e9f-8272-cdd6972621f2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:29.081366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1be0b-e2f2-48de-9b91-26ff3a900d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:29.082219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1be0b-e2f2-48de-9b91-26ff3a900d4c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:29.082531 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1be0b-e2f2-48de-9b91-26ff3a900d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:29.082809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1be0b-e2f2-48de-9b91-26ff3a900d4c None admin] PATH_INFO: `/v3/users/0a5b18b1e41144798b4323c745b06b4f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:29.096305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1be0b-e2f2-48de-9b91-26ff3a900d4c None admin] RBAC: Authorizing `identity:get_user(user_id=0a5b18b1e41144798b4323c745b06b4f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:29.097757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1be0b-e2f2-48de-9b91-26ff3a900d4c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:29.099444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 547/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:14:28 2022] GET /identity/v3/users/0a5b18b1e41144798b4323c745b06b4f => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:29.105474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ef76c-d597-4d0c-b348-c340b6d6dfa3 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:29.201267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ef76c-d597-4d0c-b348-c340b6d6dfa3 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:29.233111 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a07a1-51eb-4b14-9887-f00030175e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:29.233749 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a07a1-51eb-4b14-9887-f00030175e3f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:29.234032 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a07a1-51eb-4b14-9887-f00030175e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:29.234336 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a07a1-51eb-4b14-9887-f00030175e3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:29.298791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a07a1-51eb-4b14-9887-f00030175e3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:29.300210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a07a1-51eb-4b14-9887-f00030175e3f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:29.392694 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 568/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:14:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:14:29.398639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1be0b-e2f2-48de-9b91-26ff3a900d4c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:29.494819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1be0b-e2f2-48de-9b91-26ff3a900d4c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:29.528393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966362fb-0350-40cb-8978-2c0cbeb1e430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:29.529247 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966362fb-0350-40cb-8978-2c0cbeb1e430 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:29.529527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966362fb-0350-40cb-8978-2c0cbeb1e430 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:29.529800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966362fb-0350-40cb-8978-2c0cbeb1e430 None admin] PATH_INFO: `/v3/projects/6dfa83f7378044e389f598f4af9a5aaa` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:29.531007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966362fb-0350-40cb-8978-2c0cbeb1e430 None admin] RBAC: Authorizing `identity:get_project(project_id=6dfa83f7378044e389f598f4af9a5aaa)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:29.532440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966362fb-0350-40cb-8978-2c0cbeb1e430 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:29.534118 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 548/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:14:29 2022] GET /identity/v3/projects/6dfa83f7378044e389f598f4af9a5aaa => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:29.540422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a07a1-51eb-4b14-9887-f00030175e3f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:29.635596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a07a1-51eb-4b14-9887-f00030175e3f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:29.668651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c107f-cb41-496e-8389-5799abd16354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:29.669293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c107f-cb41-496e-8389-5799abd16354 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:29.669576 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c107f-cb41-496e-8389-5799abd16354 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:29.669856 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c107f-cb41-496e-8389-5799abd16354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:29.670707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c107f-cb41-496e-8389-5799abd16354 None admin] RBAC: Adding query filter params (role.id=44468cf4511643498cf7830993b8c9e5, scope.project.id=6dfa83f7378044e389f598f4af9a5aaa, user.id=0a5b18b1e41144798b4323c745b06b4f) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:29.671023 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c107f-cb41-496e-8389-5799abd16354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:29.672441 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c107f-cb41-496e-8389-5799abd16354 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:29.677640 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 569/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:14:29 2022] GET /identity/v3/role_assignments?user.id=0a5b18b1e41144798b4323c745b06b4f&scope.project.id=6dfa83f7378044e389f598f4af9a5aaa&role.id=44468cf4511643498cf7830993b8c9e5 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:31.879529 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611ce21-2c78-4cfe-8fb0-455c676f76a1 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:31.880064 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611ce21-2c78-4cfe-8fb0-455c676f76a1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:31.880064 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611ce21-2c78-4cfe-8fb0-455c676f76a1 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:31.881447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 549/1118] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:31.886895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861666d-5d48-47e7-85ee-7cc7dbdee8c5 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:31.887291 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861666d-5d48-47e7-85ee-7cc7dbdee8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:31.887455 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861666d-5d48-47e7-85ee-7cc7dbdee8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:31.904516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6861666d-5d48-47e7-85ee-7cc7dbdee8c5 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:31.905682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6861666d-5d48-47e7-85ee-7cc7dbdee8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:31.968446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 570/1119] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:31.991257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611ce21-2c78-4cfe-8fb0-455c676f76a1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:32.085757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611ce21-2c78-4cfe-8fb0-455c676f76a1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:32.117649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23234fea-6386-4136-8e5e-3822e85745a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:32.118505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23234fea-6386-4136-8e5e-3822e85745a0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:32.118783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23234fea-6386-4136-8e5e-3822e85745a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:32.119056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23234fea-6386-4136-8e5e-3822e85745a0 None admin] PATH_INFO: `/v3/roles/44468cf4511643498cf7830993b8c9e5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:32.120491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23234fea-6386-4136-8e5e-3822e85745a0 None admin] RBAC: Authorizing `identity:get_role(role_id=44468cf4511643498cf7830993b8c9e5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:32.121876 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23234fea-6386-4136-8e5e-3822e85745a0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:32.123244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 550/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:14:31 2022] GET /identity/v3/roles/44468cf4511643498cf7830993b8c9e5 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:32.128872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861666d-5d48-47e7-85ee-7cc7dbdee8c5 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:32.222435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861666d-5d48-47e7-85ee-7cc7dbdee8c5 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:32.254619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade9fe3-ca58-43e8-86b3-231712194979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:32.255486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade9fe3-ca58-43e8-86b3-231712194979 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:32.255771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade9fe3-ca58-43e8-86b3-231712194979 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:32.256047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade9fe3-ca58-43e8-86b3-231712194979 None admin] PATH_INFO: `/v3/users/0a5b18b1e41144798b4323c745b06b4f` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:32.257232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade9fe3-ca58-43e8-86b3-231712194979 None admin] RBAC: Authorizing `identity:get_user(user_id=0a5b18b1e41144798b4323c745b06b4f)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:32.258679 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade9fe3-ca58-43e8-86b3-231712194979 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:32.260283 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 571/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:14:32 2022] GET /identity/v3/users/0a5b18b1e41144798b4323c745b06b4f => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:32.265914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23234fea-6386-4136-8e5e-3822e85745a0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:32.359108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23234fea-6386-4136-8e5e-3822e85745a0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:32.390326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394c95-2759-47cd-81bc-020fec1f1ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:32.391166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394c95-2759-47cd-81bc-020fec1f1ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:32.391443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394c95-2759-47cd-81bc-020fec1f1ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:32.391710 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394c95-2759-47cd-81bc-020fec1f1ec0 None admin] PATH_INFO: `/v3/projects/6dfa83f7378044e389f598f4af9a5aaa` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:32.392857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394c95-2759-47cd-81bc-020fec1f1ec0 None admin] RBAC: Authorizing `identity:get_project(project_id=6dfa83f7378044e389f598f4af9a5aaa)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:32.394263 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394c95-2759-47cd-81bc-020fec1f1ec0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:32.395969 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 551/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:14:32 2022] GET /identity/v3/projects/6dfa83f7378044e389f598f4af9a5aaa => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:32.402508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade9fe3-ca58-43e8-86b3-231712194979 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:32.495538 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade9fe3-ca58-43e8-86b3-231712194979 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:32.528150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bdcc1-e70d-4d18-a3cf-b97063699443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:32.529013 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bdcc1-e70d-4d18-a3cf-b97063699443 None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:32.529290 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bdcc1-e70d-4d18-a3cf-b97063699443 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:32.529558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bdcc1-e70d-4d18-a3cf-b97063699443 None admin] PATH_INFO: `/v3/projects/6dfa83f7378044e389f598f4af9a5aaa/users/0a5b18b1e41144798b4323c745b06b4f/roles/44468cf4511643498cf7830993b8c9e5` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:32.531714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bdcc1-e70d-4d18-a3cf-b97063699443 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dfa83f7378044e389f598f4af9a5aaa, user_id=0a5b18b1e41144798b4323c745b06b4f, role_id=44468cf4511643498cf7830993b8c9e5)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:32.533119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bdcc1-e70d-4d18-a3cf-b97063699443 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:32.620070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 572/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:14:32 2022] PUT /identity/v3/projects/6dfa83f7378044e389f598f4af9a5aaa/users/0a5b18b1e41144798b4323c745b06b4f/roles/44468cf4511643498cf7830993b8c9e5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:14:34.850963 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546822d-27fb-44d9-b40c-033e3d349e7e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:34.851461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546822d-27fb-44d9-b40c-033e3d349e7e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:34.851553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546822d-27fb-44d9-b40c-033e3d349e7e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:34.852886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 552/1124] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:34.858344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4da48-8f9a-47b8-be4b-58c1f87a7abf None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:34.858771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4da48-8f9a-47b8-be4b-58c1f87a7abf None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:34.858925 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4da48-8f9a-47b8-be4b-58c1f87a7abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:34.875355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e6b4da48-8f9a-47b8-be4b-58c1f87a7abf None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:34.876551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e6b4da48-8f9a-47b8-be4b-58c1f87a7abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:34.938767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 573/1125] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:34.963417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546822d-27fb-44d9-b40c-033e3d349e7e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:35.060051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546822d-27fb-44d9-b40c-033e3d349e7e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:35.092142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6965f5-b737-4e2b-af72-197c2a812b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:35.092986 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6965f5-b737-4e2b-af72-197c2a812b1f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:35.093267 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6965f5-b737-4e2b-af72-197c2a812b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:35.093540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6965f5-b737-4e2b-af72-197c2a812b1f None admin] PATH_INFO: `/v3/roles/44468cf4511643498cf7830993b8c9e5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:35.095017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6965f5-b737-4e2b-af72-197c2a812b1f None admin] RBAC: Authorizing `identity:get_role(role_id=44468cf4511643498cf7830993b8c9e5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:35.096375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6965f5-b737-4e2b-af72-197c2a812b1f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:35.097723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 553/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:14:34 2022] GET /identity/v3/roles/44468cf4511643498cf7830993b8c9e5 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:35.103365 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4da48-8f9a-47b8-be4b-58c1f87a7abf None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:35.197220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4da48-8f9a-47b8-be4b-58c1f87a7abf None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:35.229189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c37ca-35eb-429f-82e7-025f608492b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:35.230168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c37ca-35eb-429f-82e7-025f608492b0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:35.230613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c37ca-35eb-429f-82e7-025f608492b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:35.230922 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c37ca-35eb-429f-82e7-025f608492b0 None admin] PATH_INFO: `/v3/users/0a5b18b1e41144798b4323c745b06b4f` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:35.232113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c37ca-35eb-429f-82e7-025f608492b0 None admin] RBAC: Authorizing `identity:get_user(user_id=0a5b18b1e41144798b4323c745b06b4f)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:35.233540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c37ca-35eb-429f-82e7-025f608492b0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:35.235209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 574/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:14:35 2022] GET /identity/v3/users/0a5b18b1e41144798b4323c745b06b4f => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:35.241013 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6965f5-b737-4e2b-af72-197c2a812b1f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:35.338791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6965f5-b737-4e2b-af72-197c2a812b1f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:35.370522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055d5d8-a91f-4cd2-a910-20c7e644dd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:35.371798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d5d8-a91f-4cd2-a910-20c7e644dd81 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:35.372081 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d5d8-a91f-4cd2-a910-20c7e644dd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:35.372353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d5d8-a91f-4cd2-a910-20c7e644dd81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:35.435170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055d5d8-a91f-4cd2-a910-20c7e644dd81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:35.436597 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055d5d8-a91f-4cd2-a910-20c7e644dd81 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:35.530142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 554/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:14:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:14:35.536029 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c37ca-35eb-429f-82e7-025f608492b0 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:35.630173 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c37ca-35eb-429f-82e7-025f608492b0 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:35.662117 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065324a8-3acc-4478-98c9-7babcefdae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:35.663011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065324a8-3acc-4478-98c9-7babcefdae0e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:35.663313 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065324a8-3acc-4478-98c9-7babcefdae0e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:35.663607 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065324a8-3acc-4478-98c9-7babcefdae0e None admin] PATH_INFO: `/v3/projects/6dfa83f7378044e389f598f4af9a5aaa` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:35.664813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065324a8-3acc-4478-98c9-7babcefdae0e None admin] RBAC: Authorizing `identity:get_project(project_id=6dfa83f7378044e389f598f4af9a5aaa)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:35.666236 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065324a8-3acc-4478-98c9-7babcefdae0e None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:35.668726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 575/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:14:35 2022] GET /identity/v3/projects/6dfa83f7378044e389f598f4af9a5aaa => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:35.674779 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055d5d8-a91f-4cd2-a910-20c7e644dd81 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:35.767514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055d5d8-a91f-4cd2-a910-20c7e644dd81 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:35.800140 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72651582-14db-4d66-abc9-26a5b9998076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:35.800792 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72651582-14db-4d66-abc9-26a5b9998076 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:35.801078 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72651582-14db-4d66-abc9-26a5b9998076 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:35.801359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72651582-14db-4d66-abc9-26a5b9998076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:35.802179 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72651582-14db-4d66-abc9-26a5b9998076 None admin] RBAC: Adding query filter params (role.id=44468cf4511643498cf7830993b8c9e5, scope.project.id=6dfa83f7378044e389f598f4af9a5aaa, user.id=0a5b18b1e41144798b4323c745b06b4f) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:35.802540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72651582-14db-4d66-abc9-26a5b9998076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:35.803976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72651582-14db-4d66-abc9-26a5b9998076 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:35.810217 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 555/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:14:35 2022] GET /identity/v3/role_assignments?user.id=0a5b18b1e41144798b4323c745b06b4f&scope.project.id=6dfa83f7378044e389f598f4af9a5aaa&role.id=44468cf4511643498cf7830993b8c9e5 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:38.061509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a312c3-babb-494a-b6ed-4628d347b837 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:38.062015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a312c3-babb-494a-b6ed-4628d347b837 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:38.062015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a312c3-babb-494a-b6ed-4628d347b837 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:38.063375 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 576/1131] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:38.068489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2e2fd-49ec-4a2a-b51a-105c1f59c0dd None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:38.068855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2e2fd-49ec-4a2a-b51a-105c1f59c0dd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:38.069054 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2e2fd-49ec-4a2a-b51a-105c1f59c0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:38.085854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e7b2e2fd-49ec-4a2a-b51a-105c1f59c0dd None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:38.087075 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e7b2e2fd-49ec-4a2a-b51a-105c1f59c0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:38.150581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 556/1132] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:38.174827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a312c3-babb-494a-b6ed-4628d347b837 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:38.272870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a312c3-babb-494a-b6ed-4628d347b837 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:38.306104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bbd6d-2428-4bd3-95e7-80b687b75102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:38.307051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bbd6d-2428-4bd3-95e7-80b687b75102 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:38.307336 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bbd6d-2428-4bd3-95e7-80b687b75102 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:38.307610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bbd6d-2428-4bd3-95e7-80b687b75102 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:38.309374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bbd6d-2428-4bd3-95e7-80b687b75102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:38.310852 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bbd6d-2428-4bd3-95e7-80b687b75102 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:38.312528 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 577/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:38.318343 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2e2fd-49ec-4a2a-b51a-105c1f59c0dd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:38.410801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2e2fd-49ec-4a2a-b51a-105c1f59c0dd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:38.442998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309916e-53dc-4cf9-b653-f2eadca104f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:38.443643 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309916e-53dc-4cf9-b653-f2eadca104f7 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:38.443921 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309916e-53dc-4cf9-b653-f2eadca104f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:38.444194 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309916e-53dc-4cf9-b653-f2eadca104f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:38.444880 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309916e-53dc-4cf9-b653-f2eadca104f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:38.446305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309916e-53dc-4cf9-b653-f2eadca104f7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:38.552502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 557/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:14:38 2022] POST /identity/v3/projects => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:14:40.815164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68c966-a610-42e4-817b-7288ef35cfe3 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:40.815680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68c966-a610-42e4-817b-7288ef35cfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:40.815769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68c966-a610-42e4-817b-7288ef35cfe3 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:40.817094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 578/1135] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:40.822082 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d839-4d7b-4091-b8d2-4bd441d02737 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:40.822508 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d839-4d7b-4091-b8d2-4bd441d02737 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:40.822669 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d839-4d7b-4091-b8d2-4bd441d02737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:40.841750 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fe68d839-4d7b-4091-b8d2-4bd441d02737 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:40.842942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fe68d839-4d7b-4091-b8d2-4bd441d02737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:40.907304 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 558/1136] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:40.931684 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68c966-a610-42e4-817b-7288ef35cfe3 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:41.027790 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68c966-a610-42e4-817b-7288ef35cfe3 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:41.059807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92b97a-7fab-4d49-99d1-4f63fa06906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:41.060595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b97a-7fab-4d49-99d1-4f63fa06906d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:41.060877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b97a-7fab-4d49-99d1-4f63fa06906d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:41.061152 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b97a-7fab-4d49-99d1-4f63fa06906d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:41.062325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92b97a-7fab-4d49-99d1-4f63fa06906d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:41.063750 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92b97a-7fab-4d49-99d1-4f63fa06906d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:41.065327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 579/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:14:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:41.070967 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68d839-4d7b-4091-b8d2-4bd441d02737 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:41.165956 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68d839-4d7b-4091-b8d2-4bd441d02737 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:41.198628 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03abec-1329-40b1-ab3c-22afc79c62e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:41.199747 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03abec-1329-40b1-ab3c-22afc79c62e3 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:41.200039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03abec-1329-40b1-ab3c-22afc79c62e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:41.200316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03abec-1329-40b1-ab3c-22afc79c62e3 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:41.201023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03abec-1329-40b1-ab3c-22afc79c62e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:41.202486 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03abec-1329-40b1-ab3c-22afc79c62e3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:41.311964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 559/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:14:41 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:14:43.565991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cfec5-cf4d-4b1a-9956-a350cae50573 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:43.566737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cfec5-cf4d-4b1a-9956-a350cae50573 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:43.566737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cfec5-cf4d-4b1a-9956-a350cae50573 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:43.567927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 580/1139] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:43.572979 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640e89d-eccf-454b-b907-03443c9195a1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:43.573351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640e89d-eccf-454b-b907-03443c9195a1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:43.573552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640e89d-eccf-454b-b907-03443c9195a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:43.590441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e640e89d-eccf-454b-b907-03443c9195a1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:43.591620 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e640e89d-eccf-454b-b907-03443c9195a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:43.655654 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 560/1140] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:43.679754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cfec5-cf4d-4b1a-9956-a350cae50573 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:43.781647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cfec5-cf4d-4b1a-9956-a350cae50573 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:43.813153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197183f-fa3d-47ca-a4fb-5eb8a29fe73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:43.813934 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197183f-fa3d-47ca-a4fb-5eb8a29fe73e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:43.814212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197183f-fa3d-47ca-a4fb-5eb8a29fe73e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:43.814514 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197183f-fa3d-47ca-a4fb-5eb8a29fe73e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:43.824847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197183f-fa3d-47ca-a4fb-5eb8a29fe73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-5197183f-fa3d-47ca-a4fb-5eb8a29fe73e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:14:43.832519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:43.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:43.834579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:43.834579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:43.834579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:43.834579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:43.834579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:14:43.834579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:14:43.834579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:14:43.834579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:14:43.834579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:14:43.834579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:14:43.834579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:43.834579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:43.834579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 581/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:14:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:43.840820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640e89d-eccf-454b-b907-03443c9195a1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:43.935242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640e89d-eccf-454b-b907-03443c9195a1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:43.968691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4a071-a3ca-433f-ad9a-4c00c1543ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:43.969348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4a071-a3ca-433f-ad9a-4c00c1543ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:43.969634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4a071-a3ca-433f-ad9a-4c00c1543ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:43.969909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4a071-a3ca-433f-ad9a-4c00c1543ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:43.970671 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4a071-a3ca-433f-ad9a-4c00c1543ae4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:43.970977 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4a071-a3ca-433f-ad9a-4c00c1543ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:43.972348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4a071-a3ca-433f-ad9a-4c00c1543ae4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:43.980506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 561/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:14:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:43.986173 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197183f-fa3d-47ca-a4fb-5eb8a29fe73e None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:44.078877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197183f-fa3d-47ca-a4fb-5eb8a29fe73e None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:44.110040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3135d-0794-4ac4-8de4-caa9ef9b237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:44.110923 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3135d-0794-4ac4-8de4-caa9ef9b237c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:44.111203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3135d-0794-4ac4-8de4-caa9ef9b237c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:44.111473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3135d-0794-4ac4-8de4-caa9ef9b237c None admin] PATH_INFO: `/v3/users/ea9160e97bed43b8958890513dc11e81` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:44.124229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3135d-0794-4ac4-8de4-caa9ef9b237c None admin] RBAC: Authorizing `identity:get_user(user_id=ea9160e97bed43b8958890513dc11e81)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:44.125649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3135d-0794-4ac4-8de4-caa9ef9b237c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:44.127272 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 582/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:14:43 2022] GET /identity/v3/users/ea9160e97bed43b8958890513dc11e81 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:44.132916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4a071-a3ca-433f-ad9a-4c00c1543ae4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:44.226941 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4a071-a3ca-433f-ad9a-4c00c1543ae4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:44.258412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99819ac0-6267-431f-b30d-d31165dd5ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:44.259041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99819ac0-6267-431f-b30d-d31165dd5ffe None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:44.259319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99819ac0-6267-431f-b30d-d31165dd5ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:44.259592 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99819ac0-6267-431f-b30d-d31165dd5ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:44.322559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99819ac0-6267-431f-b30d-d31165dd5ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:44.324629 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99819ac0-6267-431f-b30d-d31165dd5ffe None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:44.415228 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 562/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:14:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:14:44.421202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3135d-0794-4ac4-8de4-caa9ef9b237c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:44.514896 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3135d-0794-4ac4-8de4-caa9ef9b237c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:44.547139 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0d080-3c19-4532-bf86-4c1b95530b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:44.547987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0d080-3c19-4532-bf86-4c1b95530b32 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:44.548268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0d080-3c19-4532-bf86-4c1b95530b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:44.548539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0d080-3c19-4532-bf86-4c1b95530b32 None admin] PATH_INFO: `/v3/projects/8eb2e04536834a0c9a103d587c55f875` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:44.549697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0d080-3c19-4532-bf86-4c1b95530b32 None admin] RBAC: Authorizing `identity:get_project(project_id=8eb2e04536834a0c9a103d587c55f875)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:44.551123 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0d080-3c19-4532-bf86-4c1b95530b32 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:44.552776 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 583/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:14:44 2022] GET /identity/v3/projects/8eb2e04536834a0c9a103d587c55f875 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:44.559381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99819ac0-6267-431f-b30d-d31165dd5ffe None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:44.652114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99819ac0-6267-431f-b30d-d31165dd5ffe None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:44.685773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df71046-409f-4512-b089-07aeaafc9adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:44.686452 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71046-409f-4512-b089-07aeaafc9adb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:44.686734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71046-409f-4512-b089-07aeaafc9adb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:44.687009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71046-409f-4512-b089-07aeaafc9adb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:44.687819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df71046-409f-4512-b089-07aeaafc9adb None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=8eb2e04536834a0c9a103d587c55f875, user.id=ea9160e97bed43b8958890513dc11e81) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:44.688124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df71046-409f-4512-b089-07aeaafc9adb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:44.689598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df71046-409f-4512-b089-07aeaafc9adb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:44.695125 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 563/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:14:44 2022] GET /identity/v3/role_assignments?user.id=ea9160e97bed43b8958890513dc11e81&scope.project.id=8eb2e04536834a0c9a103d587c55f875&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:14:46.895726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f078d4a-90f6-4275-a430-66fa913b0bf0 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:46.896245 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f078d4a-90f6-4275-a430-66fa913b0bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:46.896365 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f078d4a-90f6-4275-a430-66fa913b0bf0 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:46.897664 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 584/1147] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:46.903020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450986b7-6a7c-43bf-8b16-05e59e58bf50 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:46.903429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450986b7-6a7c-43bf-8b16-05e59e58bf50 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:46.903570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450986b7-6a7c-43bf-8b16-05e59e58bf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:46.921120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-450986b7-6a7c-43bf-8b16-05e59e58bf50 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:46.922335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-450986b7-6a7c-43bf-8b16-05e59e58bf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:46.987418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 564/1148] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:14:47.009574 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f078d4a-90f6-4275-a430-66fa913b0bf0 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:47.107101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f078d4a-90f6-4275-a430-66fa913b0bf0 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:47.139088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e88a03-fb61-4aeb-af47-d85bdd3515b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:47.139865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e88a03-fb61-4aeb-af47-d85bdd3515b3 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:47.140143 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e88a03-fb61-4aeb-af47-d85bdd3515b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:47.140416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e88a03-fb61-4aeb-af47-d85bdd3515b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:47.150043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e88a03-fb61-4aeb-af47-d85bdd3515b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-a5e88a03-fb61-4aeb-af47-d85bdd3515b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:14:47.157899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:47.159150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:47.160273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:47.160273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:47.160273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:47.160273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:47.160273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:14:47.160273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:14:47.160273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:14:47.160273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:14:47.160273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:14:47.160273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:14:47.160273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:47.160273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:47.160273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 585/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:47.165467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450986b7-6a7c-43bf-8b16-05e59e58bf50 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:47.258509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450986b7-6a7c-43bf-8b16-05e59e58bf50 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:47.291107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4eb85-fa77-453e-b2f9-bfcbce6d46b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:47.291758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4eb85-fa77-453e-b2f9-bfcbce6d46b8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:47.292038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4eb85-fa77-453e-b2f9-bfcbce6d46b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:47.292447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4eb85-fa77-453e-b2f9-bfcbce6d46b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:47.293239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4eb85-fa77-453e-b2f9-bfcbce6d46b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:47.293543 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4eb85-fa77-453e-b2f9-bfcbce6d46b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:47.294943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4eb85-fa77-453e-b2f9-bfcbce6d46b8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:47.302489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 565/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:47.309345 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e88a03-fb61-4aeb-af47-d85bdd3515b3 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:47.404279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e88a03-fb61-4aeb-af47-d85bdd3515b3 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:47.436015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954de15e-97d8-4d23-9cb0-8eeaf34d7c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:47.436882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954de15e-97d8-4d23-9cb0-8eeaf34d7c99 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:47.437167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954de15e-97d8-4d23-9cb0-8eeaf34d7c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:47.437445 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954de15e-97d8-4d23-9cb0-8eeaf34d7c99 None admin] PATH_INFO: `/v3/users/ea9160e97bed43b8958890513dc11e81` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:47.438646 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954de15e-97d8-4d23-9cb0-8eeaf34d7c99 None admin] RBAC: Authorizing `identity:get_user(user_id=ea9160e97bed43b8958890513dc11e81)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:47.440066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954de15e-97d8-4d23-9cb0-8eeaf34d7c99 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:47.441667 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 586/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:14:47 2022] GET /identity/v3/users/ea9160e97bed43b8958890513dc11e81 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:47.447735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4eb85-fa77-453e-b2f9-bfcbce6d46b8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:47.543626 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4eb85-fa77-453e-b2f9-bfcbce6d46b8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:47.575717 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f588c9-5bc9-4a35-8e3b-2a0bf181ea7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:47.576558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f588c9-5bc9-4a35-8e3b-2a0bf181ea7e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:47.576839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f588c9-5bc9-4a35-8e3b-2a0bf181ea7e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:47.577114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f588c9-5bc9-4a35-8e3b-2a0bf181ea7e None admin] PATH_INFO: `/v3/projects/8eb2e04536834a0c9a103d587c55f875` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:47.578262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f588c9-5bc9-4a35-8e3b-2a0bf181ea7e None admin] RBAC: Authorizing `identity:get_project(project_id=8eb2e04536834a0c9a103d587c55f875)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:47.579719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f588c9-5bc9-4a35-8e3b-2a0bf181ea7e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:47.581383 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 566/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:14:47 2022] GET /identity/v3/projects/8eb2e04536834a0c9a103d587c55f875 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:47.587117 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954de15e-97d8-4d23-9cb0-8eeaf34d7c99 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:47.681614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954de15e-97d8-4d23-9cb0-8eeaf34d7c99 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:47.712791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4c5de-6c92-4043-ad99-ce9eed944b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:47.713658 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4c5de-6c92-4043-ad99-ce9eed944b86 None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:47.713936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4c5de-6c92-4043-ad99-ce9eed944b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:47.714316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4c5de-6c92-4043-ad99-ce9eed944b86 None admin] PATH_INFO: `/v3/projects/8eb2e04536834a0c9a103d587c55f875/users/ea9160e97bed43b8958890513dc11e81/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:47.716345 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4c5de-6c92-4043-ad99-ce9eed944b86 None admin] RBAC: Authorizing `identity:create_grant(project_id=8eb2e04536834a0c9a103d587c55f875, user_id=ea9160e97bed43b8958890513dc11e81, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:47.717742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4c5de-6c92-4043-ad99-ce9eed944b86 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:47.865826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 587/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:14:47 2022] PUT /identity/v3/projects/8eb2e04536834a0c9a103d587c55f875/users/ea9160e97bed43b8958890513dc11e81/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:14:50.115357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e0dd1-d4ef-4a7a-b036-516a5021e979 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:50.115872 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e0dd1-d4ef-4a7a-b036-516a5021e979 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:50.115872 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e0dd1-d4ef-4a7a-b036-516a5021e979 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:50.117191 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 567/1154] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:50.122791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e065c-3ea7-465e-90f3-4b6fa80fcd6f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:50.123207 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e065c-3ea7-465e-90f3-4b6fa80fcd6f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:50.123382 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e065c-3ea7-465e-90f3-4b6fa80fcd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:50.140777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-746e065c-3ea7-465e-90f3-4b6fa80fcd6f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:50.141955 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-746e065c-3ea7-465e-90f3-4b6fa80fcd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:50.207434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 588/1155] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:50.229875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e0dd1-d4ef-4a7a-b036-516a5021e979 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:50.326755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e0dd1-d4ef-4a7a-b036-516a5021e979 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:50.357646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bfe83-531b-4af5-8ec3-0f0351e45b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:50.358448 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bfe83-531b-4af5-8ec3-0f0351e45b11 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:50.358729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bfe83-531b-4af5-8ec3-0f0351e45b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:50.359003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bfe83-531b-4af5-8ec3-0f0351e45b11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:50.368936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bfe83-531b-4af5-8ec3-0f0351e45b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-401bfe83-531b-4af5-8ec3-0f0351e45b11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:14:50.376931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:50.378051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:50.379095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:50.379095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:50.379095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:50.379095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:50.379095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:14:50.379095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:14:50.379095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:14:50.379095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:14:50.379095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:14:50.379095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:14:50.379095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:14:50.379095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:14:50.379095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 568/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:50.383902 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e065c-3ea7-465e-90f3-4b6fa80fcd6f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:50.475666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e065c-3ea7-465e-90f3-4b6fa80fcd6f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:50.507932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc3261-9fc4-4087-8e5f-2ea090926244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:50.508588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc3261-9fc4-4087-8e5f-2ea090926244 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:50.508867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc3261-9fc4-4087-8e5f-2ea090926244 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:50.509140 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc3261-9fc4-4087-8e5f-2ea090926244 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:50.509872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc3261-9fc4-4087-8e5f-2ea090926244 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:50.510177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc3261-9fc4-4087-8e5f-2ea090926244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:50.511542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc3261-9fc4-4087-8e5f-2ea090926244 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:50.520208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 589/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:14:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:50.525798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bfe83-531b-4af5-8ec3-0f0351e45b11 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:50.619390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bfe83-531b-4af5-8ec3-0f0351e45b11 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:50.652222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640ed7e-5115-4489-918c-173ff5fd2a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:50.653180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640ed7e-5115-4489-918c-173ff5fd2a5e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:50.653459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640ed7e-5115-4489-918c-173ff5fd2a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:50.653732 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640ed7e-5115-4489-918c-173ff5fd2a5e None admin] PATH_INFO: `/v3/users/ea9160e97bed43b8958890513dc11e81` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:50.655037 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640ed7e-5115-4489-918c-173ff5fd2a5e None admin] RBAC: Authorizing `identity:get_user(user_id=ea9160e97bed43b8958890513dc11e81)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:50.656581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640ed7e-5115-4489-918c-173ff5fd2a5e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:50.659065 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 569/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:14:50 2022] GET /identity/v3/users/ea9160e97bed43b8958890513dc11e81 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:50.665089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc3261-9fc4-4087-8e5f-2ea090926244 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:50.763265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc3261-9fc4-4087-8e5f-2ea090926244 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:50.795862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4ae01-b60b-4eab-811e-aa4698d4eedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:50.796509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ae01-b60b-4eab-811e-aa4698d4eedc None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:50.796794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ae01-b60b-4eab-811e-aa4698d4eedc None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:50.797075 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ae01-b60b-4eab-811e-aa4698d4eedc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:50.861116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4ae01-b60b-4eab-811e-aa4698d4eedc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:50.862581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4ae01-b60b-4eab-811e-aa4698d4eedc None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:50.953683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 590/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:14:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:14:50.959527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640ed7e-5115-4489-918c-173ff5fd2a5e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:51.054218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640ed7e-5115-4489-918c-173ff5fd2a5e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:51.085373 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e1d4e-fed0-4130-9ee7-9fc67392cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:51.086221 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e1d4e-fed0-4130-9ee7-9fc67392cc3d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:51.086535 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e1d4e-fed0-4130-9ee7-9fc67392cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:51.086807 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e1d4e-fed0-4130-9ee7-9fc67392cc3d None admin] PATH_INFO: `/v3/projects/8eb2e04536834a0c9a103d587c55f875` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:51.087949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e1d4e-fed0-4130-9ee7-9fc67392cc3d None admin] RBAC: Authorizing `identity:get_project(project_id=8eb2e04536834a0c9a103d587c55f875)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:51.089363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e1d4e-fed0-4130-9ee7-9fc67392cc3d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:51.091588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 570/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:14:50 2022] GET /identity/v3/projects/8eb2e04536834a0c9a103d587c55f875 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:51.097753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4ae01-b60b-4eab-811e-aa4698d4eedc None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:51.193159 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4ae01-b60b-4eab-811e-aa4698d4eedc None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:51.224600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cca9e9-8162-4f13-a718-5e6e5ddffd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:51.225182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cca9e9-8162-4f13-a718-5e6e5ddffd53 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:51.225461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cca9e9-8162-4f13-a718-5e6e5ddffd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:51.225736 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cca9e9-8162-4f13-a718-5e6e5ddffd53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:51.226689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cca9e9-8162-4f13-a718-5e6e5ddffd53 None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=8eb2e04536834a0c9a103d587c55f875, user.id=ea9160e97bed43b8958890513dc11e81) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:51.226999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cca9e9-8162-4f13-a718-5e6e5ddffd53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:51.228408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cca9e9-8162-4f13-a718-5e6e5ddffd53 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:51.234786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 591/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:14:51 2022] GET /identity/v3/role_assignments?user.id=ea9160e97bed43b8958890513dc11e81&scope.project.id=8eb2e04536834a0c9a103d587c55f875&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:53.493698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b126d7-adff-461d-9bcd-6462d3153845 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:53.494228 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b126d7-adff-461d-9bcd-6462d3153845 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:53.494368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b126d7-adff-461d-9bcd-6462d3153845 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:53.495946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 571/1162] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:53.501648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78258a19-3885-483c-a8f2-e35cb3cea731 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:53.502050 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78258a19-3885-483c-a8f2-e35cb3cea731 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:53.502198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78258a19-3885-483c-a8f2-e35cb3cea731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:53.518227 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-78258a19-3885-483c-a8f2-e35cb3cea731 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:53.519441 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-78258a19-3885-483c-a8f2-e35cb3cea731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:53.581337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 592/1163] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:53.602794 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b126d7-adff-461d-9bcd-6462d3153845 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:53.704781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b126d7-adff-461d-9bcd-6462d3153845 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:53.741093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33ecc1-98a5-46e9-8502-5c1428599770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:53.741734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ecc1-98a5-46e9-8502-5c1428599770 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:53.742015 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ecc1-98a5-46e9-8502-5c1428599770 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:53.742316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ecc1-98a5-46e9-8502-5c1428599770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:53.805503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33ecc1-98a5-46e9-8502-5c1428599770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:53.806979 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33ecc1-98a5-46e9-8502-5c1428599770 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:53.898951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 572/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:14:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:14:53.905538 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78258a19-3885-483c-a8f2-e35cb3cea731 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:54.000637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78258a19-3885-483c-a8f2-e35cb3cea731 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:54.032986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430aed65-27d1-4e2e-b8e9-44c3f663aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:54.033729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aed65-27d1-4e2e-b8e9-44c3f663aacf None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:54.034009 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aed65-27d1-4e2e-b8e9-44c3f663aacf None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:54.034317 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aed65-27d1-4e2e-b8e9-44c3f663aacf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:54.040965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430aed65-27d1-4e2e-b8e9-44c3f663aacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:54.042435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430aed65-27d1-4e2e-b8e9-44c3f663aacf None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-430aed65-27d1-4e2e-b8e9-44c3f663aacf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:14:54.057157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:14:54.058446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:14:54.059502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 593/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Thu May 5 15:14:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:14:54.064246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33ecc1-98a5-46e9-8502-5c1428599770 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:54.159307 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33ecc1-98a5-46e9-8502-5c1428599770 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:54.192532 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb246ee-d7e8-4ca1-be99-8cafdc8a5da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:54.193179 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb246ee-d7e8-4ca1-be99-8cafdc8a5da5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:54.193467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb246ee-d7e8-4ca1-be99-8cafdc8a5da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:54.193743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb246ee-d7e8-4ca1-be99-8cafdc8a5da5 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:54.194476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb246ee-d7e8-4ca1-be99-8cafdc8a5da5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:14:54.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb246ee-d7e8-4ca1-be99-8cafdc8a5da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:54.196136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb246ee-d7e8-4ca1-be99-8cafdc8a5da5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:54.203940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 573/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Thu May 5 15:14:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:56.416280 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380de6d-6df4-4ae0-a0a7-2c9c223c565d None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:56.416808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380de6d-6df4-4ae0-a0a7-2c9c223c565d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:56.416808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380de6d-6df4-4ae0-a0a7-2c9c223c565d None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:56.419027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 594/1167] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:56.424204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51bf3-4a4a-49df-af69-8f280dd42532 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:56.424584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51bf3-4a4a-49df-af69-8f280dd42532 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:56.424777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51bf3-4a4a-49df-af69-8f280dd42532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:56.440969 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a6d51bf3-4a4a-49df-af69-8f280dd42532 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:56.442163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a6d51bf3-4a4a-49df-af69-8f280dd42532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:56.505120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 574/1168] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:56.528821 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380de6d-6df4-4ae0-a0a7-2c9c223c565d None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:56.624511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380de6d-6df4-4ae0-a0a7-2c9c223c565d None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:56.655209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39b467-d0c6-48a6-851e-03f71fbcb0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:56.655856 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b467-d0c6-48a6-851e-03f71fbcb0f3 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:56.656136 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b467-d0c6-48a6-851e-03f71fbcb0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:56.656411 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b467-d0c6-48a6-851e-03f71fbcb0f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:56.657131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39b467-d0c6-48a6-851e-03f71fbcb0f3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:56.658511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39b467-d0c6-48a6-851e-03f71fbcb0f3 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:56.745571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 595/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Thu May 5 15:14:56 2022] POST /identity/v3/domains => generated 267 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:14:59.015072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbe42f-9262-4e29-90ab-be8a97c9b29f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:59.015574 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbe42f-9262-4e29-90ab-be8a97c9b29f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:59.015574 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbe42f-9262-4e29-90ab-be8a97c9b29f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:59.016904 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 575/1170] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:14:59.021970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5927e4-b4e2-4cc9-b90e-16c9d26715db None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:59.022398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5927e4-b4e2-4cc9-b90e-16c9d26715db None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:59.022568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5927e4-b4e2-4cc9-b90e-16c9d26715db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:59.039599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6f5927e4-b4e2-4cc9-b90e-16c9d26715db None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:14:59.040785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6f5927e4-b4e2-4cc9-b90e-16c9d26715db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:14:59.103639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 596/1171] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:14:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:14:59.127176 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbe42f-9262-4e29-90ab-be8a97c9b29f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:59.222494 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbe42f-9262-4e29-90ab-be8a97c9b29f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:59.254174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070eb466-e75e-478e-9f64-2f9f6455a13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:59.255049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070eb466-e75e-478e-9f64-2f9f6455a13e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:59.255334 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070eb466-e75e-478e-9f64-2f9f6455a13e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:59.255611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070eb466-e75e-478e-9f64-2f9f6455a13e None admin] PATH_INFO: `/v3/domains/e4aa04fddb554594a32911a653df13eb` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:59.265728 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070eb466-e75e-478e-9f64-2f9f6455a13e None admin] RBAC: Authorizing `identity:get_domain(domain_id=e4aa04fddb554594a32911a653df13eb)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:59.267151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070eb466-e75e-478e-9f64-2f9f6455a13e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:59.268763 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 576/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Thu May 5 15:14:59 2022] GET /identity/v3/domains/e4aa04fddb554594a32911a653df13eb => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:14:59.274502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5927e4-b4e2-4cc9-b90e-16c9d26715db None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:14:59.368391 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5927e4-b4e2-4cc9-b90e-16c9d26715db None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:14:59.400310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ecfe5-2314-4596-bba5-eb0ab2281a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:14:59.400959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ecfe5-2314-4596-bba5-eb0ab2281a16 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:14:59.401246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ecfe5-2314-4596-bba5-eb0ab2281a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:14:59.401524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ecfe5-2314-4596-bba5-eb0ab2281a16 None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:14:59.402802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ecfe5-2314-4596-bba5-eb0ab2281a16 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:14:59.404225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ecfe5-2314-4596-bba5-eb0ab2281a16 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:14:59.488459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 597/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:14:59 2022] POST /identity/v3/projects => generated 361 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:15:01.739452 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4791f2e-49ef-482c-a184-a02961a32051 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:01.740010 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4791f2e-49ef-482c-a184-a02961a32051 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:01.740010 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4791f2e-49ef-482c-a184-a02961a32051 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:01.741350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 577/1174] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:15:01.746497 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59887264-ca7a-4d2f-afdb-6a7d9dbe1e98 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:01.746926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59887264-ca7a-4d2f-afdb-6a7d9dbe1e98 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:01.747065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59887264-ca7a-4d2f-afdb-6a7d9dbe1e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:01.763972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-59887264-ca7a-4d2f-afdb-6a7d9dbe1e98 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:15:01.765174 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-59887264-ca7a-4d2f-afdb-6a7d9dbe1e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:15:01.828360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 598/1175] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:15:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:15:01.853130 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4791f2e-49ef-482c-a184-a02961a32051 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:01.948103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4791f2e-49ef-482c-a184-a02961a32051 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:01.979639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ef9a5-bf8b-4d39-9ca7-9ebd7051f06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:01.980508 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ef9a5-bf8b-4d39-9ca7-9ebd7051f06b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:01.980783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ef9a5-bf8b-4d39-9ca7-9ebd7051f06b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:01.981057 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ef9a5-bf8b-4d39-9ca7-9ebd7051f06b None admin] PATH_INFO: `/v3/domains/e4aa04fddb554594a32911a653df13eb` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:01.982199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ef9a5-bf8b-4d39-9ca7-9ebd7051f06b None admin] RBAC: Authorizing `identity:get_domain(domain_id=e4aa04fddb554594a32911a653df13eb)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:01.983663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ef9a5-bf8b-4d39-9ca7-9ebd7051f06b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:01.985568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 578/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Thu May 5 15:15:01 2022] GET /identity/v3/domains/e4aa04fddb554594a32911a653df13eb => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:15:01.991306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59887264-ca7a-4d2f-afdb-6a7d9dbe1e98 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:02.084319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59887264-ca7a-4d2f-afdb-6a7d9dbe1e98 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:02.115923 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a65f6-3294-4b64-a685-b949f4436e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:02.116588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a65f6-3294-4b64-a685-b949f4436e64 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:02.116873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a65f6-3294-4b64-a685-b949f4436e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:02.117149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a65f6-3294-4b64-a685-b949f4436e64 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:02.117851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a65f6-3294-4b64-a685-b949f4436e64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:02.119301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a65f6-3294-4b64-a685-b949f4436e64 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:02.203323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 599/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:15:01 2022] POST /identity/v3/users => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:15:04.509946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e55c1-ee9f-42e9-84a4-e232e8b9d06d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:04.510505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e55c1-ee9f-42e9-84a4-e232e8b9d06d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:04.510624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e55c1-ee9f-42e9-84a4-e232e8b9d06d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:04.511945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 579/1178] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:15:04.517182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f4cf2-fe4b-4056-9bcd-f07852219958 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:04.517616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f4cf2-fe4b-4056-9bcd-f07852219958 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:04.517747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f4cf2-fe4b-4056-9bcd-f07852219958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:04.534688 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-101f4cf2-fe4b-4056-9bcd-f07852219958 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:15:04.535906 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-101f4cf2-fe4b-4056-9bcd-f07852219958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:15:04.599284 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 600/1179] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:15:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:15:04.622978 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e55c1-ee9f-42e9-84a4-e232e8b9d06d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:04.722782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e55c1-ee9f-42e9-84a4-e232e8b9d06d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:04.764531 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b33f87-eef6-42f6-bf29-0dd44528d02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:04.765331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b33f87-eef6-42f6-bf29-0dd44528d02f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:04.765612 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b33f87-eef6-42f6-bf29-0dd44528d02f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:04.765887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b33f87-eef6-42f6-bf29-0dd44528d02f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:04.776005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b33f87-eef6-42f6-bf29-0dd44528d02f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e7b33f87-eef6-42f6-bf29-0dd44528d02f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:15:04.784192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:15:04.785295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:15:04.786218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:15:04.786218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:15:04.786218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:15:04.786218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:15:04.786218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:15:04.786218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:15:04.786218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:15:04.786218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:15:04.786218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:15:04.786218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:15:04.786218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:15:04.786218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:15:04.786218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 580/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:15:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:15:04.791577 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f4cf2-fe4b-4056-9bcd-f07852219958 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:04.886137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f4cf2-fe4b-4056-9bcd-f07852219958 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:04.919586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7312e82-5573-4f6e-947b-98cb99015768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:04.920250 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7312e82-5573-4f6e-947b-98cb99015768 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:04.920536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7312e82-5573-4f6e-947b-98cb99015768 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:04.920814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7312e82-5573-4f6e-947b-98cb99015768 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:04.921556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7312e82-5573-4f6e-947b-98cb99015768 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:15:04.921864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7312e82-5573-4f6e-947b-98cb99015768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:04.923252 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7312e82-5573-4f6e-947b-98cb99015768 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:04.930926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 601/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:15:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:15:04.937142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b33f87-eef6-42f6-bf29-0dd44528d02f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:05.031145 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b33f87-eef6-42f6-bf29-0dd44528d02f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:05.063715 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7fd2a-04b0-4266-8ef4-d8ca94aaebc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:05.064570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7fd2a-04b0-4266-8ef4-d8ca94aaebc8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:05.064851 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7fd2a-04b0-4266-8ef4-d8ca94aaebc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:05.065126 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7fd2a-04b0-4266-8ef4-d8ca94aaebc8 None admin] PATH_INFO: `/v3/users/3727dc2b6c6e4220a02b9453200336ab` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:05.078208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7fd2a-04b0-4266-8ef4-d8ca94aaebc8 None admin] RBAC: Authorizing `identity:get_user(user_id=3727dc2b6c6e4220a02b9453200336ab)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:05.079675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7fd2a-04b0-4266-8ef4-d8ca94aaebc8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:05.081774 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 581/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:15:04 2022] GET /identity/v3/users/3727dc2b6c6e4220a02b9453200336ab => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:15:05.087549 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7312e82-5573-4f6e-947b-98cb99015768 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:05.181181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7312e82-5573-4f6e-947b-98cb99015768 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:05.213398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5b578-0617-4fd6-96f7-6d7ee09f2996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:05.214039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5b578-0617-4fd6-96f7-6d7ee09f2996 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:05.214455 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5b578-0617-4fd6-96f7-6d7ee09f2996 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:05.214869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5b578-0617-4fd6-96f7-6d7ee09f2996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:05.277467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5b578-0617-4fd6-96f7-6d7ee09f2996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:05.279033 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5b578-0617-4fd6-96f7-6d7ee09f2996 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:05.371290 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 602/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:15:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:15:05.377036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7fd2a-04b0-4266-8ef4-d8ca94aaebc8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:05.471023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7fd2a-04b0-4266-8ef4-d8ca94aaebc8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:05.503530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf6840-1357-4e15-ac7b-ba7a137baaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:05.504379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf6840-1357-4e15-ac7b-ba7a137baaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:05.504659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf6840-1357-4e15-ac7b-ba7a137baaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:05.504932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf6840-1357-4e15-ac7b-ba7a137baaa9 None admin] PATH_INFO: `/v3/projects/eef9012afc524c689f80c76ef9854844` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:05.506086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf6840-1357-4e15-ac7b-ba7a137baaa9 None admin] RBAC: Authorizing `identity:get_project(project_id=eef9012afc524c689f80c76ef9854844)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:05.507551 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf6840-1357-4e15-ac7b-ba7a137baaa9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:05.509217 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 582/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:15:05 2022] GET /identity/v3/projects/eef9012afc524c689f80c76ef9854844 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:15:05.515451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5b578-0617-4fd6-96f7-6d7ee09f2996 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:05.608229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5b578-0617-4fd6-96f7-6d7ee09f2996 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:05.639800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5044672-6933-4173-a6d4-761e3d6b71e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:05.640439 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5044672-6933-4173-a6d4-761e3d6b71e9 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:05.640716 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5044672-6933-4173-a6d4-761e3d6b71e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:05.640985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5044672-6933-4173-a6d4-761e3d6b71e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:05.641798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5044672-6933-4173-a6d4-761e3d6b71e9 None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=eef9012afc524c689f80c76ef9854844, user.id=3727dc2b6c6e4220a02b9453200336ab) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:15:05.642103 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5044672-6933-4173-a6d4-761e3d6b71e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:05.643531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5044672-6933-4173-a6d4-761e3d6b71e9 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:05.648706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 603/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:15:05 2022] GET /identity/v3/role_assignments?user.id=3727dc2b6c6e4220a02b9453200336ab&scope.project.id=eef9012afc524c689f80c76ef9854844&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:15:07.904293 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21bc47-6021-4805-8469-ffc8108632cb None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:07.904840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21bc47-6021-4805-8469-ffc8108632cb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:07.904840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21bc47-6021-4805-8469-ffc8108632cb None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:07.906196 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 583/1186] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:15:07.911390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6ad77-2868-46c0-8c90-14f1db33690b None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:07.912063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6ad77-2868-46c0-8c90-14f1db33690b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:07.912203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6ad77-2868-46c0-8c90-14f1db33690b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:07.928806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a0c6ad77-2868-46c0-8c90-14f1db33690b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:15:07.929994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a0c6ad77-2868-46c0-8c90-14f1db33690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:15:07.994633 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 604/1187] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:15:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:15:08.017599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21bc47-6021-4805-8469-ffc8108632cb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:08.115553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21bc47-6021-4805-8469-ffc8108632cb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:08.148010 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d6b14-a521-40a6-b96c-37e1a8335463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:08.148793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d6b14-a521-40a6-b96c-37e1a8335463 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:08.149077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d6b14-a521-40a6-b96c-37e1a8335463 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:08.149350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d6b14-a521-40a6-b96c-37e1a8335463 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:08.159903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d6b14-a521-40a6-b96c-37e1a8335463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-0a7d6b14-a521-40a6-b96c-37e1a8335463 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:15:08.168566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:15:08.169666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:15:08.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:15:08.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:15:08.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:15:08.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:15:08.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:15:08.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:15:08.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:15:08.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:15:08.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:15:08.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:15:08.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:15:08.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:15:08.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 584/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:15:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:15:08.176057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6ad77-2868-46c0-8c90-14f1db33690b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:08.268188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6ad77-2868-46c0-8c90-14f1db33690b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:08.300558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a5e34-cbff-44cc-92b5-ca846a5d39f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:08.301211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a5e34-cbff-44cc-92b5-ca846a5d39f0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:08.301489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a5e34-cbff-44cc-92b5-ca846a5d39f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:08.301760 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a5e34-cbff-44cc-92b5-ca846a5d39f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:08.302524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a5e34-cbff-44cc-92b5-ca846a5d39f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:15:08.302828 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a5e34-cbff-44cc-92b5-ca846a5d39f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:08.304175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a5e34-cbff-44cc-92b5-ca846a5d39f0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:08.311989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 605/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:15:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:15:08.318005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d6b14-a521-40a6-b96c-37e1a8335463 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:08.414100 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d6b14-a521-40a6-b96c-37e1a8335463 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:08.445983 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979dcec-c69c-4bf7-b396-82c0fed91ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:08.446863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979dcec-c69c-4bf7-b396-82c0fed91ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:08.447146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979dcec-c69c-4bf7-b396-82c0fed91ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:08.447421 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979dcec-c69c-4bf7-b396-82c0fed91ec4 None admin] PATH_INFO: `/v3/users/3727dc2b6c6e4220a02b9453200336ab` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:08.449089 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979dcec-c69c-4bf7-b396-82c0fed91ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=3727dc2b6c6e4220a02b9453200336ab)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:08.450990 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979dcec-c69c-4bf7-b396-82c0fed91ec4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:08.452593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 585/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:15:08 2022] GET /identity/v3/users/3727dc2b6c6e4220a02b9453200336ab => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:15:08.458714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a5e34-cbff-44cc-92b5-ca846a5d39f0 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:08.553316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a5e34-cbff-44cc-92b5-ca846a5d39f0 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:08.585088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd52483-131b-4d22-a804-713fa88b31a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:08.585942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd52483-131b-4d22-a804-713fa88b31a3 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:08.586225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd52483-131b-4d22-a804-713fa88b31a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:08.586529 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd52483-131b-4d22-a804-713fa88b31a3 None admin] PATH_INFO: `/v3/projects/eef9012afc524c689f80c76ef9854844` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:08.587697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd52483-131b-4d22-a804-713fa88b31a3 None admin] RBAC: Authorizing `identity:get_project(project_id=eef9012afc524c689f80c76ef9854844)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:08.589120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd52483-131b-4d22-a804-713fa88b31a3 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:08.591590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 606/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:15:08 2022] GET /identity/v3/projects/eef9012afc524c689f80c76ef9854844 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:15:08.597388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979dcec-c69c-4bf7-b396-82c0fed91ec4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:08.692007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979dcec-c69c-4bf7-b396-82c0fed91ec4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:08.723748 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e6ac6-f5e9-4a6b-89ee-046e92ed123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:08.724618 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e6ac6-f5e9-4a6b-89ee-046e92ed123b None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:08.724898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e6ac6-f5e9-4a6b-89ee-046e92ed123b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:08.725172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e6ac6-f5e9-4a6b-89ee-046e92ed123b None admin] PATH_INFO: `/v3/projects/eef9012afc524c689f80c76ef9854844/users/3727dc2b6c6e4220a02b9453200336ab/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:08.727130 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e6ac6-f5e9-4a6b-89ee-046e92ed123b None admin] RBAC: Authorizing `identity:create_grant(project_id=eef9012afc524c689f80c76ef9854844, user_id=3727dc2b6c6e4220a02b9453200336ab, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:08.728564 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e6ac6-f5e9-4a6b-89ee-046e92ed123b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:08.802087 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 586/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:15:08 2022] PUT /identity/v3/projects/eef9012afc524c689f80c76ef9854844/users/3727dc2b6c6e4220a02b9453200336ab/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:15:11.024575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe50f91-e483-4b8a-9b52-08501bbc561d None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:11.025094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe50f91-e483-4b8a-9b52-08501bbc561d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:11.025094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe50f91-e483-4b8a-9b52-08501bbc561d None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:11.026406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 607/1193] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:15:11.031714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e133d3a-ae06-4e92-992c-2dd7e242d31c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:11.032131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e133d3a-ae06-4e92-992c-2dd7e242d31c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:11.032266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e133d3a-ae06-4e92-992c-2dd7e242d31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:11.049096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1e133d3a-ae06-4e92-992c-2dd7e242d31c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:15:11.050270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1e133d3a-ae06-4e92-992c-2dd7e242d31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:15:11.113077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 587/1194] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:15:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:15:11.136379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe50f91-e483-4b8a-9b52-08501bbc561d None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:11.232655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe50f91-e483-4b8a-9b52-08501bbc561d None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:11.264438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61484c34-2492-43f2-b199-1e455d396955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:11.265217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61484c34-2492-43f2-b199-1e455d396955 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:11.265494 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61484c34-2492-43f2-b199-1e455d396955 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:11.265766 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61484c34-2492-43f2-b199-1e455d396955 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:11.275278 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61484c34-2492-43f2-b199-1e455d396955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-61484c34-2492-43f2-b199-1e455d396955 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:15:11.283224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:15:11.284310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:15:11.285481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:15:11.285481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:15:11.285481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:15:11.285481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:15:11.285481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:15:11.285481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:15:11.285481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:15:11.285481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:15:11.285481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:15:11.285481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:15:11.285481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:15:11.285481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:15:11.285481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 608/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:15:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:15:11.290588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e133d3a-ae06-4e92-992c-2dd7e242d31c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:11.384277 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e133d3a-ae06-4e92-992c-2dd7e242d31c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:11.416956 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933a83a-e773-49e5-91dd-402db5483799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:11.418653 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933a83a-e773-49e5-91dd-402db5483799 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:11.418938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933a83a-e773-49e5-91dd-402db5483799 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:11.419216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933a83a-e773-49e5-91dd-402db5483799 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:11.419951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933a83a-e773-49e5-91dd-402db5483799 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:15:11.420257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933a83a-e773-49e5-91dd-402db5483799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:11.421615 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933a83a-e773-49e5-91dd-402db5483799 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:11.429236 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 588/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:15:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:15:11.435081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61484c34-2492-43f2-b199-1e455d396955 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:11.529438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61484c34-2492-43f2-b199-1e455d396955 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:11.560914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf1252-af56-45f2-9b8c-423f6e5ab5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:11.561768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf1252-af56-45f2-9b8c-423f6e5ab5cb None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:11.562052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf1252-af56-45f2-9b8c-423f6e5ab5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:11.562360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf1252-af56-45f2-9b8c-423f6e5ab5cb None admin] PATH_INFO: `/v3/users/3727dc2b6c6e4220a02b9453200336ab` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:11.563528 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf1252-af56-45f2-9b8c-423f6e5ab5cb None admin] RBAC: Authorizing `identity:get_user(user_id=3727dc2b6c6e4220a02b9453200336ab)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:11.564948 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf1252-af56-45f2-9b8c-423f6e5ab5cb None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:11.566591 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 609/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 5 15:15:11 2022] GET /identity/v3/users/3727dc2b6c6e4220a02b9453200336ab => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:15:11.572514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933a83a-e773-49e5-91dd-402db5483799 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:11.668458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933a83a-e773-49e5-91dd-402db5483799 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:11.700224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bbd5c-a21c-406d-8129-7e7bb69c73e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:11.700856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bbd5c-a21c-406d-8129-7e7bb69c73e1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:11.701164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bbd5c-a21c-406d-8129-7e7bb69c73e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:11.701439 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bbd5c-a21c-406d-8129-7e7bb69c73e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:11.764917 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bbd5c-a21c-406d-8129-7e7bb69c73e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:11.766390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bbd5c-a21c-406d-8129-7e7bb69c73e1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:11.861394 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 589/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:15:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:15:11.867167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf1252-af56-45f2-9b8c-423f6e5ab5cb None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:11.962049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf1252-af56-45f2-9b8c-423f6e5ab5cb None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:11.994485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe773f2-e25e-4672-a6af-64eb3f42d270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:11.995376 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe773f2-e25e-4672-a6af-64eb3f42d270 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:11.995743 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe773f2-e25e-4672-a6af-64eb3f42d270 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:11.996020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe773f2-e25e-4672-a6af-64eb3f42d270 None admin] PATH_INFO: `/v3/projects/eef9012afc524c689f80c76ef9854844` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:11.997186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe773f2-e25e-4672-a6af-64eb3f42d270 None admin] RBAC: Authorizing `identity:get_project(project_id=eef9012afc524c689f80c76ef9854844)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:11.998626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe773f2-e25e-4672-a6af-64eb3f42d270 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:12.000289 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 610/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 5 15:15:11 2022] GET /identity/v3/projects/eef9012afc524c689f80c76ef9854844 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:15:12.006304 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bbd5c-a21c-406d-8129-7e7bb69c73e1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:15:12.099702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bbd5c-a21c-406d-8129-7e7bb69c73e1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:15:12.132541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac45a93-ea91-482d-bf10-ffc3d9029133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:15:12.133173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac45a93-ea91-482d-bf10-ffc3d9029133 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:15:12.133458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac45a93-ea91-482d-bf10-ffc3d9029133 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:15:12.133734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac45a93-ea91-482d-bf10-ffc3d9029133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:15:12.134573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac45a93-ea91-482d-bf10-ffc3d9029133 None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=eef9012afc524c689f80c76ef9854844, user.id=3727dc2b6c6e4220a02b9453200336ab) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:15:12.134881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac45a93-ea91-482d-bf10-ffc3d9029133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:15:12.136334 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac45a93-ea91-482d-bf10-ffc3d9029133 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:15:12.142093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 590/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:15:12 2022] GET /identity/v3/role_assignments?user.id=3727dc2b6c6e4220a02b9453200336ab&scope.project.id=eef9012afc524c689f80c76ef9854844&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:30.618428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88c5c6-797f-420d-b036-706277ee88e6 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:30.619641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88c5c6-797f-420d-b036-706277ee88e6 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:30.619641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88c5c6-797f-420d-b036-706277ee88e6 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:30.620944 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 611/1201] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:16:30.626214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a81c30-0294-4848-8141-8c5df9ad7931 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:30.626680 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a81c30-0294-4848-8141-8c5df9ad7931 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:30.626831 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a81c30-0294-4848-8141-8c5df9ad7931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:30.643712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-21a81c30-0294-4848-8141-8c5df9ad7931 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:16:30.644902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-21a81c30-0294-4848-8141-8c5df9ad7931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:16:30.709197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 591/1202] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:16:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:16:30.734133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88c5c6-797f-420d-b036-706277ee88e6 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:30.834604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88c5c6-797f-420d-b036-706277ee88e6 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:30.867965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d5ff7-3c92-4562-a188-f65448ebdf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:30.869579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d5ff7-3c92-4562-a188-f65448ebdf8d None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:30.869940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d5ff7-3c92-4562-a188-f65448ebdf8d None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:30.870329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d5ff7-3c92-4562-a188-f65448ebdf8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:30.880052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d5ff7-3c92-4562-a188-f65448ebdf8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:30.881473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d5ff7-3c92-4562-a188-f65448ebdf8d None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-291d5ff7-3c92-4562-a188-f65448ebdf8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:16:30.898861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:30.900014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:30.901311 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:16:30.901311 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:16:30.901311 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:30.901311 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:30.901311 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 612/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:30.906942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a81c30-0294-4848-8141-8c5df9ad7931 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:31.005322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a81c30-0294-4848-8141-8c5df9ad7931 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:31.039841 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a4a38-6ca1-4f5e-8e43-a91282545f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:31.040500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a4a38-6ca1-4f5e-8e43-a91282545f60 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:31.041436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a4a38-6ca1-4f5e-8e43-a91282545f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:31.042185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a4a38-6ca1-4f5e-8e43-a91282545f60 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:31.042936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a4a38-6ca1-4f5e-8e43-a91282545f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:31.043242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a4a38-6ca1-4f5e-8e43-a91282545f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:31.044617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a4a38-6ca1-4f5e-8e43-a91282545f60 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:31.055594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 592/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:31.061269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d5ff7-3c92-4562-a188-f65448ebdf8d None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:31.157801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d5ff7-3c92-4562-a188-f65448ebdf8d None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:31.190781 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1df19-56d2-4434-b515-98e73dcca25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:31.191436 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1df19-56d2-4434-b515-98e73dcca25f None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:31.191715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1df19-56d2-4434-b515-98e73dcca25f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:31.192030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1df19-56d2-4434-b515-98e73dcca25f None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:31.192830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1df19-56d2-4434-b515-98e73dcca25f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:31.194249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1df19-56d2-4434-b515-98e73dcca25f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:31.327789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 613/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 5 15:16:31 2022] POST /identity/v3/users => generated 251 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:16:33.612387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cbe62-9f93-4b75-a582-2be5d73892a0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:33.612937 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cbe62-9f93-4b75-a582-2be5d73892a0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:33.612937 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cbe62-9f93-4b75-a582-2be5d73892a0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:33.614328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 593/1206] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:16:33.619846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ec22e-25a0-4c0b-bda5-951836740345 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:33.620324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ec22e-25a0-4c0b-bda5-951836740345 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:33.620424 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ec22e-25a0-4c0b-bda5-951836740345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:33.637638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a40ec22e-25a0-4c0b-bda5-951836740345 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:16:33.638887 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a40ec22e-25a0-4c0b-bda5-951836740345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:16:33.703939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 614/1207] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:16:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:16:33.727741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cbe62-9f93-4b75-a582-2be5d73892a0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:33.826059 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cbe62-9f93-4b75-a582-2be5d73892a0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:33.858659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8194adf-3eca-4387-838d-2e307bea72bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:33.859435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8194adf-3eca-4387-838d-2e307bea72bc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:33.859719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8194adf-3eca-4387-838d-2e307bea72bc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:33.859995 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8194adf-3eca-4387-838d-2e307bea72bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:33.870634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8194adf-3eca-4387-838d-2e307bea72bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f8194adf-3eca-4387-838d-2e307bea72bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:16:33.878335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:33.879464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:33.880500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:33.880500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:33.880500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:33.880500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:33.880500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:16:33.880500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:16:33.880500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:16:33.880500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:16:33.880500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:16:33.880500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:16:33.880500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:16:33.880500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:33.880500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 594/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:16:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:33.886184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ec22e-25a0-4c0b-bda5-951836740345 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:33.983149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ec22e-25a0-4c0b-bda5-951836740345 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:34.015686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad077e-9af5-4dda-a93d-a0ec49d22b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:34.016356 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad077e-9af5-4dda-a93d-a0ec49d22b4c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:34.016636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad077e-9af5-4dda-a93d-a0ec49d22b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:34.017073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad077e-9af5-4dda-a93d-a0ec49d22b4c None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:34.017814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad077e-9af5-4dda-a93d-a0ec49d22b4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:34.018117 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad077e-9af5-4dda-a93d-a0ec49d22b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:34.019508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad077e-9af5-4dda-a93d-a0ec49d22b4c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:34.027606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 615/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:16:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:34.033390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8194adf-3eca-4387-838d-2e307bea72bc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:34.129911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8194adf-3eca-4387-838d-2e307bea72bc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:34.163819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb83c7-387a-4e76-a3f2-e5ea9d302881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:34.164611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb83c7-387a-4e76-a3f2-e5ea9d302881 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:34.164895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb83c7-387a-4e76-a3f2-e5ea9d302881 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:34.165280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb83c7-387a-4e76-a3f2-e5ea9d302881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:34.176291 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb83c7-387a-4e76-a3f2-e5ea9d302881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:34.177732 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb83c7-387a-4e76-a3f2-e5ea9d302881 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-8ddb83c7-387a-4e76-a3f2-e5ea9d302881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:16:34.194783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:34.195823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:34.196907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:16:34.196907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:16:34.196907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:34.196907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:34.196907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 595/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:34.201928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad077e-9af5-4dda-a93d-a0ec49d22b4c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:34.301229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad077e-9af5-4dda-a93d-a0ec49d22b4c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:34.334275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a09d8-a902-48be-aef1-cafed388fe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:34.334964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a09d8-a902-48be-aef1-cafed388fe92 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:34.335248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a09d8-a902-48be-aef1-cafed388fe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:34.335525 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a09d8-a902-48be-aef1-cafed388fe92 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:34.336237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a09d8-a902-48be-aef1-cafed388fe92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:34.336541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a09d8-a902-48be-aef1-cafed388fe92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:34.338995 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a09d8-a902-48be-aef1-cafed388fe92 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:34.350098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 616/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:34.356015 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb83c7-387a-4e76-a3f2-e5ea9d302881 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:34.453180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb83c7-387a-4e76-a3f2-e5ea9d302881 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:34.487686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b5ad5-599a-4996-aa35-71e22844a3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:34.488479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b5ad5-599a-4996-aa35-71e22844a3dd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:34.488761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b5ad5-599a-4996-aa35-71e22844a3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:34.489036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b5ad5-599a-4996-aa35-71e22844a3dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:34.496011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b5ad5-599a-4996-aa35-71e22844a3dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:34.497556 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b5ad5-599a-4996-aa35-71e22844a3dd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ee8b5ad5-599a-4996-aa35-71e22844a3dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:16:34.512426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:34.513411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:34.514503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:34.514503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:34.514503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:16:34.514503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:16:34.514503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:16:34.514503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:16:34.514503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:16:34.514503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:16:34.514503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:16:34.514503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:34.514503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 596/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:34.519501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a09d8-a902-48be-aef1-cafed388fe92 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:34.622421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a09d8-a902-48be-aef1-cafed388fe92 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:34.655648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f490ff-0651-4252-af85-8fcb9d263fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:34.656314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f490ff-0651-4252-af85-8fcb9d263fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:34.656599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f490ff-0651-4252-af85-8fcb9d263fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:34.656876 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f490ff-0651-4252-af85-8fcb9d263fb1 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:34.657794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f490ff-0651-4252-af85-8fcb9d263fb1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:34.658102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f490ff-0651-4252-af85-8fcb9d263fb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:34.659561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f490ff-0651-4252-af85-8fcb9d263fb1 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:34.676639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 617/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Thu May 5 15:16:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:34.683216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b5ad5-599a-4996-aa35-71e22844a3dd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:34.781915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b5ad5-599a-4996-aa35-71e22844a3dd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:34.815446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1ac40-627e-4dbb-a9d9-d3f67d440da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:34.816095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1ac40-627e-4dbb-a9d9-d3f67d440da3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:34.816380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1ac40-627e-4dbb-a9d9-d3f67d440da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:34.816786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1ac40-627e-4dbb-a9d9-d3f67d440da3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:34.881005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1ac40-627e-4dbb-a9d9-d3f67d440da3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:34.882509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1ac40-627e-4dbb-a9d9-d3f67d440da3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:34.980246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 597/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:16:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:16:34.986159 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f490ff-0651-4252-af85-8fcb9d263fb1 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:35.085691 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f490ff-0651-4252-af85-8fcb9d263fb1 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:35.119285 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247ba1f-a379-403e-bf44-ba344ba7d5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:35.120079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247ba1f-a379-403e-bf44-ba344ba7d5ca None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:35.120363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247ba1f-a379-403e-bf44-ba344ba7d5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:35.120641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247ba1f-a379-403e-bf44-ba344ba7d5ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:35.130467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247ba1f-a379-403e-bf44-ba344ba7d5ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:35.131991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247ba1f-a379-403e-bf44-ba344ba7d5ca None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-8247ba1f-a379-403e-bf44-ba344ba7d5ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:16:35.150429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:35.152020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:35.153165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:16:35.153165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:16:35.153165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:35.153165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:35.153165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 618/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:35.158227 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1ac40-627e-4dbb-a9d9-d3f67d440da3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:35.250653 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1ac40-627e-4dbb-a9d9-d3f67d440da3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:35.283592 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609820b0-ad17-4961-9240-7618c221650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:35.284247 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609820b0-ad17-4961-9240-7618c221650d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:35.284526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609820b0-ad17-4961-9240-7618c221650d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:35.284798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609820b0-ad17-4961-9240-7618c221650d None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:35.285500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609820b0-ad17-4961-9240-7618c221650d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:35.285802 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609820b0-ad17-4961-9240-7618c221650d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:35.287429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609820b0-ad17-4961-9240-7618c221650d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:35.298671 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 598/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:35.304386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247ba1f-a379-403e-bf44-ba344ba7d5ca None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:35.399851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247ba1f-a379-403e-bf44-ba344ba7d5ca None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:35.433103 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30f249-c194-46f5-8d3d-90d1c243a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:35.433891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30f249-c194-46f5-8d3d-90d1c243a4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:35.434170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30f249-c194-46f5-8d3d-90d1c243a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:35.434472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30f249-c194-46f5-8d3d-90d1c243a4b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:35.440807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30f249-c194-46f5-8d3d-90d1c243a4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:35.442217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30f249-c194-46f5-8d3d-90d1c243a4b1 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-9b30f249-c194-46f5-8d3d-90d1c243a4b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:16:35.456121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:35.457209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:35.458325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:16:35.458325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:16:35.458325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:16:35.458325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:16:35.458325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:16:35.458325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:16:35.458325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:16:35.458325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:35.458325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 619/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:35.463412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609820b0-ad17-4961-9240-7618c221650d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:35.558515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609820b0-ad17-4961-9240-7618c221650d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:35.590071 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544841d-2e75-4694-b9ee-07e663fd9899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:35.590745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544841d-2e75-4694-b9ee-07e663fd9899 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:35.591025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544841d-2e75-4694-b9ee-07e663fd9899 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:35.591297 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544841d-2e75-4694-b9ee-07e663fd9899 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:35.592072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544841d-2e75-4694-b9ee-07e663fd9899 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:35.592374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544841d-2e75-4694-b9ee-07e663fd9899 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:35.593799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544841d-2e75-4694-b9ee-07e663fd9899 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:35.610652 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 599/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:35.611834 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30f249-c194-46f5-8d3d-90d1c243a4b1 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:35.708522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30f249-c194-46f5-8d3d-90d1c243a4b1 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:35.740568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea259daf-754c-4827-baa9-a46d01eaf7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:35.755012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea259daf-754c-4827-baa9-a46d01eaf7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:35.755012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea259daf-754c-4827-baa9-a46d01eaf7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:35.755012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea259daf-754c-4827-baa9-a46d01eaf7f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:35.755012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea259daf-754c-4827-baa9-a46d01eaf7f0 None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=db978c3b147c4b259b623e8c64e7c13a) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:35.755012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea259daf-754c-4827-baa9-a46d01eaf7f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:35.755012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea259daf-754c-4827-baa9-a46d01eaf7f0 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:35.755559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 620/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:16:35 2022] GET /identity/v3/role_assignments?user.id=db978c3b147c4b259b623e8c64e7c13a&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:37.971689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eef06d-ec6b-40c2-a8f6-e6aa91457e4a None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:37.972348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eef06d-ec6b-40c2-a8f6-e6aa91457e4a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:37.972348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eef06d-ec6b-40c2-a8f6-e6aa91457e4a None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:37.973644 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 600/1220] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:16:37.978949 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dccec-ba3e-462b-beaa-d3474500cfbd None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:37.979403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dccec-ba3e-462b-beaa-d3474500cfbd None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:37.979509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dccec-ba3e-462b-beaa-d3474500cfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:37.996375 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-fb6dccec-ba3e-462b-beaa-d3474500cfbd None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:16:37.997564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-fb6dccec-ba3e-462b-beaa-d3474500cfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:16:38.060971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 621/1221] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:16:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:16:38.083953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eef06d-ec6b-40c2-a8f6-e6aa91457e4a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:38.184902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eef06d-ec6b-40c2-a8f6-e6aa91457e4a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:38.218904 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9a1e1-ecb0-4f27-b23b-8d67adfa6e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:38.219704 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9a1e1-ecb0-4f27-b23b-8d67adfa6e2d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:38.219988 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9a1e1-ecb0-4f27-b23b-8d67adfa6e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:38.220263 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9a1e1-ecb0-4f27-b23b-8d67adfa6e2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:38.230980 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9a1e1-ecb0-4f27-b23b-8d67adfa6e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-2ff9a1e1-ecb0-4f27-b23b-8d67adfa6e2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:16:38.238731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:38.239877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:38.240814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:38.240814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:38.240814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:38.240814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:38.240814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:16:38.240814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:16:38.240814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:16:38.240814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:16:38.240814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:16:38.240814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:16:38.240814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:16:38.240814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:38.240814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 601/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:16:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:38.246884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dccec-ba3e-462b-beaa-d3474500cfbd None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:38.341443 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dccec-ba3e-462b-beaa-d3474500cfbd None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:38.374390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256b3b9-afab-46d4-b591-d02345506f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:38.375134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256b3b9-afab-46d4-b591-d02345506f05 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:38.375413 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256b3b9-afab-46d4-b591-d02345506f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:38.375687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256b3b9-afab-46d4-b591-d02345506f05 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:38.376424 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256b3b9-afab-46d4-b591-d02345506f05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:38.376727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256b3b9-afab-46d4-b591-d02345506f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:38.378082 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256b3b9-afab-46d4-b591-d02345506f05 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:38.385803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 622/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:16:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:38.391773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9a1e1-ecb0-4f27-b23b-8d67adfa6e2d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:38.487360 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9a1e1-ecb0-4f27-b23b-8d67adfa6e2d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:38.519668 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4027e5-7b41-45d5-a46e-be3f6fd07666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:38.520457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4027e5-7b41-45d5-a46e-be3f6fd07666 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:38.520742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4027e5-7b41-45d5-a46e-be3f6fd07666 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:38.521020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4027e5-7b41-45d5-a46e-be3f6fd07666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:38.532086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4027e5-7b41-45d5-a46e-be3f6fd07666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:38.534354 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4027e5-7b41-45d5-a46e-be3f6fd07666 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-1d4027e5-7b41-45d5-a46e-be3f6fd07666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:16:38.551359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:38.552347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:38.553369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:16:38.553369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:16:38.553369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:38.553369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:38.553369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 602/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:38.558622 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256b3b9-afab-46d4-b591-d02345506f05 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:38.654843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256b3b9-afab-46d4-b591-d02345506f05 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:38.687008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6ec5f-b9bf-4206-a829-3880944dd675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:38.687664 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6ec5f-b9bf-4206-a829-3880944dd675 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:38.687948 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6ec5f-b9bf-4206-a829-3880944dd675 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:38.688227 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6ec5f-b9bf-4206-a829-3880944dd675 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:38.688939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6ec5f-b9bf-4206-a829-3880944dd675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:38.689245 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6ec5f-b9bf-4206-a829-3880944dd675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:38.690639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6ec5f-b9bf-4206-a829-3880944dd675 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:38.701855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 623/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:38.707463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4027e5-7b41-45d5-a46e-be3f6fd07666 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:38.806669 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4027e5-7b41-45d5-a46e-be3f6fd07666 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:38.840402 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc036d-fe6c-47fb-bf66-cb7bc7747f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:38.841205 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc036d-fe6c-47fb-bf66-cb7bc7747f60 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:38.841489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc036d-fe6c-47fb-bf66-cb7bc7747f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:38.841766 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc036d-fe6c-47fb-bf66-cb7bc7747f60 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:38.849133 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc036d-fe6c-47fb-bf66-cb7bc7747f60 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:38.850612 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc036d-fe6c-47fb-bf66-cb7bc7747f60 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-46dc036d-fe6c-47fb-bf66-cb7bc7747f60 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:16:38.864741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:38.865914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:38.867069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:38.867069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:38.867069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:16:38.867069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:16:38.867069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:16:38.867069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:16:38.867069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:16:38.867069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:16:38.867069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:16:38.867069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:38.867069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 603/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:38.871934 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6ec5f-b9bf-4206-a829-3880944dd675 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:38.974131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6ec5f-b9bf-4206-a829-3880944dd675 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:39.011030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527fc0c-823f-4589-a107-76f52916187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:39.011993 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527fc0c-823f-4589-a107-76f52916187f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:39.012320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527fc0c-823f-4589-a107-76f52916187f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:39.012593 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527fc0c-823f-4589-a107-76f52916187f None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:39.013426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527fc0c-823f-4589-a107-76f52916187f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:39.013730 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527fc0c-823f-4589-a107-76f52916187f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:39.015178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527fc0c-823f-4589-a107-76f52916187f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:39.032491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 624/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Thu May 5 15:16:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:39.038666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc036d-fe6c-47fb-bf66-cb7bc7747f60 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:39.136098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc036d-fe6c-47fb-bf66-cb7bc7747f60 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:39.169213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51e29d-1c23-41cd-8304-307e6eca3481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:39.170020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e29d-1c23-41cd-8304-307e6eca3481 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:39.170320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e29d-1c23-41cd-8304-307e6eca3481 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:39.170599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e29d-1c23-41cd-8304-307e6eca3481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:39.182091 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51e29d-1c23-41cd-8304-307e6eca3481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:39.183574 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51e29d-1c23-41cd-8304-307e6eca3481 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9f51e29d-1c23-41cd-8304-307e6eca3481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:16:39.201185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:39.202260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:39.207735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:16:39.207735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:16:39.207735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:39.207735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:39.207735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 604/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:39.208157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527fc0c-823f-4589-a107-76f52916187f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:39.303473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527fc0c-823f-4589-a107-76f52916187f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:39.339471 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9edf5-8841-4fce-83cd-e8e520830012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:39.340418 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9edf5-8841-4fce-83cd-e8e520830012 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:39.340751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9edf5-8841-4fce-83cd-e8e520830012 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:39.341024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9edf5-8841-4fce-83cd-e8e520830012 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:39.341736 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9edf5-8841-4fce-83cd-e8e520830012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:39.342042 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9edf5-8841-4fce-83cd-e8e520830012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:39.343829 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9edf5-8841-4fce-83cd-e8e520830012 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:39.355707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 625/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:39.361491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51e29d-1c23-41cd-8304-307e6eca3481 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:39.459502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51e29d-1c23-41cd-8304-307e6eca3481 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:39.491032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13796aef-4d46-44e1-ba55-ad918fed0a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:39.491819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796aef-4d46-44e1-ba55-ad918fed0a0c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:39.492102 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796aef-4d46-44e1-ba55-ad918fed0a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:39.492376 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796aef-4d46-44e1-ba55-ad918fed0a0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:39.499440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13796aef-4d46-44e1-ba55-ad918fed0a0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:39.500881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13796aef-4d46-44e1-ba55-ad918fed0a0c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-13796aef-4d46-44e1-ba55-ad918fed0a0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:16:39.516184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:39.517249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:39.518583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:16:39.518583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:16:39.518583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:16:39.518583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:16:39.518583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:16:39.518583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:16:39.518583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:16:39.518583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:39.518583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 605/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:39.523327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9edf5-8841-4fce-83cd-e8e520830012 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:39.619668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9edf5-8841-4fce-83cd-e8e520830012 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:39.651686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c29524-a481-4051-9b38-056fd64147fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:39.652338 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c29524-a481-4051-9b38-056fd64147fc None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:39.652656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c29524-a481-4051-9b38-056fd64147fc None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:39.652942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c29524-a481-4051-9b38-056fd64147fc None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:39.653726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c29524-a481-4051-9b38-056fd64147fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:39.654062 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c29524-a481-4051-9b38-056fd64147fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:39.655517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c29524-a481-4051-9b38-056fd64147fc None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:39.668374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 626/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:16:39.675021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13796aef-4d46-44e1-ba55-ad918fed0a0c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:39.771489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13796aef-4d46-44e1-ba55-ad918fed0a0c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:39.804027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b683e-6965-4334-857b-90ac2b8d8e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:39.804896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b683e-6965-4334-857b-90ac2b8d8e16 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:39.805175 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b683e-6965-4334-857b-90ac2b8d8e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:39.805447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b683e-6965-4334-857b-90ac2b8d8e16 None admin] PATH_INFO: `/v3/projects/587280a3c4c54bffb4d769e406af3689/users/db978c3b147c4b259b623e8c64e7c13a/roles/139847713c8a4df68a3d20babdbb75d5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:39.819696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b683e-6965-4334-857b-90ac2b8d8e16 None admin] RBAC: Authorizing `identity:create_grant(project_id=587280a3c4c54bffb4d769e406af3689, user_id=db978c3b147c4b259b623e8c64e7c13a, role_id=139847713c8a4df68a3d20babdbb75d5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:39.821116 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b683e-6965-4334-857b-90ac2b8d8e16 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:39.898580 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 606/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:16:39 2022] PUT /identity/v3/projects/587280a3c4c54bffb4d769e406af3689/users/db978c3b147c4b259b623e8c64e7c13a/roles/139847713c8a4df68a3d20babdbb75d5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:16:42.122960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491aab5-43ee-4311-a1ae-58ebcb831215 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:42.123474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491aab5-43ee-4311-a1ae-58ebcb831215 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:42.123474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491aab5-43ee-4311-a1ae-58ebcb831215 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:42.124778 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 627/1233] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:16:42.129973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae99ae-c3ae-4cf4-ba2c-8f498d5a8392 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:42.130383 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae99ae-c3ae-4cf4-ba2c-8f498d5a8392 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:42.130568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae99ae-c3ae-4cf4-ba2c-8f498d5a8392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:42.147703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5cae99ae-c3ae-4cf4-ba2c-8f498d5a8392 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:16:42.148889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5cae99ae-c3ae-4cf4-ba2c-8f498d5a8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:16:42.216146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 607/1234] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:16:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:16:42.239420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491aab5-43ee-4311-a1ae-58ebcb831215 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:42.342928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491aab5-43ee-4311-a1ae-58ebcb831215 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:42.377880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a17e-4f57-4353-ab5b-51afdeec4300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:42.378631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a17e-4f57-4353-ab5b-51afdeec4300 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:42.378909 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a17e-4f57-4353-ab5b-51afdeec4300 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:42.379186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a17e-4f57-4353-ab5b-51afdeec4300 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:42.389641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4a17e-4f57-4353-ab5b-51afdeec4300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-aea4a17e-4f57-4353-ab5b-51afdeec4300 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:16:42.397310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:42.398585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:42.399625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:42.399625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:42.399625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:42.399625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:42.399625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:16:42.399625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:16:42.399625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:16:42.399625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:16:42.399625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:16:42.399625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:16:42.399625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:16:42.399625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:42.399625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 628/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 5 15:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:16:42.404858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae99ae-c3ae-4cf4-ba2c-8f498d5a8392 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:42.499358 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae99ae-c3ae-4cf4-ba2c-8f498d5a8392 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:42.532052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f45fcf-afff-40e2-b439-36d6b1dd53a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:42.532723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45fcf-afff-40e2-b439-36d6b1dd53a1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:42.533009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45fcf-afff-40e2-b439-36d6b1dd53a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:42.533284 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45fcf-afff-40e2-b439-36d6b1dd53a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:42.534021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f45fcf-afff-40e2-b439-36d6b1dd53a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:42.534353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f45fcf-afff-40e2-b439-36d6b1dd53a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:42.535735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f45fcf-afff-40e2-b439-36d6b1dd53a1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:42.544463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 608/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 5 15:16:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:42.550157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a17e-4f57-4353-ab5b-51afdeec4300 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:42.645297 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a17e-4f57-4353-ab5b-51afdeec4300 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:42.678108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d7b52-1923-4b7b-bf26-43cd8d2fae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:42.678932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d7b52-1923-4b7b-bf26-43cd8d2fae3a None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:42.679220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d7b52-1923-4b7b-bf26-43cd8d2fae3a None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:42.679499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d7b52-1923-4b7b-bf26-43cd8d2fae3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:42.690218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d7b52-1923-4b7b-bf26-43cd8d2fae3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:42.691689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d7b52-1923-4b7b-bf26-43cd8d2fae3a None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-fa4d7b52-1923-4b7b-bf26-43cd8d2fae3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:16:42.708277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:42.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:42.711410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:16:42.711410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:16:42.711410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:42.711410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:42.711410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 629/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:42.715457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f45fcf-afff-40e2-b439-36d6b1dd53a1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:42.813550 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f45fcf-afff-40e2-b439-36d6b1dd53a1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:42.846860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aabb5-6fd9-4506-9b53-58a959d5e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:42.847524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aabb5-6fd9-4506-9b53-58a959d5e527 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:42.847799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aabb5-6fd9-4506-9b53-58a959d5e527 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:42.848071 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aabb5-6fd9-4506-9b53-58a959d5e527 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:42.848774 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183aabb5-6fd9-4506-9b53-58a959d5e527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:42.849077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183aabb5-6fd9-4506-9b53-58a959d5e527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:42.850462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183aabb5-6fd9-4506-9b53-58a959d5e527 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:42.862296 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 609/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:42.867985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d7b52-1923-4b7b-bf26-43cd8d2fae3a None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:42.968968 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d7b52-1923-4b7b-bf26-43cd8d2fae3a None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:43.000732 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c54747-d5dc-4a9c-8615-637c16bcdc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:43.001519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54747-d5dc-4a9c-8615-637c16bcdc16 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:43.001800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54747-d5dc-4a9c-8615-637c16bcdc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:43.002070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54747-d5dc-4a9c-8615-637c16bcdc16 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:43.009324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c54747-d5dc-4a9c-8615-637c16bcdc16 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:43.011397 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c54747-d5dc-4a9c-8615-637c16bcdc16 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-59c54747-d5dc-4a9c-8615-637c16bcdc16 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:16:43.025360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:43.026599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:43.027751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:43.027751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:43.027751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:16:43.027751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:16:43.027751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:16:43.027751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:16:43.027751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:16:43.027751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:16:43.027751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:16:43.027751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:43.027751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 630/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:43.032600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aabb5-6fd9-4506-9b53-58a959d5e527 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:43.129445 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aabb5-6fd9-4506-9b53-58a959d5e527 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:43.161938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4f019-d235-48ab-920a-f3d44aaa3d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:43.162890 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4f019-d235-48ab-920a-f3d44aaa3d08 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:43.163172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4f019-d235-48ab-920a-f3d44aaa3d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:43.163446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4f019-d235-48ab-920a-f3d44aaa3d08 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:43.164275 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4f019-d235-48ab-920a-f3d44aaa3d08 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:43.164584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4f019-d235-48ab-920a-f3d44aaa3d08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:43.166616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4f019-d235-48ab-920a-f3d44aaa3d08 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:43.183389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 610/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Thu May 5 15:16:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:43.189294 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c54747-d5dc-4a9c-8615-637c16bcdc16 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:43.284550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c54747-d5dc-4a9c-8615-637c16bcdc16 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:43.317374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee1f7b-ace5-44e3-b8bc-4bbaa7913b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:43.318023 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee1f7b-ace5-44e3-b8bc-4bbaa7913b44 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:43.318332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee1f7b-ace5-44e3-b8bc-4bbaa7913b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:43.318611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee1f7b-ace5-44e3-b8bc-4bbaa7913b44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:43.387087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee1f7b-ace5-44e3-b8bc-4bbaa7913b44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:43.388522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee1f7b-ace5-44e3-b8bc-4bbaa7913b44 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:43.483996 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 631/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:16:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:16:43.489847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4f019-d235-48ab-920a-f3d44aaa3d08 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:43.592273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4f019-d235-48ab-920a-f3d44aaa3d08 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:43.624438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ec98f-08e7-4a9e-b58d-31999d2d639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:43.625242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ec98f-08e7-4a9e-b58d-31999d2d639f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:43.630384 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ec98f-08e7-4a9e-b58d-31999d2d639f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:43.630384 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ec98f-08e7-4a9e-b58d-31999d2d639f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:43.638175 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ec98f-08e7-4a9e-b58d-31999d2d639f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:43.639648 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ec98f-08e7-4a9e-b58d-31999d2d639f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-bf5ec98f-08e7-4a9e-b58d-31999d2d639f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:16:43.657431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:43.658537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:43.659784 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:16:43.659784 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:16:43.659784 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:43.659784 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:43.659784 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 611/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:43.664636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee1f7b-ace5-44e3-b8bc-4bbaa7913b44 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:43.759210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee1f7b-ace5-44e3-b8bc-4bbaa7913b44 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:43.792324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc706c8-1304-471f-abb9-b9b96f22dd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:43.793954 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc706c8-1304-471f-abb9-b9b96f22dd2c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:43.793954 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc706c8-1304-471f-abb9-b9b96f22dd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:43.793954 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc706c8-1304-471f-abb9-b9b96f22dd2c None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:43.794245 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc706c8-1304-471f-abb9-b9b96f22dd2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:43.794563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc706c8-1304-471f-abb9-b9b96f22dd2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:43.795921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc706c8-1304-471f-abb9-b9b96f22dd2c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:43.807237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 632/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:43.812969 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ec98f-08e7-4a9e-b58d-31999d2d639f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:43.909206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ec98f-08e7-4a9e-b58d-31999d2d639f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:43.942384 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c979b89-cda4-48d1-a81c-c31c3e744b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:43.943172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979b89-cda4-48d1-a81c-c31c3e744b85 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:43.943459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979b89-cda4-48d1-a81c-c31c3e744b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:43.943734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979b89-cda4-48d1-a81c-c31c3e744b85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:43.950841 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c979b89-cda4-48d1-a81c-c31c3e744b85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:43.952280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c979b89-cda4-48d1-a81c-c31c3e744b85 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5c979b89-cda4-48d1-a81c-c31c3e744b85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:16:43.965822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:43.967095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:43.968085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:16:43.968085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:16:43.968085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:16:43.968085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:16:43.968085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:16:43.968085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:16:43.968085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:16:43.968085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:43.968085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 612/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:43.973226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc706c8-1304-471f-abb9-b9b96f22dd2c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:44.069279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc706c8-1304-471f-abb9-b9b96f22dd2c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:44.101442 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa997d84-d302-4496-9151-45d1decc8a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:44.102098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa997d84-d302-4496-9151-45d1decc8a7e None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:44.102414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa997d84-d302-4496-9151-45d1decc8a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:44.102696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa997d84-d302-4496-9151-45d1decc8a7e None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:44.104057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa997d84-d302-4496-9151-45d1decc8a7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:44.104367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa997d84-d302-4496-9151-45d1decc8a7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:44.105795 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa997d84-d302-4496-9151-45d1decc8a7e None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:44.117853 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 633/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:16:44.124790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c979b89-cda4-48d1-a81c-c31c3e744b85 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:44.224143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c979b89-cda4-48d1-a81c-c31c3e744b85 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:44.258416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab28d7a-6a87-481a-8aac-db2c60b7c226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:44.259072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab28d7a-6a87-481a-8aac-db2c60b7c226 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:44.259689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab28d7a-6a87-481a-8aac-db2c60b7c226 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:44.259790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab28d7a-6a87-481a-8aac-db2c60b7c226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:44.260601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab28d7a-6a87-481a-8aac-db2c60b7c226 None admin] RBAC: Adding query filter params (role.id=139847713c8a4df68a3d20babdbb75d5, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=db978c3b147c4b259b623e8c64e7c13a) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:44.260890 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab28d7a-6a87-481a-8aac-db2c60b7c226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:44.262408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab28d7a-6a87-481a-8aac-db2c60b7c226 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:44.268512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 613/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:16:44 2022] GET /identity/v3/role_assignments?user.id=db978c3b147c4b259b623e8c64e7c13a&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=139847713c8a4df68a3d20babdbb75d5 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:46.540008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d5f96-2beb-493e-8c54-8f29d0443d76 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:46.541080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d5f96-2beb-493e-8c54-8f29d0443d76 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:46.541080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d5f96-2beb-493e-8c54-8f29d0443d76 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:46.543107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 634/1247] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:16:46.548424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594638d-8589-4db7-8e4c-7e5a000c2b47 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:46.548918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594638d-8589-4db7-8e4c-7e5a000c2b47 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:46.549027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594638d-8589-4db7-8e4c-7e5a000c2b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:46.565902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1594638d-8589-4db7-8e4c-7e5a000c2b47 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:16:46.567115 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1594638d-8589-4db7-8e4c-7e5a000c2b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:16:46.631756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 614/1248] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:16:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:16:46.656001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d5f96-2beb-493e-8c54-8f29d0443d76 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:46.756929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d5f96-2beb-493e-8c54-8f29d0443d76 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:46.790413 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e2cd8-5c13-4dee-aa4a-e0ca3469c94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:46.791777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e2cd8-5c13-4dee-aa4a-e0ca3469c94f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:46.792056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e2cd8-5c13-4dee-aa4a-e0ca3469c94f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:46.792327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e2cd8-5c13-4dee-aa4a-e0ca3469c94f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:46.802104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e2cd8-5c13-4dee-aa4a-e0ca3469c94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-454e2cd8-5c13-4dee-aa4a-e0ca3469c94f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:16:46.809808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:46.811153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:46.812320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:46.812320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:46.812320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:46.812320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:46.812320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:16:46.812320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:16:46.812320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:16:46.812320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:16:46.812320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:16:46.812320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:16:46.812320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:16:46.812320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:46.812320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 635/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:16:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:46.817079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594638d-8589-4db7-8e4c-7e5a000c2b47 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:46.913546 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594638d-8589-4db7-8e4c-7e5a000c2b47 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:46.949110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd5689-2389-4f34-ad5b-b9c9e1e1d599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:46.949842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5689-2389-4f34-ad5b-b9c9e1e1d599 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:46.950168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5689-2389-4f34-ad5b-b9c9e1e1d599 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:46.950516 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5689-2389-4f34-ad5b-b9c9e1e1d599 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:46.951251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd5689-2389-4f34-ad5b-b9c9e1e1d599 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:46.951606 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd5689-2389-4f34-ad5b-b9c9e1e1d599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:46.953064 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd5689-2389-4f34-ad5b-b9c9e1e1d599 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:46.961219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 615/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:16:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:46.967948 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e2cd8-5c13-4dee-aa4a-e0ca3469c94f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:47.067658 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e2cd8-5c13-4dee-aa4a-e0ca3469c94f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:47.100476 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152aaa6-c5c4-4384-98d2-cd0bcbcf26b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:47.101274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152aaa6-c5c4-4384-98d2-cd0bcbcf26b7 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:47.101556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152aaa6-c5c4-4384-98d2-cd0bcbcf26b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:47.101830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152aaa6-c5c4-4384-98d2-cd0bcbcf26b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:47.112767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152aaa6-c5c4-4384-98d2-cd0bcbcf26b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:47.114198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152aaa6-c5c4-4384-98d2-cd0bcbcf26b7 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-e152aaa6-c5c4-4384-98d2-cd0bcbcf26b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:16:47.131741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:47.132807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:47.133787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:16:47.133787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:16:47.133787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:47.133787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:47.133787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 636/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:47.139215 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd5689-2389-4f34-ad5b-b9c9e1e1d599 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:47.234343 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd5689-2389-4f34-ad5b-b9c9e1e1d599 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:47.266505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0947349-7b90-4138-94b8-f58aed90daa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:47.267169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0947349-7b90-4138-94b8-f58aed90daa8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:47.267451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0947349-7b90-4138-94b8-f58aed90daa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:47.267726 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0947349-7b90-4138-94b8-f58aed90daa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:47.268441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0947349-7b90-4138-94b8-f58aed90daa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:47.268747 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0947349-7b90-4138-94b8-f58aed90daa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:47.270101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0947349-7b90-4138-94b8-f58aed90daa8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:47.281758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 616/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:16:47.287665 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152aaa6-c5c4-4384-98d2-cd0bcbcf26b7 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:47.382209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152aaa6-c5c4-4384-98d2-cd0bcbcf26b7 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:47.413780 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c6bd9-e780-442f-8e8a-2dafeb732971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:47.414604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c6bd9-e780-442f-8e8a-2dafeb732971 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:47.414885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c6bd9-e780-442f-8e8a-2dafeb732971 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:47.418920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c6bd9-e780-442f-8e8a-2dafeb732971 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:47.423022 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c6bd9-e780-442f-8e8a-2dafeb732971 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:47.424438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c6bd9-e780-442f-8e8a-2dafeb732971 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-c13c6bd9-e780-442f-8e8a-2dafeb732971 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:16:47.438817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:47.440005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:47.441138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:47.441138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:47.441138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:16:47.441138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:16:47.441138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:16:47.441138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:16:47.441138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:16:47.441138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:16:47.441138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:16:47.441138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:47.441138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 637/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:47.445853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0947349-7b90-4138-94b8-f58aed90daa8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:47.544097 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0947349-7b90-4138-94b8-f58aed90daa8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:47.579558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bb545-9743-4f00-be68-487b68656eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:47.580233 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb545-9743-4f00-be68-487b68656eca None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:47.580519 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb545-9743-4f00-be68-487b68656eca None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:47.580801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb545-9743-4f00-be68-487b68656eca None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:47.581634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bb545-9743-4f00-be68-487b68656eca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:47.581944 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bb545-9743-4f00-be68-487b68656eca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:47.583418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bb545-9743-4f00-be68-487b68656eca None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:47.600245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 617/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Thu May 5 15:16:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:47.606203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c6bd9-e780-442f-8e8a-2dafeb732971 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:47.703903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c6bd9-e780-442f-8e8a-2dafeb732971 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:47.736885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df9a44-3774-4bad-9b4a-a8fca7dadb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:47.737532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df9a44-3774-4bad-9b4a-a8fca7dadb60 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:47.737815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df9a44-3774-4bad-9b4a-a8fca7dadb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:47.738093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df9a44-3774-4bad-9b4a-a8fca7dadb60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:47.806011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df9a44-3774-4bad-9b4a-a8fca7dadb60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:47.807681 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df9a44-3774-4bad-9b4a-a8fca7dadb60 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:47.903759 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 638/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:16:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:16:47.909711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bb545-9743-4f00-be68-487b68656eca None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:48.008952 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bb545-9743-4f00-be68-487b68656eca None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:48.044906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb70b7-f7c6-4b84-bc76-2f05832b2ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:48.045736 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb70b7-f7c6-4b84-bc76-2f05832b2ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:48.046054 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb70b7-f7c6-4b84-bc76-2f05832b2ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:48.046409 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb70b7-f7c6-4b84-bc76-2f05832b2ae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:48.056962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb70b7-f7c6-4b84-bc76-2f05832b2ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:48.058412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb70b7-f7c6-4b84-bc76-2f05832b2ae4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-37cb70b7-f7c6-4b84-bc76-2f05832b2ae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:16:48.077001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:48.077900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:48.078898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:16:48.078898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:16:48.078898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:48.078898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:48.078898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 618/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:48.084158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df9a44-3774-4bad-9b4a-a8fca7dadb60 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:48.180559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df9a44-3774-4bad-9b4a-a8fca7dadb60 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:48.214261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b0a94-aa10-4f11-8d36-a6a9895c5f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:48.214953 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b0a94-aa10-4f11-8d36-a6a9895c5f37 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:48.215239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b0a94-aa10-4f11-8d36-a6a9895c5f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:48.215515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b0a94-aa10-4f11-8d36-a6a9895c5f37 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:48.216232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b0a94-aa10-4f11-8d36-a6a9895c5f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:48.216534 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b0a94-aa10-4f11-8d36-a6a9895c5f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:48.217906 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b0a94-aa10-4f11-8d36-a6a9895c5f37 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:48.229353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 639/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:48.235067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb70b7-f7c6-4b84-bc76-2f05832b2ae4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:48.333332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb70b7-f7c6-4b84-bc76-2f05832b2ae4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:48.365568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2f190-1373-4117-ad93-56cc664c8677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:48.366382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2f190-1373-4117-ad93-56cc664c8677 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:48.366699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2f190-1373-4117-ad93-56cc664c8677 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:48.366997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2f190-1373-4117-ad93-56cc664c8677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:48.373953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2f190-1373-4117-ad93-56cc664c8677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:48.375468 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2f190-1373-4117-ad93-56cc664c8677 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-fbe2f190-1373-4117-ad93-56cc664c8677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:16:48.390095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:48.391151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:48.392264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:16:48.392264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:16:48.392264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:16:48.392264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:16:48.392264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:16:48.392264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:16:48.392264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:16:48.392264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:48.392264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 619/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:48.397473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b0a94-aa10-4f11-8d36-a6a9895c5f37 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:48.493244 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b0a94-aa10-4f11-8d36-a6a9895c5f37 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:48.526004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ca964-5b98-4aac-863f-396f9a7eeb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:48.526679 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ca964-5b98-4aac-863f-396f9a7eeb6c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:48.526961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ca964-5b98-4aac-863f-396f9a7eeb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:48.527232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ca964-5b98-4aac-863f-396f9a7eeb6c None admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:48.528011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ca964-5b98-4aac-863f-396f9a7eeb6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:48.528319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ca964-5b98-4aac-863f-396f9a7eeb6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:48.529725 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ca964-5b98-4aac-863f-396f9a7eeb6c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:48.541764 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 640/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:48.547923 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2f190-1373-4117-ad93-56cc664c8677 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:48.646799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2f190-1373-4117-ad93-56cc664c8677 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:48.681897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a14fec-9800-46ec-b8e4-f18d2031ce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:48.682650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a14fec-9800-46ec-b8e4-f18d2031ce9f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:48.682953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a14fec-9800-46ec-b8e4-f18d2031ce9f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:48.683251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a14fec-9800-46ec-b8e4-f18d2031ce9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:48.684127 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a14fec-9800-46ec-b8e4-f18d2031ce9f None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=db978c3b147c4b259b623e8c64e7c13a) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:48.684456 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a14fec-9800-46ec-b8e4-f18d2031ce9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:48.686004 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a14fec-9800-46ec-b8e4-f18d2031ce9f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:48.691611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 620/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:16:48 2022] GET /identity/v3/role_assignments?user.id=db978c3b147c4b259b623e8c64e7c13a&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:50.928046 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71cf92-2632-4467-af99-5ef76ecee1a1 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:50.928642 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71cf92-2632-4467-af99-5ef76ecee1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:50.928642 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71cf92-2632-4467-af99-5ef76ecee1a1 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:50.929982 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 641/1261] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:16:50.935478 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f8555-91fb-4a98-ab75-680a3757dc07 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:50.935935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f8555-91fb-4a98-ab75-680a3757dc07 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:50.936039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f8555-91fb-4a98-ab75-680a3757dc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:50.953105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-393f8555-91fb-4a98-ab75-680a3757dc07 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:16:50.954272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-393f8555-91fb-4a98-ab75-680a3757dc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:16:51.019579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 621/1262] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:16:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:16:51.042686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71cf92-2632-4467-af99-5ef76ecee1a1 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:51.144363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71cf92-2632-4467-af99-5ef76ecee1a1 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:51.177519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e1c8f-8771-4b2c-ba11-b6b13f17835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:51.178329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e1c8f-8771-4b2c-ba11-b6b13f17835f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:51.178618 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e1c8f-8771-4b2c-ba11-b6b13f17835f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:51.178893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e1c8f-8771-4b2c-ba11-b6b13f17835f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:51.189174 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e1c8f-8771-4b2c-ba11-b6b13f17835f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-4a7e1c8f-8771-4b2c-ba11-b6b13f17835f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:16:51.197566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:51.198824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:51.199928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:51.199928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:51.199928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:51.199928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:51.199928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:16:51.199928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:16:51.199928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:16:51.199928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:16:51.199928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:16:51.199928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:16:51.199928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:16:51.199928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:51.199928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 642/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:16:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:51.205084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f8555-91fb-4a98-ab75-680a3757dc07 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:51.299783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f8555-91fb-4a98-ab75-680a3757dc07 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:51.333468 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86624c-af76-4fbc-9b23-91ac0f04fe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:51.334132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86624c-af76-4fbc-9b23-91ac0f04fe06 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:51.334441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86624c-af76-4fbc-9b23-91ac0f04fe06 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:51.334719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86624c-af76-4fbc-9b23-91ac0f04fe06 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:51.335450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86624c-af76-4fbc-9b23-91ac0f04fe06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:51.335754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86624c-af76-4fbc-9b23-91ac0f04fe06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:51.337113 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86624c-af76-4fbc-9b23-91ac0f04fe06 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:51.345327 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 622/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:16:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:51.351485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e1c8f-8771-4b2c-ba11-b6b13f17835f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:51.452268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e1c8f-8771-4b2c-ba11-b6b13f17835f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:51.487388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa058a-bbbe-43a2-9d2e-afe0c52a253c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:51.488184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa058a-bbbe-43a2-9d2e-afe0c52a253c None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:51.488468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa058a-bbbe-43a2-9d2e-afe0c52a253c None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:51.488745 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa058a-bbbe-43a2-9d2e-afe0c52a253c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:51.498948 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa058a-bbbe-43a2-9d2e-afe0c52a253c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:51.500419 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa058a-bbbe-43a2-9d2e-afe0c52a253c None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-2ffa058a-bbbe-43a2-9d2e-afe0c52a253c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:16:51.517233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:51.518408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:51.519591 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:16:51.519591 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:16:51.519591 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:51.519591 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:51.519591 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 643/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:51.524204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86624c-af76-4fbc-9b23-91ac0f04fe06 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:51.623067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86624c-af76-4fbc-9b23-91ac0f04fe06 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:51.656285 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc263769-d3c0-41d9-8331-1503dcca75af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:51.657011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263769-d3c0-41d9-8331-1503dcca75af None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:51.657286 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263769-d3c0-41d9-8331-1503dcca75af None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:51.657562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263769-d3c0-41d9-8331-1503dcca75af None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:51.658265 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc263769-d3c0-41d9-8331-1503dcca75af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:51.664743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc263769-d3c0-41d9-8331-1503dcca75af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:51.664743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc263769-d3c0-41d9-8331-1503dcca75af None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:51.671769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 623/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:51.677571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa058a-bbbe-43a2-9d2e-afe0c52a253c None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:51.777941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa058a-bbbe-43a2-9d2e-afe0c52a253c None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:51.823180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8d380-43b3-4488-b5f1-807245149801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:51.823977 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8d380-43b3-4488-b5f1-807245149801 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:51.824264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8d380-43b3-4488-b5f1-807245149801 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:51.824535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8d380-43b3-4488-b5f1-807245149801 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:51.835852 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8d380-43b3-4488-b5f1-807245149801 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:51.837392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8d380-43b3-4488-b5f1-807245149801 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-58e8d380-43b3-4488-b5f1-807245149801 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:16:51.852171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:51.853899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:51.855176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:51.855176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:51.855176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:16:51.855176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:16:51.855176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:16:51.855176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:16:51.855176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:16:51.855176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:16:51.855176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:16:51.855176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:51.855176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 644/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:16:51.859364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc263769-d3c0-41d9-8331-1503dcca75af None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:51.955891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc263769-d3c0-41d9-8331-1503dcca75af None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:51.988054 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40223513-da6a-405e-aab2-acb48d03b32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:51.988719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40223513-da6a-405e-aab2-acb48d03b32d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:51.989006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40223513-da6a-405e-aab2-acb48d03b32d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:51.989281 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40223513-da6a-405e-aab2-acb48d03b32d None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:51.990108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40223513-da6a-405e-aab2-acb48d03b32d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:51.990446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40223513-da6a-405e-aab2-acb48d03b32d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:51.995320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40223513-da6a-405e-aab2-acb48d03b32d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:52.009172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 624/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Thu May 5 15:16:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:52.015411 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8d380-43b3-4488-b5f1-807245149801 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:52.122128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8d380-43b3-4488-b5f1-807245149801 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:52.161167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b63bd-950d-440a-8539-741525f6d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:52.161974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b63bd-950d-440a-8539-741525f6d20f None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:52.162543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b63bd-950d-440a-8539-741525f6d20f None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:52.162823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b63bd-950d-440a-8539-741525f6d20f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:52.174303 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b63bd-950d-440a-8539-741525f6d20f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:52.175837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b63bd-950d-440a-8539-741525f6d20f None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-1f6b63bd-950d-440a-8539-741525f6d20f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:16:52.193292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:52.194480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:52.195553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:16:52.195553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:16:52.195553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:52.195553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:52.195553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 645/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:52.200837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40223513-da6a-405e-aab2-acb48d03b32d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:52.299524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40223513-da6a-405e-aab2-acb48d03b32d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:52.333259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaf7c5-76c2-4992-bb88-2098cdfd1353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:52.334029 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaf7c5-76c2-4992-bb88-2098cdfd1353 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:52.334389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaf7c5-76c2-4992-bb88-2098cdfd1353 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:52.334655 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaf7c5-76c2-4992-bb88-2098cdfd1353 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:52.335369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aaf7c5-76c2-4992-bb88-2098cdfd1353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:52.335676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aaf7c5-76c2-4992-bb88-2098cdfd1353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:52.337822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aaf7c5-76c2-4992-bb88-2098cdfd1353 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:52.349516 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 625/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:52.355358 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b63bd-950d-440a-8539-741525f6d20f None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:52.461132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b63bd-950d-440a-8539-741525f6d20f None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:52.493790 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978390f-8ec1-42d6-bd05-07e9eff76ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:52.496906 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978390f-8ec1-42d6-bd05-07e9eff76ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:52.496906 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978390f-8ec1-42d6-bd05-07e9eff76ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:52.496906 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978390f-8ec1-42d6-bd05-07e9eff76ac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:52.501984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978390f-8ec1-42d6-bd05-07e9eff76ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:52.503506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978390f-8ec1-42d6-bd05-07e9eff76ac2 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-8978390f-8ec1-42d6-bd05-07e9eff76ac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:16:52.518132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:52.520974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:52.522087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:16:52.522087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:16:52.522087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:16:52.522087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:16:52.522087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:16:52.522087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:16:52.522087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:16:52.522087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:52.522087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 646/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:16:52.525428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaf7c5-76c2-4992-bb88-2098cdfd1353 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:52.624024 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaf7c5-76c2-4992-bb88-2098cdfd1353 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:52.656460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f11615-2b6b-4495-b37c-fec13fe43601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:52.657116 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11615-2b6b-4495-b37c-fec13fe43601 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:52.657395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11615-2b6b-4495-b37c-fec13fe43601 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:52.657669 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11615-2b6b-4495-b37c-fec13fe43601 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:52.658471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f11615-2b6b-4495-b37c-fec13fe43601 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:52.658777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f11615-2b6b-4495-b37c-fec13fe43601 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:52.660185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f11615-2b6b-4495-b37c-fec13fe43601 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:52.672364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 626/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:52.678423 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978390f-8ec1-42d6-bd05-07e9eff76ac2 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:52.786316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978390f-8ec1-42d6-bd05-07e9eff76ac2 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:52.819463 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3fb3-a217-43fe-bd24-8353411d5ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:52.820346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3fb3-a217-43fe-bd24-8353411d5ded None admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:52.820629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3fb3-a217-43fe-bd24-8353411d5ded None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:52.820903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3fb3-a217-43fe-bd24-8353411d5ded None admin] PATH_INFO: `/v3/projects/587280a3c4c54bffb4d769e406af3689/users/db978c3b147c4b259b623e8c64e7c13a/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:52.823662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee3fb3-a217-43fe-bd24-8353411d5ded None admin] RBAC: Authorizing `identity:create_grant(project_id=587280a3c4c54bffb4d769e406af3689, user_id=db978c3b147c4b259b623e8c64e7c13a, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:52.825079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee3fb3-a217-43fe-bd24-8353411d5ded None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:52.909811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 647/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 5 15:16:52 2022] PUT /identity/v3/projects/587280a3c4c54bffb4d769e406af3689/users/db978c3b147c4b259b623e8c64e7c13a/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:16:55.149015 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecdc02-630d-40bb-bfe8-4a557cd53f97 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:55.149565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecdc02-630d-40bb-bfe8-4a557cd53f97 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:55.149658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecdc02-630d-40bb-bfe8-4a557cd53f97 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:55.151659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 627/1274] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:16:55.156834 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca97467-1086-46f5-a81c-0c770aaafe46 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:55.157274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca97467-1086-46f5-a81c-0c770aaafe46 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:55.157432 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca97467-1086-46f5-a81c-0c770aaafe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:55.175162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-dca97467-1086-46f5-a81c-0c770aaafe46 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:16:55.176382 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-dca97467-1086-46f5-a81c-0c770aaafe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:16:55.244332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 648/1275] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:16:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:16:55.268443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecdc02-630d-40bb-bfe8-4a557cd53f97 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:55.371378 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecdc02-630d-40bb-bfe8-4a557cd53f97 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:55.405991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942c8a0-5812-44f1-9fdc-e0bd2c16ad5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:55.406753 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942c8a0-5812-44f1-9fdc-e0bd2c16ad5e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:55.407100 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942c8a0-5812-44f1-9fdc-e0bd2c16ad5e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:55.407450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942c8a0-5812-44f1-9fdc-e0bd2c16ad5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:55.417791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942c8a0-5812-44f1-9fdc-e0bd2c16ad5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-2942c8a0-5812-44f1-9fdc-e0bd2c16ad5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:16:55.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:55.426817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:55.427811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:55.427811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:55.427811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:55.427811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:55.427811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:16:55.427811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:16:55.427811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:16:55.427811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:16:55.427811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:16:55.427811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:16:55.427811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:16:55.427811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:55.427811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 628/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 5 15:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:55.433213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca97467-1086-46f5-a81c-0c770aaafe46 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:55.529272 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca97467-1086-46f5-a81c-0c770aaafe46 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:55.562117 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82678834-749c-4d25-8637-66720e7f68a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:55.562813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82678834-749c-4d25-8637-66720e7f68a3 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:55.563097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82678834-749c-4d25-8637-66720e7f68a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:55.563371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82678834-749c-4d25-8637-66720e7f68a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:55.564118 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82678834-749c-4d25-8637-66720e7f68a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:55.564422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82678834-749c-4d25-8637-66720e7f68a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:55.565788 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82678834-749c-4d25-8637-66720e7f68a3 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:55.574413 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 649/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 5 15:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:55.580157 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942c8a0-5812-44f1-9fdc-e0bd2c16ad5e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:55.679002 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942c8a0-5812-44f1-9fdc-e0bd2c16ad5e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:55.711111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64687649-3263-4dd4-b9ad-52f54a049077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:55.711902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64687649-3263-4dd4-b9ad-52f54a049077 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:55.712186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64687649-3263-4dd4-b9ad-52f54a049077 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:55.712505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64687649-3263-4dd4-b9ad-52f54a049077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:55.722627 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64687649-3263-4dd4-b9ad-52f54a049077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:55.724074 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64687649-3263-4dd4-b9ad-52f54a049077 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-64687649-3263-4dd4-b9ad-52f54a049077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:16:55.740345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:55.741547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:55.744493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:16:55.744493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:16:55.744493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:55.744493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:55.744493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 629/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:16:55.747909 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82678834-749c-4d25-8637-66720e7f68a3 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:55.845232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82678834-749c-4d25-8637-66720e7f68a3 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:55.878550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a8d15-8e60-4258-a4bb-9efa0bae9244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:55.879214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a8d15-8e60-4258-a4bb-9efa0bae9244 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:55.879492 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a8d15-8e60-4258-a4bb-9efa0bae9244 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:55.879763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a8d15-8e60-4258-a4bb-9efa0bae9244 None admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:55.880481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a8d15-8e60-4258-a4bb-9efa0bae9244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:55.880782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a8d15-8e60-4258-a4bb-9efa0bae9244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:55.882130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a8d15-8e60-4258-a4bb-9efa0bae9244 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:55.894034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 650/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:55.899781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64687649-3263-4dd4-b9ad-52f54a049077 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:56.003055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64687649-3263-4dd4-b9ad-52f54a049077 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:56.035638 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedd6c2-b6fa-424f-81f3-d0ab127830bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:56.036435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedd6c2-b6fa-424f-81f3-d0ab127830bd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:56.036718 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedd6c2-b6fa-424f-81f3-d0ab127830bd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:56.036998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedd6c2-b6fa-424f-81f3-d0ab127830bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:56.045463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedd6c2-b6fa-424f-81f3-d0ab127830bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:56.046944 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedd6c2-b6fa-424f-81f3-d0ab127830bd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-dfedd6c2-b6fa-424f-81f3-d0ab127830bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:16:56.061566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:56.064873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:56.066043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:56.066043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:56.066043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:16:56.066043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:16:56.066043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:16:56.066043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:16:56.066043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:16:56.066043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:16:56.066043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:16:56.066043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:56.066043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 630/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:56.068508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a8d15-8e60-4258-a4bb-9efa0bae9244 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:56.167669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a8d15-8e60-4258-a4bb-9efa0bae9244 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:56.201547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632d94c-9258-48b5-b614-716cb222c106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:56.202234 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632d94c-9258-48b5-b614-716cb222c106 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:56.202560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632d94c-9258-48b5-b614-716cb222c106 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:56.202875 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632d94c-9258-48b5-b614-716cb222c106 None admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:56.203707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632d94c-9258-48b5-b614-716cb222c106 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:56.204041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632d94c-9258-48b5-b614-716cb222c106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:56.205449 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632d94c-9258-48b5-b614-716cb222c106 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:56.222535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 651/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Thu May 5 15:16:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:56.228980 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedd6c2-b6fa-424f-81f3-d0ab127830bd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:56.327304 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedd6c2-b6fa-424f-81f3-d0ab127830bd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:56.362068 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41f1e1-1408-42d6-9ed7-3b4def5b8739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:56.362809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41f1e1-1408-42d6-9ed7-3b4def5b8739 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:56.363097 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41f1e1-1408-42d6-9ed7-3b4def5b8739 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:56.363414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41f1e1-1408-42d6-9ed7-3b4def5b8739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:56.432924 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41f1e1-1408-42d6-9ed7-3b4def5b8739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:56.434456 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41f1e1-1408-42d6-9ed7-3b4def5b8739 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:56.528201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 631/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 5 15:16:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 15:16:56.534182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632d94c-9258-48b5-b614-716cb222c106 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:56.630926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632d94c-9258-48b5-b614-716cb222c106 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:56.663905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa0275-7161-4473-a9c9-f089e48d40f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:56.664699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa0275-7161-4473-a9c9-f089e48d40f2 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:56.664989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa0275-7161-4473-a9c9-f089e48d40f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:56.665292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa0275-7161-4473-a9c9-f089e48d40f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:56.675706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa0275-7161-4473-a9c9-f089e48d40f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:56.677137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa0275-7161-4473-a9c9-f089e48d40f2 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-57aa0275-7161-4473-a9c9-f089e48d40f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:16:56.694262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:56.695331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:56.696565 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:16:56.696565 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:16:56.696565 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:16:56.696565 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:56.696565 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 652/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:56.701377 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41f1e1-1408-42d6-9ed7-3b4def5b8739 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:56.799804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41f1e1-1408-42d6-9ed7-3b4def5b8739 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:56.833706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404601-303a-4493-8911-c8c7408f03b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:56.834396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404601-303a-4493-8911-c8c7408f03b9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:56.834679 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404601-303a-4493-8911-c8c7408f03b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:56.834955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404601-303a-4493-8911-c8c7408f03b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:56.835658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2404601-303a-4493-8911-c8c7408f03b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:56.835959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2404601-303a-4493-8911-c8c7408f03b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:56.838081 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2404601-303a-4493-8911-c8c7408f03b9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:56.848982 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 632/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 5 15:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:56.855438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa0275-7161-4473-a9c9-f089e48d40f2 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:56.955108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa0275-7161-4473-a9c9-f089e48d40f2 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:56.988614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200c1ee-7117-4ee5-a2d4-cf2413bb3109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:56.989459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200c1ee-7117-4ee5-a2d4-cf2413bb3109 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:56.989745 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200c1ee-7117-4ee5-a2d4-cf2413bb3109 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:56.990022 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200c1ee-7117-4ee5-a2d4-cf2413bb3109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:56.996798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200c1ee-7117-4ee5-a2d4-cf2413bb3109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:56.998364 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200c1ee-7117-4ee5-a2d4-cf2413bb3109 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application [None req-f200c1ee-7117-4ee5-a2d4-cf2413bb3109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:16:57.012878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application with Lock( May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:57.014434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:57.015390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:16:57.015390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:16:57.015390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:16:57.015390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:16:57.015390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:16:57.015390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:16:57.015390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:16:57.015390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: ERROR keystone.server.flask.application May 05 15:16:57.015390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 653/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 5 15:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:57.020388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404601-303a-4493-8911-c8c7408f03b9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:57.122568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404601-303a-4493-8911-c8c7408f03b9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:57.165084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155ecc0-1666-4cc7-8316-dcdacde65984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:57.165803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155ecc0-1666-4cc7-8316-dcdacde65984 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:57.166086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155ecc0-1666-4cc7-8316-dcdacde65984 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:57.166469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155ecc0-1666-4cc7-8316-dcdacde65984 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:57.167241 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155ecc0-1666-4cc7-8316-dcdacde65984 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:57.167548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155ecc0-1666-4cc7-8316-dcdacde65984 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:57.169068 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155ecc0-1666-4cc7-8316-dcdacde65984 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:57.180914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 633/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 5 15:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:57.188297 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200c1ee-7117-4ee5-a2d4-cf2413bb3109 None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:57.282676 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200c1ee-7117-4ee5-a2d4-cf2413bb3109 None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:57.315274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6359341-3914-48ab-90dd-a1cf0517ee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:57.315923 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6359341-3914-48ab-90dd-a1cf0517ee70 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:57.316260 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6359341-3914-48ab-90dd-a1cf0517ee70 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:57.316537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6359341-3914-48ab-90dd-a1cf0517ee70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:57.317363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6359341-3914-48ab-90dd-a1cf0517ee70 None admin] RBAC: Adding query filter params (role.id=a4cde3da8b864cf69a7a4680732971bf, scope.project.id=587280a3c4c54bffb4d769e406af3689, user.id=db978c3b147c4b259b623e8c64e7c13a) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:57.317671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6359341-3914-48ab-90dd-a1cf0517ee70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:57.319119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6359341-3914-48ab-90dd-a1cf0517ee70 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:57.325467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 654/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 5 15:16:57 2022] GET /identity/v3/role_assignments?user.id=db978c3b147c4b259b623e8c64e7c13a&scope.project.id=587280a3c4c54bffb4d769e406af3689&role.id=a4cde3da8b864cf69a7a4680732971bf => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:59.582873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873f7a-fe89-425b-85e5-fc41a318b20d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:59.583427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873f7a-fe89-425b-85e5-fc41a318b20d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:59.583427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873f7a-fe89-425b-85e5-fc41a318b20d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:59.584832 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 634/1288] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:16:59.590048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c00c7-3f6a-4633-84c5-06eff99e80b2 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:59.590498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c00c7-3f6a-4633-84c5-06eff99e80b2 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:59.590632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c00c7-3f6a-4633-84c5-06eff99e80b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:59.607453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ba4c00c7-3f6a-4633-84c5-06eff99e80b2 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:16:59.608630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ba4c00c7-3f6a-4633-84c5-06eff99e80b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:16:59.674021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 655/1289] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:16:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:16:59.696675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5873f7a-fe89-425b-85e5-fc41a318b20d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:59.796042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5873f7a-fe89-425b-85e5-fc41a318b20d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:59.829651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1174da6-8ab3-4e76-922a-5a50eddec614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:59.830469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174da6-8ab3-4e76-922a-5a50eddec614 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:59.830748 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174da6-8ab3-4e76-922a-5a50eddec614 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:59.831019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174da6-8ab3-4e76-922a-5a50eddec614 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:59.831702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1174da6-8ab3-4e76-922a-5a50eddec614 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:59.833116 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1174da6-8ab3-4e76-922a-5a50eddec614 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-d1174da6-8ab3-4e76-922a-5a50eddec614 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:16:59.844688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:16:59.848262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:16:59.849123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 635/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Thu May 5 15:16:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:16:59.852002 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c00c7-3f6a-4633-84c5-06eff99e80b2 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:16:59.948651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c00c7-3f6a-4633-84c5-06eff99e80b2 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:16:59.981763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc95578-8497-485c-b85d-30dc4a3a24d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:16:59.982610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc95578-8497-485c-b85d-30dc4a3a24d6 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:16:59.982891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc95578-8497-485c-b85d-30dc4a3a24d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:16:59.983164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc95578-8497-485c-b85d-30dc4a3a24d6 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:16:59.983860 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc95578-8497-485c-b85d-30dc4a3a24d6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:16:59.984164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc95578-8497-485c-b85d-30dc4a3a24d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:16:59.985646 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc95578-8497-485c-b85d-30dc4a3a24d6 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:16:59.990396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 656/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Thu May 5 15:16:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:16:59.996834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1174da6-8ab3-4e76-922a-5a50eddec614 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:17:00.092846 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1174da6-8ab3-4e76-922a-5a50eddec614 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:17:00.126599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763e67c-2428-480c-9655-53fb49371724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:17:00.127520 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763e67c-2428-480c-9655-53fb49371724 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:00.127805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763e67c-2428-480c-9655-53fb49371724 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:00.128085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763e67c-2428-480c-9655-53fb49371724 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:00.128786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763e67c-2428-480c-9655-53fb49371724 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:17:00.129095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763e67c-2428-480c-9655-53fb49371724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:17:00.130486 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763e67c-2428-480c-9655-53fb49371724 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:17:00.134778 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 636/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Thu May 5 15:16:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:17:02.442062 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9537175-517e-4aec-9056-9f2cb84fd369 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:02.442649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9537175-517e-4aec-9056-9f2cb84fd369 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:02.442794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9537175-517e-4aec-9056-9f2cb84fd369 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:02.444155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 657/1293] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:17:02.450033 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268ee89-5843-4109-a2bb-40452a3bd2b0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:02.450459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268ee89-5843-4109-a2bb-40452a3bd2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:02.450625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268ee89-5843-4109-a2bb-40452a3bd2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:02.467270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c268ee89-5843-4109-a2bb-40452a3bd2b0 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:17:02.468451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c268ee89-5843-4109-a2bb-40452a3bd2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:17:02.532178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 637/1294] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:17:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:17:02.555119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9537175-517e-4aec-9056-9f2cb84fd369 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:17:02.651800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9537175-517e-4aec-9056-9f2cb84fd369 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:17:02.684222 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be21e5f-ffd4-4daa-b356-65bcb21ea4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:17:02.684877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21e5f-ffd4-4daa-b356-65bcb21ea4a1 None admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:02.685157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21e5f-ffd4-4daa-b356-65bcb21ea4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:02.685431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21e5f-ffd4-4daa-b356-65bcb21ea4a1 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:02.686136 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be21e5f-ffd4-4daa-b356-65bcb21ea4a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:17:02.687519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be21e5f-ffd4-4daa-b356-65bcb21ea4a1 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:17:02.753101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 658/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 5 15:17:02 2022] POST /identity/v3/services => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:17:05.034896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ae7e4-3b32-454b-bb75-25f370276ccc None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:05.035404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ae7e4-3b32-454b-bb75-25f370276ccc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:05.035404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ae7e4-3b32-454b-bb75-25f370276ccc None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:05.036844 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 638/1296] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:17:05.043257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d6f5f-8a8b-4b61-8f7d-7342c46a3a95 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:05.043685 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d6f5f-8a8b-4b61-8f7d-7342c46a3a95 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:05.043815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d6f5f-8a8b-4b61-8f7d-7342c46a3a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:05.061130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-128d6f5f-8a8b-4b61-8f7d-7342c46a3a95 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:17:05.062330 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-128d6f5f-8a8b-4b61-8f7d-7342c46a3a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:17:05.133927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 659/1297] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:17:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:17:05.158101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ae7e4-3b32-454b-bb75-25f370276ccc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:17:05.260720 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ae7e4-3b32-454b-bb75-25f370276ccc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:17:05.294976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9776171-fff1-44c0-856c-16104f47712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:17:05.295738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776171-fff1-44c0-856c-16104f47712a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:05.296040 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776171-fff1-44c0-856c-16104f47712a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:05.296316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776171-fff1-44c0-856c-16104f47712a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:05.296991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9776171-fff1-44c0-856c-16104f47712a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:17:05.298468 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9776171-fff1-44c0-856c-16104f47712a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c9776171-fff1-44c0-856c-16104f47712a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:17:05.311357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:17:05.312587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:17:05.313768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 639/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Thu May 5 15:17:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:17:05.321450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d6f5f-8a8b-4b61-8f7d-7342c46a3a95 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:17:05.415258 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d6f5f-8a8b-4b61-8f7d-7342c46a3a95 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:17:05.449833 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4954c-6fd8-44ef-81e0-279573b9dcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:17:05.450538 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4954c-6fd8-44ef-81e0-279573b9dcfe None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:05.450848 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4954c-6fd8-44ef-81e0-279573b9dcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:05.451130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4954c-6fd8-44ef-81e0-279573b9dcfe None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:05.451825 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4954c-6fd8-44ef-81e0-279573b9dcfe None admin] RBAC: Adding query filter params (name=placement) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:17:05.452125 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4954c-6fd8-44ef-81e0-279573b9dcfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:17:05.453482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4954c-6fd8-44ef-81e0-279573b9dcfe None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:17:05.458460 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 660/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Thu May 5 15:17:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:17:05.465688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9776171-fff1-44c0-856c-16104f47712a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:17:05.565591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9776171-fff1-44c0-856c-16104f47712a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:17:05.597675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01ef82-3b40-4dac-99c4-f834fc7d45bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:17:05.598362 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01ef82-3b40-4dac-99c4-f834fc7d45bb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:05.598647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01ef82-3b40-4dac-99c4-f834fc7d45bb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:05.598924 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01ef82-3b40-4dac-99c4-f834fc7d45bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:05.599707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01ef82-3b40-4dac-99c4-f834fc7d45bb None admin] RBAC: Adding query filter params (interface=public, service_id=4fdb47f42c524e73bd5b9c62ce1aca1a, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:17:05.600021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01ef82-3b40-4dac-99c4-f834fc7d45bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:17:05.601380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01ef82-3b40-4dac-99c4-f834fc7d45bb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:17:05.606961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 640/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 5 15:17:05 2022] GET /identity/v3/endpoints?service_id=4fdb47f42c524e73bd5b9c62ce1aca1a&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:17:05.612630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4954c-6fd8-44ef-81e0-279573b9dcfe None admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:17:05.706574 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4954c-6fd8-44ef-81e0-279573b9dcfe None admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:17:05.739105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189b15-56c1-4345-9dbd-8bbad1288718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:17:05.739762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189b15-56c1-4345-9dbd-8bbad1288718 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:05.740048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189b15-56c1-4345-9dbd-8bbad1288718 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:05.740323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189b15-56c1-4345-9dbd-8bbad1288718 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:05.745084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de189b15-56c1-4345-9dbd-8bbad1288718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:17:05.745084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de189b15-56c1-4345-9dbd-8bbad1288718 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:17:05.749076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 661/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 5 15:17:05 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:17:07.998047 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0f955-0413-4f08-804a-af541e2d8c81 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:07.998631 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0f955-0413-4f08-804a-af541e2d8c81 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:07.998631 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0f955-0413-4f08-804a-af541e2d8c81 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:08.000190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 641/1302] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:17:08.005182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5ebeb-012a-4b3f-a072-4bb77951cca7 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:08.005615 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5ebeb-012a-4b3f-a072-4bb77951cca7 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:08.005767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5ebeb-012a-4b3f-a072-4bb77951cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:08.022769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-91f5ebeb-012a-4b3f-a072-4bb77951cca7 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:17:08.023913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-91f5ebeb-012a-4b3f-a072-4bb77951cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:17:08.088518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 662/1303] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:17:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:17:08.115034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0f955-0413-4f08-804a-af541e2d8c81 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:17:08.229851 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0f955-0413-4f08-804a-af541e2d8c81 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:17:08.263013 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5ca53-e353-4c1b-962f-4666c1e022ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:17:08.263808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5ca53-e353-4c1b-962f-4666c1e022ca None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:08.264085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5ca53-e353-4c1b-962f-4666c1e022ca None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:08.264355 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5ca53-e353-4c1b-962f-4666c1e022ca None admin] PATH_INFO: `/v3/services/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:08.265014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5ca53-e353-4c1b-962f-4666c1e022ca None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:17:08.266395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5ca53-e353-4c1b-962f-4666c1e022ca None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-46c5ca53-e353-4c1b-962f-4666c1e022ca None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:17:08.278137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:17:08.279418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: ERROR keystone.server.flask.application May 05 15:17:08.280501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 642/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Thu May 5 15:17:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:17:08.285335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5ebeb-012a-4b3f-a072-4bb77951cca7 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:17:08.381116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5ebeb-012a-4b3f-a072-4bb77951cca7 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:17:08.413589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd05014-5cbb-4bd9-a6de-39532e0da992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:17:08.414258 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05014-5cbb-4bd9-a6de-39532e0da992 None admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:08.414574 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05014-5cbb-4bd9-a6de-39532e0da992 None admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:08.414855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05014-5cbb-4bd9-a6de-39532e0da992 None admin] PATH_INFO: `/v3/services` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:08.415561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd05014-5cbb-4bd9-a6de-39532e0da992 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:17:08.415871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd05014-5cbb-4bd9-a6de-39532e0da992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:17:08.418010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd05014-5cbb-4bd9-a6de-39532e0da992 None admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:17:08.423067 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 663/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Thu May 5 15:17:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:17:08.428909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5ca53-e353-4c1b-962f-4666c1e022ca None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:17:08.529229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5ca53-e353-4c1b-962f-4666c1e022ca None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:17:08.562456 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796a70e-865b-4d65-b6ef-7380a37a63ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:17:08.563115 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796a70e-865b-4d65-b6ef-7380a37a63ee None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:17:08.563397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796a70e-865b-4d65-b6ef-7380a37a63ee None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:17:08.563676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796a70e-865b-4d65-b6ef-7380a37a63ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:17:08.564412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796a70e-865b-4d65-b6ef-7380a37a63ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:17:08.565823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796a70e-865b-4d65-b6ef-7380a37a63ee None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:17:08.676201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 643/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 5 15:17:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:24:03.753849 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e9208-87a8-458c-8e33-379511a1488d None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:03.757101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e9208-87a8-458c-8e33-379511a1488d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:03.757101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e9208-87a8-458c-8e33-379511a1488d None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:03.757101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 664/1307] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:03.762741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612f9dd-1c43-4157-9a94-ae8f2d76b098 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:03.763225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612f9dd-1c43-4157-9a94-ae8f2d76b098 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:03.763536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612f9dd-1c43-4157-9a94-ae8f2d76b098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:03.857808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7612f9dd-1c43-4157-9a94-ae8f2d76b098 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:03.859109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7612f9dd-1c43-4157-9a94-ae8f2d76b098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:03.990348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 644/1308] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:04.041911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fe983-8d07-4221-beb2-c603b64f6368 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:04.042098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fe983-8d07-4221-beb2-c603b64f6368 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:04.042835 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fe983-8d07-4221-beb2-c603b64f6368 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:04.046127 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 665/1309] 10.222.0.44 () {54 vars in 964 bytes} [Thu May 5 15:24:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:04.053042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20731a3-e6d3-4a1e-84db-c965b4ef2e92 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:04.053329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20731a3-e6d3-4a1e-84db-c965b4ef2e92 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:04.053706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20731a3-e6d3-4a1e-84db-c965b4ef2e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:04.131078 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f20731a3-e6d3-4a1e-84db-c965b4ef2e92 None None] MFA Rules not processed for user `c5efb606fb1b422182ab91576088c85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:04.132436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f20731a3-e6d3-4a1e-84db-c965b4ef2e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:04.209366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 645/1310] 10.222.0.44 () {58 vars in 1061 bytes} [Thu May 5 15:24:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:24:04.219482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fe983-8d07-4221-beb2-c603b64f6368 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:04.221467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2d8fe983-8d07-4221-beb2-c603b64f6368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:04.339118 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fe983-8d07-4221-beb2-c603b64f6368 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:04.418196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a81df2-ecce-495a-9919-f67f087c61ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:04.418909 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a81df2-ecce-495a-9919-f67f087c61ae service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:04.419193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a81df2-ecce-495a-9919-f67f087c61ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:04.419468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a81df2-ecce-495a-9919-f67f087c61ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:04.421385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-59a81df2-ecce-495a-9919-f67f087c61ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:04.535633 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a81df2-ecce-495a-9919-f67f087c61ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:04.537001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a81df2-ecce-495a-9919-f67f087c61ae service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:04.556009 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 666/1311] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:07.150316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a8be-163f-439c-b319-77a3a9fd0f9e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:07.150764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a8be-163f-439c-b319-77a3a9fd0f9e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:07.150873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a8be-163f-439c-b319-77a3a9fd0f9e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:07.152182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 646/1312] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:07.158377 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0ee0c-6a96-42c1-82bd-2e1d4518ecb5 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:07.158917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0ee0c-6a96-42c1-82bd-2e1d4518ecb5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:07.159016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0ee0c-6a96-42c1-82bd-2e1d4518ecb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:07.227859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-0ce0ee0c-6a96-42c1-82bd-2e1d4518ecb5 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:07.229072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-0ce0ee0c-6a96-42c1-82bd-2e1d4518ecb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:07.323138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 667/1313] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:07.362128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053a8be-163f-439c-b319-77a3a9fd0f9e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:07.363721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0053a8be-163f-439c-b319-77a3a9fd0f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:07.465861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053a8be-163f-439c-b319-77a3a9fd0f9e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:07.536903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059570a2-836d-4e98-a32a-4f70582d6cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:07.537576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059570a2-836d-4e98-a32a-4f70582d6cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:07.537854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059570a2-836d-4e98-a32a-4f70582d6cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:07.538127 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059570a2-836d-4e98-a32a-4f70582d6cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:07.539763 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-059570a2-836d-4e98-a32a-4f70582d6cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:07.643682 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059570a2-836d-4e98-a32a-4f70582d6cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:07.645118 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059570a2-836d-4e98-a32a-4f70582d6cc6 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:07.662792 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 647/1314] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:10.555768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a20b4-c9ee-4fc6-8217-f62eaaf02035 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:10.556306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a20b4-c9ee-4fc6-8217-f62eaaf02035 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:10.556306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a20b4-c9ee-4fc6-8217-f62eaaf02035 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:10.557588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 668/1315] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:10.562814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac07d0-5cea-4791-89fa-99014315da4a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:10.563254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac07d0-5cea-4791-89fa-99014315da4a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:10.563510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac07d0-5cea-4791-89fa-99014315da4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:10.627025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-34ac07d0-5cea-4791-89fa-99014315da4a None None] MFA Rules not processed for user `1e88330c8d8b49a79c15d2a198869b44`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:10.628545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-34ac07d0-5cea-4791-89fa-99014315da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:10.728872 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 648/1316] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:24:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:10.773406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a20b4-c9ee-4fc6-8217-f62eaaf02035 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:10.774992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-231a20b4-c9ee-4fc6-8217-f62eaaf02035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:10.876157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a20b4-c9ee-4fc6-8217-f62eaaf02035 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:10.947986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd860364-3129-4c94-85e4-120053d8e788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:10.948636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd860364-3129-4c94-85e4-120053d8e788 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:10.948914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd860364-3129-4c94-85e4-120053d8e788 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:10.949183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd860364-3129-4c94-85e4-120053d8e788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:10.950814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-cd860364-3129-4c94-85e4-120053d8e788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:11.057890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd860364-3129-4c94-85e4-120053d8e788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:11.059350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd860364-3129-4c94-85e4-120053d8e788 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:11.077332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 669/1317] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:24:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:14.164759 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e4d46-8022-4420-93a2-7168a046c413 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:14.165305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e4d46-8022-4420-93a2-7168a046c413 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:14.165425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e4d46-8022-4420-93a2-7168a046c413 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:14.166804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 649/1318] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:14.173048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d7d2b-2466-460b-9fbb-f5021ed05f75 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:14.173469 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d7d2b-2466-460b-9fbb-f5021ed05f75 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:14.173612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d7d2b-2466-460b-9fbb-f5021ed05f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:14.235908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-7b6d7d2b-2466-460b-9fbb-f5021ed05f75 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:14.237104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7b6d7d2b-2466-460b-9fbb-f5021ed05f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:14.334304 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 670/1319] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:24:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:14.373316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e4d46-8022-4420-93a2-7168a046c413 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:14.375484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4f1e4d46-8022-4420-93a2-7168a046c413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:14.478995 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e4d46-8022-4420-93a2-7168a046c413 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:14.552344 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624db65b-c462-4068-8ba1-488c80da53ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:14.552990 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624db65b-c462-4068-8ba1-488c80da53ff service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:14.553272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624db65b-c462-4068-8ba1-488c80da53ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:14.553546 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624db65b-c462-4068-8ba1-488c80da53ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:14.555202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-624db65b-c462-4068-8ba1-488c80da53ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:14.661115 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624db65b-c462-4068-8ba1-488c80da53ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:14.662578 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624db65b-c462-4068-8ba1-488c80da53ff service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:14.680936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 650/1320] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:24:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:18.088552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad38b7-d32b-422e-b38c-bfb64e65f8f8 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:18.089060 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad38b7-d32b-422e-b38c-bfb64e65f8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:18.089060 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad38b7-d32b-422e-b38c-bfb64e65f8f8 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:18.090442 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 671/1321] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:18.095785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525afef2-b766-4595-a16c-0074e11875f0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:18.096196 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525afef2-b766-4595-a16c-0074e11875f0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:18.096349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525afef2-b766-4595-a16c-0074e11875f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:18.159872 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-525afef2-b766-4595-a16c-0074e11875f0 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:18.161062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-525afef2-b766-4595-a16c-0074e11875f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:18.255164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 651/1322] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:24:18.291498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad38b7-d32b-422e-b38c-bfb64e65f8f8 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:18.293017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-89ad38b7-d32b-422e-b38c-bfb64e65f8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:18.396075 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad38b7-d32b-422e-b38c-bfb64e65f8f8 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:18.470788 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42807140-656d-401d-9ae3-8bd749323395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:18.471445 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42807140-656d-401d-9ae3-8bd749323395 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:18.471731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42807140-656d-401d-9ae3-8bd749323395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:18.472008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42807140-656d-401d-9ae3-8bd749323395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:18.473674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-42807140-656d-401d-9ae3-8bd749323395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:18.581346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42807140-656d-401d-9ae3-8bd749323395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:18.582809 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42807140-656d-401d-9ae3-8bd749323395 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:18.601248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 672/1323] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:24:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:20.896562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3906b-c5ef-4aac-8541-7cca68158fc0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:20.897092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3906b-c5ef-4aac-8541-7cca68158fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:20.897092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3906b-c5ef-4aac-8541-7cca68158fc0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:20.898545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 652/1324] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:20.903920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e779b4-e136-4199-a895-1bb855f58d90 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:20.904333 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e779b4-e136-4199-a895-1bb855f58d90 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:20.904475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e779b4-e136-4199-a895-1bb855f58d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:20.970423 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-14e779b4-e136-4199-a895-1bb855f58d90 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:20.971615 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-14e779b4-e136-4199-a895-1bb855f58d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:21.065506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 673/1325] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:21.119131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f717ba5-35cb-4801-9a65-daf7f99d21c9 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:21.119517 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f717ba5-35cb-4801-9a65-daf7f99d21c9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:21.119866 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f717ba5-35cb-4801-9a65-daf7f99d21c9 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:21.121305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 653/1326] 10.222.0.44 () {54 vars in 964 bytes} [Thu May 5 15:24:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:21.127734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e49ba6-14ab-4df0-b377-392835b9f35c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:21.128028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e49ba6-14ab-4df0-b377-392835b9f35c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:21.128309 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e49ba6-14ab-4df0-b377-392835b9f35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:21.202172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b6e49ba6-14ab-4df0-b377-392835b9f35c None None] MFA Rules not processed for user `c5efb606fb1b422182ab91576088c85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:21.204028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b6e49ba6-14ab-4df0-b377-392835b9f35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:21.278623 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 674/1327] 10.222.0.44 () {58 vars in 1061 bytes} [Thu May 5 15:24:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:21.288920 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f717ba5-35cb-4801-9a65-daf7f99d21c9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:21.290578 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2f717ba5-35cb-4801-9a65-daf7f99d21c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:21.391149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f717ba5-35cb-4801-9a65-daf7f99d21c9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:21.463451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec7af6-c075-47e0-afb5-8e04e3b9989a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:21.464098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec7af6-c075-47e0-afb5-8e04e3b9989a service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:21.464374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec7af6-c075-47e0-afb5-8e04e3b9989a service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:21.464641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec7af6-c075-47e0-afb5-8e04e3b9989a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:21.466253 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-beec7af6-c075-47e0-afb5-8e04e3b9989a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:21.574991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec7af6-c075-47e0-afb5-8e04e3b9989a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:21.576414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec7af6-c075-47e0-afb5-8e04e3b9989a service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:21.594346 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 654/1328] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:24.137094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb479c-604e-4889-b8b9-c355bfe06452 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:24.137624 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb479c-604e-4889-b8b9-c355bfe06452 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:24.137716 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb479c-604e-4889-b8b9-c355bfe06452 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:24.139056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 675/1329] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:24:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:24.144443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cba7a9-8f8d-424b-9c98-a43401e8846a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:24.144899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cba7a9-8f8d-424b-9c98-a43401e8846a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:24.144997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cba7a9-8f8d-424b-9c98-a43401e8846a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:24.208530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-51cba7a9-8f8d-424b-9c98-a43401e8846a None None] MFA Rules not processed for user `1e88330c8d8b49a79c15d2a198869b44`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:24.209735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-51cba7a9-8f8d-424b-9c98-a43401e8846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:24.304385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 655/1330] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:24:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:24.341306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb479c-604e-4889-b8b9-c355bfe06452 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:24.342859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8fcb479c-604e-4889-b8b9-c355bfe06452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:24.444188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb479c-604e-4889-b8b9-c355bfe06452 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:24.514714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f4ff4-b028-488e-b7d4-ea5bb53e16a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:24.515376 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f4ff4-b028-488e-b7d4-ea5bb53e16a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:24.515663 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f4ff4-b028-488e-b7d4-ea5bb53e16a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:24.515945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f4ff4-b028-488e-b7d4-ea5bb53e16a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:24.517604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-984f4ff4-b028-488e-b7d4-ea5bb53e16a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:24.622332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f4ff4-b028-488e-b7d4-ea5bb53e16a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:24.623768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f4ff4-b028-488e-b7d4-ea5bb53e16a9 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:24.642800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 676/1331] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:24:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:27.570680 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0f648-4dac-498c-9ca4-d45faf86bb42 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:27.571222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0f648-4dac-498c-9ca4-d45faf86bb42 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:27.571222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0f648-4dac-498c-9ca4-d45faf86bb42 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:27.572584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 656/1332] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:27.578326 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c80682-e117-4104-8710-3deb3d9682b3 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:27.579334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c80682-e117-4104-8710-3deb3d9682b3 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:27.579838 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c80682-e117-4104-8710-3deb3d9682b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:27.648896 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-69c80682-e117-4104-8710-3deb3d9682b3 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:27.650081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-69c80682-e117-4104-8710-3deb3d9682b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:27.758462 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 677/1333] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:27.787077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0f648-4dac-498c-9ca4-d45faf86bb42 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:27.788675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c0d0f648-4dac-498c-9ca4-d45faf86bb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:27.896134 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0f648-4dac-498c-9ca4-d45faf86bb42 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:27.970136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4af4d-de47-4b50-a594-fa5cddc19974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:27.971063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4af4d-de47-4b50-a594-fa5cddc19974 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:27.971534 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4af4d-de47-4b50-a594-fa5cddc19974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:27.971965 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4af4d-de47-4b50-a594-fa5cddc19974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:27.973797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-efc4af4d-de47-4b50-a594-fa5cddc19974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:28.081039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4af4d-de47-4b50-a594-fa5cddc19974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:28.082514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4af4d-de47-4b50-a594-fa5cddc19974 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:28.101709 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 657/1334] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:30.393870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fbfcd-1d0f-4cbf-b251-4d872291d44e None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:30.394438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fbfcd-1d0f-4cbf-b251-4d872291d44e None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:30.394438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fbfcd-1d0f-4cbf-b251-4d872291d44e None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:30.395820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 678/1335] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:30.400825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa604323-b872-48ba-9082-4e4664546f05 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:30.401229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa604323-b872-48ba-9082-4e4664546f05 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:30.401382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa604323-b872-48ba-9082-4e4664546f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:30.464310 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-aa604323-b872-48ba-9082-4e4664546f05 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:30.465510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aa604323-b872-48ba-9082-4e4664546f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:30.559738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 658/1336] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:30.599431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fbfcd-1d0f-4cbf-b251-4d872291d44e None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:30.600950 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-183fbfcd-1d0f-4cbf-b251-4d872291d44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:30.699538 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fbfcd-1d0f-4cbf-b251-4d872291d44e None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:30.769846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29201bf0-0e87-4d3b-b058-09263a96bd06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:30.770531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29201bf0-0e87-4d3b-b058-09263a96bd06 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:30.770809 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29201bf0-0e87-4d3b-b058-09263a96bd06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:30.771083 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29201bf0-0e87-4d3b-b058-09263a96bd06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:30.772698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-29201bf0-0e87-4d3b-b058-09263a96bd06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:30.880637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29201bf0-0e87-4d3b-b058-09263a96bd06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:30.882116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29201bf0-0e87-4d3b-b058-09263a96bd06 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:30.900412 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 679/1337] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:24:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:33.826446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65959-fd19-420a-a5bb-5e096e9dee5b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:33.827019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65959-fd19-420a-a5bb-5e096e9dee5b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:33.827019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65959-fd19-420a-a5bb-5e096e9dee5b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:33.828956 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 659/1338] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:33.834263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308cf5b-2644-4d7c-8d98-34292cc29ac5 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:33.834861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308cf5b-2644-4d7c-8d98-34292cc29ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:33.834861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308cf5b-2644-4d7c-8d98-34292cc29ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:33.896860 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-0308cf5b-2644-4d7c-8d98-34292cc29ac5 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:33.898040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-0308cf5b-2644-4d7c-8d98-34292cc29ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:33.992394 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 680/1339] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:24:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:34.029110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b65959-fd19-420a-a5bb-5e096e9dee5b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:34.032705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-07b65959-fd19-420a-a5bb-5e096e9dee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:34.143965 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b65959-fd19-420a-a5bb-5e096e9dee5b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:34.147589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e62f3-6fde-43ff-95a8-6bec226dbf84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:34.148234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e62f3-6fde-43ff-95a8-6bec226dbf84 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:34.148520 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e62f3-6fde-43ff-95a8-6bec226dbf84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:34.148804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e62f3-6fde-43ff-95a8-6bec226dbf84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:34.150588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-480e62f3-6fde-43ff-95a8-6bec226dbf84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:34.252191 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e62f3-6fde-43ff-95a8-6bec226dbf84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:34.253560 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e62f3-6fde-43ff-95a8-6bec226dbf84 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:34.272259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 660/1340] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:24:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:38.849666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cccf6-3643-4968-8bb4-7118354d93e3 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:38.850223 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cccf6-3643-4968-8bb4-7118354d93e3 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:38.850361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cccf6-3643-4968-8bb4-7118354d93e3 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:38.852028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 681/1341] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:38.857486 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cda67-7989-46cf-91aa-2c2282e9f59b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:38.857935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cda67-7989-46cf-91aa-2c2282e9f59b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:38.858035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cda67-7989-46cf-91aa-2c2282e9f59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:38.905395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-064cda67-7989-46cf-91aa-2c2282e9f59b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:38.907333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-064cda67-7989-46cf-91aa-2c2282e9f59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:38.982913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 661/1342] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:39.021977 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cccf6-3643-4968-8bb4-7118354d93e3 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:39.034092 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cccf6-3643-4968-8bb4-7118354d93e3 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:39.037679 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1cda4-3daf-4dbd-a5c8-df4ad47a7f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:39.038419 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1cda4-3daf-4dbd-a5c8-df4ad47a7f4e service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:39.038806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1cda4-3daf-4dbd-a5c8-df4ad47a7f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:39.039154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1cda4-3daf-4dbd-a5c8-df4ad47a7f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:39.048479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1cda4-3daf-4dbd-a5c8-df4ad47a7f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:39.049983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1cda4-3daf-4dbd-a5c8-df4ad47a7f4e service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:39.059727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 682/1343] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:42.546897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dafb2-6d8c-4d54-9d2a-15efb1efe4c4 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:42.547578 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dafb2-6d8c-4d54-9d2a-15efb1efe4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:42.547578 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dafb2-6d8c-4d54-9d2a-15efb1efe4c4 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:42.550329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 662/1344] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:42.554798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f21cf8-7812-4233-b1be-a60d4866a20a None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:42.555288 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f21cf8-7812-4233-b1be-a60d4866a20a None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:42.555432 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f21cf8-7812-4233-b1be-a60d4866a20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:42.584370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-f4f21cf8-7812-4233-b1be-a60d4866a20a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:42.585567 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-f4f21cf8-7812-4233-b1be-a60d4866a20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:42.593996 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 683/1345] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:24:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:42.630515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dafb2-6d8c-4d54-9d2a-15efb1efe4c4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:42.641560 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dafb2-6d8c-4d54-9d2a-15efb1efe4c4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:42.645304 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9302d46-e853-431b-baa4-09494f5f0360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:42.645948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9302d46-e853-431b-baa4-09494f5f0360 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:42.646227 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9302d46-e853-431b-baa4-09494f5f0360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:42.646537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9302d46-e853-431b-baa4-09494f5f0360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:42.656238 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9302d46-e853-431b-baa4-09494f5f0360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:42.657902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9302d46-e853-431b-baa4-09494f5f0360 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:42.667319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 663/1346] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:24:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:24:47.160112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7572c0-3ba7-440f-b1c0-e380a450d35e None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:47.160659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7572c0-3ba7-440f-b1c0-e380a450d35e None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:47.160917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7572c0-3ba7-440f-b1c0-e380a450d35e None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:47.162426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 684/1347] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:47.167711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1538c-4574-4e22-aa40-5259b3c192ee None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:47.168216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1538c-4574-4e22-aa40-5259b3c192ee None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:47.168317 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1538c-4574-4e22-aa40-5259b3c192ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:47.189481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-12b1538c-4574-4e22-aa40-5259b3c192ee None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:47.190998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-12b1538c-4574-4e22-aa40-5259b3c192ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:47.198984 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 664/1348] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:47.237402 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7572c0-3ba7-440f-b1c0-e380a450d35e None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:24:47.248036 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7572c0-3ba7-440f-b1c0-e380a450d35e None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:24:47.251589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418123a-b1be-4e90-bfbb-3f2ade9fecad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:24:47.252227 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418123a-b1be-4e90-bfbb-3f2ade9fecad service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:47.252506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418123a-b1be-4e90-bfbb-3f2ade9fecad service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:47.252778 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418123a-b1be-4e90-bfbb-3f2ade9fecad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:47.261999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418123a-b1be-4e90-bfbb-3f2ade9fecad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:24:47.263461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418123a-b1be-4e90-bfbb-3f2ade9fecad service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:24:47.273549 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 685/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:24:52.653031 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90933d2-af31-4fa8-bea5-0ffb4b352d5f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:52.654014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90933d2-af31-4fa8-bea5-0ffb4b352d5f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:52.654624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90933d2-af31-4fa8-bea5-0ffb4b352d5f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:52.662984 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 665/1350] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 5 15:24:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:52.667999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b5083-f087-42fc-ad98-23a784a58531 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:52.668806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b5083-f087-42fc-ad98-23a784a58531 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:52.669088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b5083-f087-42fc-ad98-23a784a58531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:52.741133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-522b5083-f087-42fc-ad98-23a784a58531 None None] MFA Rules not processed for user `db978c3b147c4b259b623e8c64e7c13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:52.742631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-522b5083-f087-42fc-ad98-23a784a58531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:52.817536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 686/1351] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 5 15:24:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:57.366899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dd493-fa67-47da-9b82-0c17210786cf None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:57.367926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dd493-fa67-47da-9b82-0c17210786cf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:57.368433 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dd493-fa67-47da-9b82-0c17210786cf None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:57.370304 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 666/1352] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 5 15:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:57.375530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa92d6-8155-4c72-b61e-08a7e2296583 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:57.375989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa92d6-8155-4c72-b61e-08a7e2296583 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:57.376114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa92d6-8155-4c72-b61e-08a7e2296583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:57.395849 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a1fa92d6-8155-4c72-b61e-08a7e2296583 None None] MFA Rules not processed for user `db978c3b147c4b259b623e8c64e7c13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:57.397042 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a1fa92d6-8155-4c72-b61e-08a7e2296583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:57.406360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 687/1353] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 5 15:24:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:24:58.702869 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381c166-a923-4445-9eda-2270b9ef72d3 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:58.703514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381c166-a923-4445-9eda-2270b9ef72d3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:58.703514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381c166-a923-4445-9eda-2270b9ef72d3 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:58.704834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 667/1354] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 5 15:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:24:58.710192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8358ce-e199-4d37-924e-5b26fe2ee36a None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:24:58.710663 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8358ce-e199-4d37-924e-5b26fe2ee36a None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:24:58.710777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8358ce-e199-4d37-924e-5b26fe2ee36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:24:58.728220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ad8358ce-e199-4d37-924e-5b26fe2ee36a None None] MFA Rules not processed for user `db978c3b147c4b259b623e8c64e7c13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:24:58.729420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ad8358ce-e199-4d37-924e-5b26fe2ee36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:24:58.737823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 688/1355] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 5 15:24:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:02.632937 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82089fa-cde7-4977-8b51-38af78456ed9 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:02.636297 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82089fa-cde7-4977-8b51-38af78456ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:02.636297 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82089fa-cde7-4977-8b51-38af78456ed9 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:02.636297 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 668/1356] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:02.641526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb220fa2-29af-496e-a224-3dfc55775f66 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:02.641948 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb220fa2-29af-496e-a224-3dfc55775f66 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:02.642084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb220fa2-29af-496e-a224-3dfc55775f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:02.670551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-fb220fa2-29af-496e-a224-3dfc55775f66 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:02.676783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-fb220fa2-29af-496e-a224-3dfc55775f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:02.682687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 689/1357] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:02.732124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96546d1-b179-4036-a238-5ce93e3c3c4e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:02.732414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96546d1-b179-4036-a238-5ce93e3c3c4e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:02.732684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96546d1-b179-4036-a238-5ce93e3c3c4e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:02.734796 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 669/1358] 10.222.0.44 () {54 vars in 960 bytes} [Thu May 5 15:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:02.740122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536f57b-da0b-423e-9a8d-fda1d61708da None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:02.740521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536f57b-da0b-423e-9a8d-fda1d61708da None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:02.740901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536f57b-da0b-423e-9a8d-fda1d61708da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:02.792242 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-d536f57b-da0b-423e-9a8d-fda1d61708da None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:02.793615 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d536f57b-da0b-423e-9a8d-fda1d61708da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:02.875903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 690/1359] 10.222.0.44 () {58 vars in 1057 bytes} [Thu May 5 15:25:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:02.883758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96546d1-b179-4036-a238-5ce93e3c3c4e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:02.899435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96546d1-b179-4036-a238-5ce93e3c3c4e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:02.904837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507837b-0cab-4827-a7ee-e0485d17e00d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:02.906363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507837b-0cab-4827-a7ee-e0485d17e00d service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:02.906715 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507837b-0cab-4827-a7ee-e0485d17e00d service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:02.907093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507837b-0cab-4827-a7ee-e0485d17e00d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:02.915577 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507837b-0cab-4827-a7ee-e0485d17e00d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:02.917239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507837b-0cab-4827-a7ee-e0485d17e00d service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:02.941493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 670/1360] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:05.462545 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506470e-6725-45ab-96a9-8ee26ec4656d None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:05.463381 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506470e-6725-45ab-96a9-8ee26ec4656d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:05.463865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506470e-6725-45ab-96a9-8ee26ec4656d None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:05.465238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 691/1361] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:05.471387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9f09-e2a8-4247-a5b1-46dc484552ec None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:05.471826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9f09-e2a8-4247-a5b1-46dc484552ec None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:05.471958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9f09-e2a8-4247-a5b1-46dc484552ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:05.492891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e8dd9f09-e2a8-4247-a5b1-46dc484552ec None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:05.494367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e8dd9f09-e2a8-4247-a5b1-46dc484552ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:05.503578 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 671/1362] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:05.550148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506470e-6725-45ab-96a9-8ee26ec4656d None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:05.565787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506470e-6725-45ab-96a9-8ee26ec4656d None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:05.572051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b971-a232-479a-9195-25c7bc37e2e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:05.572796 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b971-a232-479a-9195-25c7bc37e2e3 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:05.573177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b971-a232-479a-9195-25c7bc37e2e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:05.573550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b971-a232-479a-9195-25c7bc37e2e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:05.583360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331b971-a232-479a-9195-25c7bc37e2e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:05.585039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331b971-a232-479a-9195-25c7bc37e2e3 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:05.595702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 692/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:08.340525 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b77fc4-092d-4be2-ac6a-1b0eeec7288b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:08.341038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b77fc4-092d-4be2-ac6a-1b0eeec7288b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:08.341038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b77fc4-092d-4be2-ac6a-1b0eeec7288b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:08.342437 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 672/1364] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:08.348621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c64b72-6d55-402c-bc74-c74dc223b06e None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:08.349016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c64b72-6d55-402c-bc74-c74dc223b06e None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:08.349187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c64b72-6d55-402c-bc74-c74dc223b06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:08.367208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-79c64b72-6d55-402c-bc74-c74dc223b06e None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:08.368391 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-79c64b72-6d55-402c-bc74-c74dc223b06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:08.376249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 693/1365] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:08.422165 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f795e-2949-40f2-a765-915d422d21ab None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:08.422518 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f795e-2949-40f2-a765-915d422d21ab None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:08.422822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f795e-2949-40f2-a765-915d422d21ab None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:08.424726 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 673/1366] 10.222.0.44 () {54 vars in 960 bytes} [Thu May 5 15:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:08.430009 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b314d-160d-46ce-87ac-8aee8f95e8b2 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:08.430459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b314d-160d-46ce-87ac-8aee8f95e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:08.430745 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b314d-160d-46ce-87ac-8aee8f95e8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:08.454197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b73b314d-160d-46ce-87ac-8aee8f95e8b2 None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:08.455456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b73b314d-160d-46ce-87ac-8aee8f95e8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:08.472301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 694/1367] 10.222.0.44 () {58 vars in 1057 bytes} [Thu May 5 15:25:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:08.480177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f795e-2949-40f2-a765-915d422d21ab None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:08.495557 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f795e-2949-40f2-a765-915d422d21ab None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:08.501508 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da05e4-182a-4717-aa9a-35c55630c697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:08.502142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da05e4-182a-4717-aa9a-35c55630c697 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:08.502462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da05e4-182a-4717-aa9a-35c55630c697 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:08.502740 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da05e4-182a-4717-aa9a-35c55630c697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:08.511284 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da05e4-182a-4717-aa9a-35c55630c697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:08.512909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da05e4-182a-4717-aa9a-35c55630c697 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:08.523460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 674/1368] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:11.021556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ed626-9bef-4a61-9f1c-db50ebd3b2dc None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:11.022073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ed626-9bef-4a61-9f1c-db50ebd3b2dc None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:11.022073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ed626-9bef-4a61-9f1c-db50ebd3b2dc None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:11.023458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 695/1369] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:11.029247 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca963ed-a797-4886-999a-9e02a10d9320 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:11.029749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca963ed-a797-4886-999a-9e02a10d9320 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:11.030063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca963ed-a797-4886-999a-9e02a10d9320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:11.051883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4ca963ed-a797-4886-999a-9e02a10d9320 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:11.053173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4ca963ed-a797-4886-999a-9e02a10d9320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:11.061714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 675/1370] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:11.136594 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16778272-a857-410d-adc9-267daa5ed457 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:11.136883 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16778272-a857-410d-adc9-267daa5ed457 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:11.137330 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16778272-a857-410d-adc9-267daa5ed457 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:11.138725 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 696/1371] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:11.144026 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e71783-7bf4-4675-bc76-f3ff4e81b44c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:11.144319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e71783-7bf4-4675-bc76-f3ff4e81b44c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:11.144621 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e71783-7bf4-4675-bc76-f3ff4e81b44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:11.162223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-46e71783-7bf4-4675-bc76-f3ff4e81b44c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:11.163437 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-46e71783-7bf4-4675-bc76-f3ff4e81b44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:11.172415 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 676/1372] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:11.215479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16778272-a857-410d-adc9-267daa5ed457 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:11.230449 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16778272-a857-410d-adc9-267daa5ed457 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:11.236762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf36d2-120c-48de-88b5-d5655186f657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:11.237693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf36d2-120c-48de-88b5-d5655186f657 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:11.237980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf36d2-120c-48de-88b5-d5655186f657 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:11.238252 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf36d2-120c-48de-88b5-d5655186f657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:11.246793 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf36d2-120c-48de-88b5-d5655186f657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:11.248362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf36d2-120c-48de-88b5-d5655186f657 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:11.259396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 697/1373] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:11.378657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ac331-dbf2-44f0-a011-a2d970c35258 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:11.378657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ac331-dbf2-44f0-a011-a2d970c35258 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:11.378657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ac331-dbf2-44f0-a011-a2d970c35258 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:11.378657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 677/1374] 10.222.0.44 () {54 vars in 963 bytes} [Thu May 5 15:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:11.378997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c8e61-e6d8-4b92-b6f6-c2eb4b5ddd15 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:11.378997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c8e61-e6d8-4b92-b6f6-c2eb4b5ddd15 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:11.378997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c8e61-e6d8-4b92-b6f6-c2eb4b5ddd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:11.427696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-5a0c8e61-e6d8-4b92-b6f6-c2eb4b5ddd15 None None] MFA Rules not processed for user `7fe051e3e2084f89a95a95aa4fd857df`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:11.429012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-5a0c8e61-e6d8-4b92-b6f6-c2eb4b5ddd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:11.495547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 698/1375] 10.222.0.44 () {58 vars in 1060 bytes} [Thu May 5 15:25:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:11.503802 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ac331-dbf2-44f0-a011-a2d970c35258 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:11.515489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ac331-dbf2-44f0-a011-a2d970c35258 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:11.519414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68c40a-f88d-401f-9e57-c633f7840a13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:11.520200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68c40a-f88d-401f-9e57-c633f7840a13 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:11.520591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68c40a-f88d-401f-9e57-c633f7840a13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:11.520941 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68c40a-f88d-401f-9e57-c633f7840a13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:11.531777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68c40a-f88d-401f-9e57-c633f7840a13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:11.533359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68c40a-f88d-401f-9e57-c633f7840a13 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:11.544595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 678/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:13.714858 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef31a5d-d8fc-47af-92db-743ab424dd1c None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:13.715370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef31a5d-d8fc-47af-92db-743ab424dd1c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:13.715902 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef31a5d-d8fc-47af-92db-743ab424dd1c None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:13.716790 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 699/1377] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:13.722187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c7422-88d3-4467-b940-afe17961a209 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:13.722673 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c7422-88d3-4467-b940-afe17961a209 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:13.722798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c7422-88d3-4467-b940-afe17961a209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:13.740867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-754c7422-88d3-4467-b940-afe17961a209 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:13.742039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-754c7422-88d3-4467-b940-afe17961a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:13.750687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 679/1378] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:13.794797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef31a5d-d8fc-47af-92db-743ab424dd1c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:13.809573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef31a5d-d8fc-47af-92db-743ab424dd1c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:13.815711 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03d721-6c70-485d-8d16-8ee0247f1ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:13.816362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03d721-6c70-485d-8d16-8ee0247f1ba6 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:13.816647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03d721-6c70-485d-8d16-8ee0247f1ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:13.816917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03d721-6c70-485d-8d16-8ee0247f1ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:13.825474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03d721-6c70-485d-8d16-8ee0247f1ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:13.827714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03d721-6c70-485d-8d16-8ee0247f1ba6 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:13.837901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 700/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:16.274551 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea377e7-fe31-41f9-b406-396e673eb8f1 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:16.275132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea377e7-fe31-41f9-b406-396e673eb8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:16.275486 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea377e7-fe31-41f9-b406-396e673eb8f1 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:16.276970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 680/1380] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:16.282650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1fcd4-21b9-44e4-a5aa-6869c7fe2188 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:16.283041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1fcd4-21b9-44e4-a5aa-6869c7fe2188 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:16.283222 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1fcd4-21b9-44e4-a5aa-6869c7fe2188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:16.302408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-59e1fcd4-21b9-44e4-a5aa-6869c7fe2188 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:16.303619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-59e1fcd4-21b9-44e4-a5aa-6869c7fe2188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:16.311884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 701/1381] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:16.357081 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea377e7-fe31-41f9-b406-396e673eb8f1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:16.372239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea377e7-fe31-41f9-b406-396e673eb8f1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:16.378775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913fc50-8382-40a8-9acb-d013a7bff3eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:16.379451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913fc50-8382-40a8-9acb-d013a7bff3eb service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:16.379742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913fc50-8382-40a8-9acb-d013a7bff3eb service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:16.380027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913fc50-8382-40a8-9acb-d013a7bff3eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:16.388928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913fc50-8382-40a8-9acb-d013a7bff3eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:16.390698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913fc50-8382-40a8-9acb-d013a7bff3eb service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:16.400696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 681/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:18.931981 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb3014-864d-479a-851a-3e403f6995d4 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:18.932541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb3014-864d-479a-851a-3e403f6995d4 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:18.932541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb3014-864d-479a-851a-3e403f6995d4 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:18.933874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 702/1383] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:25:18.939722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904418e-b52f-424d-aeb1-8655c2a50652 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:18.940128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904418e-b52f-424d-aeb1-8655c2a50652 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:18.940279 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904418e-b52f-424d-aeb1-8655c2a50652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:18.958103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f904418e-b52f-424d-aeb1-8655c2a50652 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:18.959324 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f904418e-b52f-424d-aeb1-8655c2a50652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:18.967908 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 682/1384] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:19.008705 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb3014-864d-479a-851a-3e403f6995d4 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:19.023098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb3014-864d-479a-851a-3e403f6995d4 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:19.028633 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420e3e8-e617-40ca-89e3-cec54a5184df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:19.029457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420e3e8-e617-40ca-89e3-cec54a5184df service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:19.030440 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420e3e8-e617-40ca-89e3-cec54a5184df service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:19.030861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420e3e8-e617-40ca-89e3-cec54a5184df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:19.039229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420e3e8-e617-40ca-89e3-cec54a5184df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:19.040946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420e3e8-e617-40ca-89e3-cec54a5184df service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:19.053287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 703/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:21.312476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d3d8-4fb4-4a94-bd05-47249d73fba9 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:21.313039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d3d8-4fb4-4a94-bd05-47249d73fba9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:21.313142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d3d8-4fb4-4a94-bd05-47249d73fba9 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:21.314571 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 683/1386] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:21.320905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202f001-814b-4164-b503-63d7e90cce94 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:21.321323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202f001-814b-4164-b503-63d7e90cce94 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:21.321468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202f001-814b-4164-b503-63d7e90cce94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:21.340220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-c202f001-814b-4164-b503-63d7e90cce94 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:21.341424 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c202f001-814b-4164-b503-63d7e90cce94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:21.349984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 704/1387] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:21.403881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d3d8-4fb4-4a94-bd05-47249d73fba9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:21.423670 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d3d8-4fb4-4a94-bd05-47249d73fba9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:21.430846 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45875c-67cd-421d-8e10-dbe3e62f836b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:21.431731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45875c-67cd-421d-8e10-dbe3e62f836b service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:21.432102 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45875c-67cd-421d-8e10-dbe3e62f836b service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:21.432479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45875c-67cd-421d-8e10-dbe3e62f836b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:21.443745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45875c-67cd-421d-8e10-dbe3e62f836b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:21.445858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45875c-67cd-421d-8e10-dbe3e62f836b service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:21.458735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 684/1388] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:24.557570 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ac0c7-5e5f-41f5-88ab-11c88f589500 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:24.558115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ac0c7-5e5f-41f5-88ab-11c88f589500 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:24.558115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ac0c7-5e5f-41f5-88ab-11c88f589500 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:24.559503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 705/1389] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:24.566944 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92eff3-598c-4366-82e6-ba9e5b3abd0a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:24.567338 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92eff3-598c-4366-82e6-ba9e5b3abd0a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:24.567541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92eff3-598c-4366-82e6-ba9e5b3abd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:24.585539 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3a92eff3-598c-4366-82e6-ba9e5b3abd0a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:24.586762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3a92eff3-598c-4366-82e6-ba9e5b3abd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:24.595243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 685/1390] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:24.639526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ac0c7-5e5f-41f5-88ab-11c88f589500 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:24.653741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ac0c7-5e5f-41f5-88ab-11c88f589500 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:24.660259 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271086cf-2618-4c50-a076-c8aab4f763d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:24.660920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271086cf-2618-4c50-a076-c8aab4f763d8 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:24.661202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271086cf-2618-4c50-a076-c8aab4f763d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:24.661479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271086cf-2618-4c50-a076-c8aab4f763d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:24.669949 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271086cf-2618-4c50-a076-c8aab4f763d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:24.671843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271086cf-2618-4c50-a076-c8aab4f763d8 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:24.681795 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 706/1391] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:25:27.303375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc079d-1bb9-47b0-9dd6-d700f9a8f555 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:27.303977 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc079d-1bb9-47b0-9dd6-d700f9a8f555 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:27.303977 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc079d-1bb9-47b0-9dd6-d700f9a8f555 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:27.305323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 686/1392] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:27.310845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b9fbd-cd33-489d-8c06-fb11c46d57fa None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:27.311300 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b9fbd-cd33-489d-8c06-fb11c46d57fa None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:27.311471 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b9fbd-cd33-489d-8c06-fb11c46d57fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:27.328861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-598b9fbd-cd33-489d-8c06-fb11c46d57fa None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:27.330047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-598b9fbd-cd33-489d-8c06-fb11c46d57fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:27.337750 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 707/1393] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:27.381636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc079d-1bb9-47b0-9dd6-d700f9a8f555 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:27.395981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc079d-1bb9-47b0-9dd6-d700f9a8f555 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:27.401378 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b22b6-8547-41f8-8019-2771a8167a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:27.402015 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b22b6-8547-41f8-8019-2771a8167a0d service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:27.402316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b22b6-8547-41f8-8019-2771a8167a0d service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:27.402597 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b22b6-8547-41f8-8019-2771a8167a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:27.411752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b22b6-8547-41f8-8019-2771a8167a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:27.413335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b22b6-8547-41f8-8019-2771a8167a0d service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:27.423498 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 687/1394] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:27.902605 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c0fc5-f83b-4a66-a842-a7df61018823 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:27.902901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c0fc5-f83b-4a66-a842-a7df61018823 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:27.903182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c0fc5-f83b-4a66-a842-a7df61018823 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:27.904645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 708/1395] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:27.910782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a204933-27f8-45f7-8a53-13c9b5a319e4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:27.911075 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a204933-27f8-45f7-8a53-13c9b5a319e4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:27.911356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a204933-27f8-45f7-8a53-13c9b5a319e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:27.929453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3a204933-27f8-45f7-8a53-13c9b5a319e4 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:27.930672 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3a204933-27f8-45f7-8a53-13c9b5a319e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:27.939357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 688/1396] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:27.995585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce052ba-6b42-4b49-a24d-90d9bd646279 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:27.995885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce052ba-6b42-4b49-a24d-90d9bd646279 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:27.996170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce052ba-6b42-4b49-a24d-90d9bd646279 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:27.997629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 709/1397] 10.222.0.44 () {54 vars in 962 bytes} [Thu May 5 15:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:28.003183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6555188-2106-4321-86b0-2774d09879b7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:28.003470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6555188-2106-4321-86b0-2774d09879b7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:28.003742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6555188-2106-4321-86b0-2774d09879b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:28.051202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e6555188-2106-4321-86b0-2774d09879b7 None None] MFA Rules not processed for user `34f973b13dd44e609110f9a967ae1fed`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:28.052381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e6555188-2106-4321-86b0-2774d09879b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:28.110983 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 689/1398] 10.222.0.44 () {58 vars in 1059 bytes} [Thu May 5 15:25:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:28.118769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce052ba-6b42-4b49-a24d-90d9bd646279 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:28.129983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce052ba-6b42-4b49-a24d-90d9bd646279 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:28.133490 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ba2f1-c137-4bd1-815b-b792b20e98d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f973b13dd44e609110f9a967ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:28.134212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ba2f1-c137-4bd1-815b-b792b20e98d7 service glance] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:28.134582 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ba2f1-c137-4bd1-815b-b792b20e98d7 service glance] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:28.134920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ba2f1-c137-4bd1-815b-b792b20e98d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:28.144635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ba2f1-c137-4bd1-815b-b792b20e98d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:28.146074 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ba2f1-c137-4bd1-815b-b792b20e98d7 service glance] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:28.155910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 710/1399] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:25:28.815660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467af2cd-c6c9-4e89-9ca2-6f1e5d51cb57 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:28.816162 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467af2cd-c6c9-4e89-9ca2-6f1e5d51cb57 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:28.816272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467af2cd-c6c9-4e89-9ca2-6f1e5d51cb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:28.863087 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-467af2cd-c6c9-4e89-9ca2-6f1e5d51cb57 None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:28.864311 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-467af2cd-c6c9-4e89-9ca2-6f1e5d51cb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:28.927207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 690/1400] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:25:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:28.968958 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75e3f9-e7e7-4ba7-b8e2-ed7d6d8a851c None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:28.969444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75e3f9-e7e7-4ba7-b8e2-ed7d6d8a851c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:28.969549 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75e3f9-e7e7-4ba7-b8e2-ed7d6d8a851c None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:28.970930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 711/1401] 10.222.0.44 () {54 vars in 942 bytes} [Thu May 5 15:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:28.977165 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd41f5-16ae-40ba-9764-145a41c67c56 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:28.977464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd41f5-16ae-40ba-9764-145a41c67c56 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:28.977749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd41f5-16ae-40ba-9764-145a41c67c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:29.026166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9bcd41f5-16ae-40ba-9764-145a41c67c56 None None] MFA Rules not processed for user `27e0b470f6b84df38565abf006dd8ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:29.027306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9bcd41f5-16ae-40ba-9764-145a41c67c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:29.099234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 691/1402] 10.222.0.44 () {58 vars in 1039 bytes} [Thu May 5 15:25:28 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:29.109071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75e3f9-e7e7-4ba7-b8e2-ed7d6d8a851c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:29.122096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75e3f9-e7e7-4ba7-b8e2-ed7d6d8a851c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:29.127933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc483953-7337-4c4b-bf72-a5f32855ddf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:29.128582 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc483953-7337-4c4b-bf72-a5f32855ddf7 service swift] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:29.128887 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc483953-7337-4c4b-bf72-a5f32855ddf7 service swift] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:29.129168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc483953-7337-4c4b-bf72-a5f32855ddf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:29.137382 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc483953-7337-4c4b-bf72-a5f32855ddf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:29.139168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc483953-7337-4c4b-bf72-a5f32855ddf7 service swift] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:29.147318 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 712/1403] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:25:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:25:29.916049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b024c-ded3-4e09-ac86-ef4aee9940f0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:29.916598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b024c-ded3-4e09-ac86-ef4aee9940f0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:29.916598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b024c-ded3-4e09-ac86-ef4aee9940f0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:29.917990 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 692/1404] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:29.923734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64441571-2d87-4790-beec-121230588555 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:29.924303 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64441571-2d87-4790-beec-121230588555 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:29.924793 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64441571-2d87-4790-beec-121230588555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:29.943639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-64441571-2d87-4790-beec-121230588555 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:29.944851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-64441571-2d87-4790-beec-121230588555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:29.958393 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 713/1405] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:25:29.997827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b024c-ded3-4e09-ac86-ef4aee9940f0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:30.015406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b024c-ded3-4e09-ac86-ef4aee9940f0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:30.021242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f4b21-c25f-4430-af9c-6635d47da438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:30.022107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f4b21-c25f-4430-af9c-6635d47da438 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:30.022495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f4b21-c25f-4430-af9c-6635d47da438 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:30.022845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f4b21-c25f-4430-af9c-6635d47da438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:30.032396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f4b21-c25f-4430-af9c-6635d47da438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:30.033994 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f4b21-c25f-4430-af9c-6635d47da438 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:30.043548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 693/1406] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:32.645314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffd3e3-5ee3-46f0-8126-690cc59c2ae2 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:32.646212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffd3e3-5ee3-46f0-8126-690cc59c2ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:32.646534 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffd3e3-5ee3-46f0-8126-690cc59c2ae2 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:32.651286 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 714/1407] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:25:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:32.654058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2e081-e82f-4b8c-bfdf-c3c3ad20f616 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:32.655790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2e081-e82f-4b8c-bfdf-c3c3ad20f616 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:32.656283 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2e081-e82f-4b8c-bfdf-c3c3ad20f616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:32.676989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cfb2e081-e82f-4b8c-bfdf-c3c3ad20f616 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:32.678481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cfb2e081-e82f-4b8c-bfdf-c3c3ad20f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:32.687234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 694/1408] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:32.739659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffd3e3-5ee3-46f0-8126-690cc59c2ae2 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:32.755410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffd3e3-5ee3-46f0-8126-690cc59c2ae2 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:32.766600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f437661-ba3c-487f-948b-5c6dd98a1f19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:32.767402 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f437661-ba3c-487f-948b-5c6dd98a1f19 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:32.767689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f437661-ba3c-487f-948b-5c6dd98a1f19 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:32.767964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f437661-ba3c-487f-948b-5c6dd98a1f19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:32.777372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f437661-ba3c-487f-948b-5c6dd98a1f19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:32.779191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f437661-ba3c-487f-948b-5c6dd98a1f19 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:32.790634 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 715/1409] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:53.887039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100c2b-cd18-4f96-9a33-d151094292bb None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:53.887657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100c2b-cd18-4f96-9a33-d151094292bb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:53.887657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100c2b-cd18-4f96-9a33-d151094292bb None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:53.888939 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 695/1410] 10.222.0.44 () {54 vars in 918 bytes} [Thu May 5 15:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:53.894670 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57bddc-885c-4bb0-8233-5fc546be491e None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:53.895154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57bddc-885c-4bb0-8233-5fc546be491e None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:53.895263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57bddc-885c-4bb0-8233-5fc546be491e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:53.914213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-cd57bddc-885c-4bb0-8233-5fc546be491e None None] MFA Rules not processed for user `db978c3b147c4b259b623e8c64e7c13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:53.915431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-cd57bddc-885c-4bb0-8233-5fc546be491e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:53.924179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 716/1411] 10.222.0.44 () {58 vars in 1015 bytes} [Thu May 5 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:53.938351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbad39-8b56-4fe2-a6bb-fac7b7e50bb8 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:53.938640 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbad39-8b56-4fe2-a6bb-fac7b7e50bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:53.938916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbad39-8b56-4fe2-a6bb-fac7b7e50bb8 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:53.940268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 696/1412] 10.222.0.44 () {54 vars in 918 bytes} [Thu May 5 15:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:53.945016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467409c-d269-49ee-91cd-207f86ef3259 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:53.945303 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467409c-d269-49ee-91cd-207f86ef3259 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:53.945582 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467409c-d269-49ee-91cd-207f86ef3259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:53.963320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-1467409c-d269-49ee-91cd-207f86ef3259 None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:53.964431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1467409c-d269-49ee-91cd-207f86ef3259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:53.974271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 717/1413] 10.222.0.44 () {58 vars in 1015 bytes} [Thu May 5 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:56.666010 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e43822-a6d2-41e3-9e03-009bdf72027e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:56.666616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e43822-a6d2-41e3-9e03-009bdf72027e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:56.666616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e43822-a6d2-41e3-9e03-009bdf72027e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:56.667949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:56.673422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f0b42-0d53-4012-a128-d1355a0de869 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:56.673857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f0b42-0d53-4012-a128-d1355a0de869 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:56.673991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f0b42-0d53-4012-a128-d1355a0de869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:56.691858 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-f67f0b42-0d53-4012-a128-d1355a0de869 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:56.693027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-f67f0b42-0d53-4012-a128-d1355a0de869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:56.700838 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:56.743143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e43822-a6d2-41e3-9e03-009bdf72027e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:56.758472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e43822-a6d2-41e3-9e03-009bdf72027e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:56.763879 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bdf2d-dd79-4025-8877-e212ad36fe72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:56.765721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bdf2d-dd79-4025-8877-e212ad36fe72 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:56.766005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bdf2d-dd79-4025-8877-e212ad36fe72 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:56.766306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bdf2d-dd79-4025-8877-e212ad36fe72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:56.774448 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bdf2d-dd79-4025-8877-e212ad36fe72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:56.776023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bdf2d-dd79-4025-8877-e212ad36fe72 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:56.785595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 698/1416] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:58.102103 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9861e3a-9834-407c-96f6-81253d99f1ac None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:58.102687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9861e3a-9834-407c-96f6-81253d99f1ac None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:58.102687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9861e3a-9834-407c-96f6-81253d99f1ac None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:58.104008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:58.109881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e4a53-bd1d-40fc-a5de-42e9a4f04b42 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:58.110364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e4a53-bd1d-40fc-a5de-42e9a4f04b42 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:58.110464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e4a53-bd1d-40fc-a5de-42e9a4f04b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:58.128288 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-995e4a53-bd1d-40fc-a5de-42e9a4f04b42 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:58.129474 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-995e4a53-bd1d-40fc-a5de-42e9a4f04b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:58.137165 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:58.300685 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9861e3a-9834-407c-96f6-81253d99f1ac None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:58.314702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9861e3a-9834-407c-96f6-81253d99f1ac None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:58.320077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73587b79-a19c-44e1-83e2-c8805d039e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:58.320714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73587b79-a19c-44e1-83e2-c8805d039e11 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:58.320996 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73587b79-a19c-44e1-83e2-c8805d039e11 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:58.321269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73587b79-a19c-44e1-83e2-c8805d039e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:58.330068 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73587b79-a19c-44e1-83e2-c8805d039e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:58.331715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73587b79-a19c-44e1-83e2-c8805d039e11 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:58.340944 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 720/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:25:59.591051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0391fb5-20c7-4590-b7df-62309e2f8fbb None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:59.591632 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0391fb5-20c7-4590-b7df-62309e2f8fbb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:59.591632 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0391fb5-20c7-4590-b7df-62309e2f8fbb None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:59.593854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:25:59.598733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec49a-4f71-476d-a164-798d4a5623db None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:59.599211 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec49a-4f71-476d-a164-798d4a5623db None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:59.599320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec49a-4f71-476d-a164-798d4a5623db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:59.617758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e53ec49a-4f71-476d-a164-798d4a5623db None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:25:59.618993 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e53ec49a-4f71-476d-a164-798d4a5623db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:25:59.627203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:25:59.775685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0391fb5-20c7-4590-b7df-62309e2f8fbb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:25:59.790720 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0391fb5-20c7-4590-b7df-62309e2f8fbb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:25:59.796097 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead392ac-4522-42d4-b34c-2b81815e20fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:25:59.796734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead392ac-4522-42d4-b34c-2b81815e20fd service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:25:59.797271 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead392ac-4522-42d4-b34c-2b81815e20fd service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:25:59.797550 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead392ac-4522-42d4-b34c-2b81815e20fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:25:59.805591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead392ac-4522-42d4-b34c-2b81815e20fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:25:59.807191 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead392ac-4522-42d4-b34c-2b81815e20fd service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:25:59.816530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 701/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:01.062272 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86544f-3845-4cd5-a237-e9f6892bd764 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:01.062846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86544f-3845-4cd5-a237-e9f6892bd764 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:01.062846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86544f-3845-4cd5-a237-e9f6892bd764 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:01.064233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:01.069009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b221b-72a1-4055-b4a8-7df4893f618b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:01.069392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b221b-72a1-4055-b4a8-7df4893f618b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:01.069567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b221b-72a1-4055-b4a8-7df4893f618b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:01.087528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ef4b221b-72a1-4055-b4a8-7df4893f618b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:01.088712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ef4b221b-72a1-4055-b4a8-7df4893f618b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:01.096393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:01.250629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86544f-3845-4cd5-a237-e9f6892bd764 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:01.265142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86544f-3845-4cd5-a237-e9f6892bd764 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:01.270423 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33748166-25e1-4793-83f9-faefa36d35a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:01.271054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33748166-25e1-4793-83f9-faefa36d35a2 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:01.271335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33748166-25e1-4793-83f9-faefa36d35a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:01.271610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33748166-25e1-4793-83f9-faefa36d35a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:01.279430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33748166-25e1-4793-83f9-faefa36d35a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:01.281277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33748166-25e1-4793-83f9-faefa36d35a2 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:01.290363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 723/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:02.538879 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e4c12-7ad2-44ae-ae22-29cbfd42eac8 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:02.539415 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e4c12-7ad2-44ae-ae22-29cbfd42eac8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:02.539415 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e4c12-7ad2-44ae-ae22-29cbfd42eac8 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:02.540787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:02.546507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9caea-677b-4295-9e19-494556baa5c3 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:02.546954 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9caea-677b-4295-9e19-494556baa5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:02.547328 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9caea-677b-4295-9e19-494556baa5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:02.565001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-69c9caea-677b-4295-9e19-494556baa5c3 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:02.566172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-69c9caea-677b-4295-9e19-494556baa5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:02.573990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:02.723146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e4c12-7ad2-44ae-ae22-29cbfd42eac8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:02.737963 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e4c12-7ad2-44ae-ae22-29cbfd42eac8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:02.743319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eea428-7fe6-4af4-8fee-9f1edf57a33c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:02.743953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eea428-7fe6-4af4-8fee-9f1edf57a33c service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:02.744230 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eea428-7fe6-4af4-8fee-9f1edf57a33c service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:02.744533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eea428-7fe6-4af4-8fee-9f1edf57a33c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:02.752378 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eea428-7fe6-4af4-8fee-9f1edf57a33c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:02.754112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eea428-7fe6-4af4-8fee-9f1edf57a33c service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:02.763547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 704/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:04.117492 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb873f-4f2c-4e69-ba00-d3d6bf763663 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:04.118004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb873f-4f2c-4e69-ba00-d3d6bf763663 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:04.118134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb873f-4f2c-4e69-ba00-d3d6bf763663 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:04.119537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:04.127205 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a05f6-0cf7-450e-a372-c5e45eb699f8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:04.127205 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a05f6-0cf7-450e-a372-c5e45eb699f8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:04.127205 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a05f6-0cf7-450e-a372-c5e45eb699f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:04.144097 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ce9a05f6-0cf7-450e-a372-c5e45eb699f8 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:04.145299 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ce9a05f6-0cf7-450e-a372-c5e45eb699f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:04.153381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:04.303512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb873f-4f2c-4e69-ba00-d3d6bf763663 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:04.318082 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb873f-4f2c-4e69-ba00-d3d6bf763663 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:04.323434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ca770-1118-469c-abc0-8a7f7e9f3e0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:04.324064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ca770-1118-469c-abc0-8a7f7e9f3e0c service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:04.324345 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ca770-1118-469c-abc0-8a7f7e9f3e0c service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:04.324619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ca770-1118-469c-abc0-8a7f7e9f3e0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:04.332634 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ca770-1118-469c-abc0-8a7f7e9f3e0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:04.334197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ca770-1118-469c-abc0-8a7f7e9f3e0c service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:04.343280 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 726/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:05.620685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413995a-7df5-4134-9e21-c2c1132a992c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:05.621255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413995a-7df5-4134-9e21-c2c1132a992c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:05.621255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413995a-7df5-4134-9e21-c2c1132a992c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:05.622646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:05.627955 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01efe1-bd9c-4c44-8637-e755aa250ecc None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:05.628455 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01efe1-bd9c-4c44-8637-e755aa250ecc None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:05.628552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01efe1-bd9c-4c44-8637-e755aa250ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:05.647129 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-8b01efe1-bd9c-4c44-8637-e755aa250ecc None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:05.648349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8b01efe1-bd9c-4c44-8637-e755aa250ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:05.656257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:05.807096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413995a-7df5-4134-9e21-c2c1132a992c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:05.821796 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413995a-7df5-4134-9e21-c2c1132a992c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:05.827694 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51eb926-5790-486e-9538-bfed2d0e0a93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:05.828325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51eb926-5790-486e-9538-bfed2d0e0a93 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:05.832096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51eb926-5790-486e-9538-bfed2d0e0a93 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:05.832096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51eb926-5790-486e-9538-bfed2d0e0a93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:05.837159 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51eb926-5790-486e-9538-bfed2d0e0a93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:05.838758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51eb926-5790-486e-9538-bfed2d0e0a93 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:05.848113 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 707/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:07.287800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d164-8236-4160-a537-7989efde0908 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:07.288362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d164-8236-4160-a537-7989efde0908 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:07.288362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d164-8236-4160-a537-7989efde0908 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:07.289717 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:07.294893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b696-c840-4e55-8000-a463d3d8e4cb None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:07.295830 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b696-c840-4e55-8000-a463d3d8e4cb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:07.296399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b696-c840-4e55-8000-a463d3d8e4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:07.314157 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-97c3b696-c840-4e55-8000-a463d3d8e4cb None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:07.315366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-97c3b696-c840-4e55-8000-a463d3d8e4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:07.322955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:07.470678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7d164-8236-4160-a537-7989efde0908 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:07.485269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7d164-8236-4160-a537-7989efde0908 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:07.490716 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2b556-644f-4a74-8ce1-0c9c09cc9046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:07.491371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2b556-644f-4a74-8ce1-0c9c09cc9046 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:07.491689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2b556-644f-4a74-8ce1-0c9c09cc9046 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:07.491969 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2b556-644f-4a74-8ce1-0c9c09cc9046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:07.500767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2b556-644f-4a74-8ce1-0c9c09cc9046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:07.502368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2b556-644f-4a74-8ce1-0c9c09cc9046 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:07.511595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 729/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:08.843372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267681dd-b188-479f-b8af-5d5bd295498a None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:08.843953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267681dd-b188-479f-b8af-5d5bd295498a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:08.844052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267681dd-b188-479f-b8af-5d5bd295498a None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:08.845387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:08.850351 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b6844-2a7c-4201-af80-5bf447f93831 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:08.850749 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b6844-2a7c-4201-af80-5bf447f93831 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:08.850920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b6844-2a7c-4201-af80-5bf447f93831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:08.869064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ba5b6844-2a7c-4201-af80-5bf447f93831 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:08.870258 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ba5b6844-2a7c-4201-af80-5bf447f93831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:08.878827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:09.027765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267681dd-b188-479f-b8af-5d5bd295498a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:09.041572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267681dd-b188-479f-b8af-5d5bd295498a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:09.047617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0309e-383a-4d57-bfea-9d41f38849cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:09.048248 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0309e-383a-4d57-bfea-9d41f38849cb service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:09.048531 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0309e-383a-4d57-bfea-9d41f38849cb service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:09.048813 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0309e-383a-4d57-bfea-9d41f38849cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:09.056651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0309e-383a-4d57-bfea-9d41f38849cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:09.058225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0309e-383a-4d57-bfea-9d41f38849cb service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:09.068162 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 710/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:11.255919 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e59ce-fd4d-403b-a4fd-281d83212c7a None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:11.256487 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e59ce-fd4d-403b-a4fd-281d83212c7a None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:11.256487 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e59ce-fd4d-403b-a4fd-281d83212c7a None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:11.257851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:11.263111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5642-2559-4030-875f-d65e3d09a569 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:11.263534 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5642-2559-4030-875f-d65e3d09a569 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:11.263665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5642-2559-4030-875f-d65e3d09a569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:11.282168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bb5a5642-2559-4030-875f-d65e3d09a569 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:11.283368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bb5a5642-2559-4030-875f-d65e3d09a569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:11.290938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:11.328966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e59ce-fd4d-403b-a4fd-281d83212c7a None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:11.339605 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e59ce-fd4d-403b-a4fd-281d83212c7a None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:11.343105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bbcd0-affe-4fdc-aa8f-4d7f5dea314a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:11.344356 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bbcd0-affe-4fdc-aa8f-4d7f5dea314a service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:11.344634 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bbcd0-affe-4fdc-aa8f-4d7f5dea314a service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:11.344906 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bbcd0-affe-4fdc-aa8f-4d7f5dea314a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:11.353707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bbcd0-affe-4fdc-aa8f-4d7f5dea314a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:11.355158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bbcd0-affe-4fdc-aa8f-4d7f5dea314a service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:11.364458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 732/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:13.781857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a2b17-f344-420f-80bd-961c2f415e7a None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:13.782365 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a2b17-f344-420f-80bd-961c2f415e7a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:13.782472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a2b17-f344-420f-80bd-961c2f415e7a None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:13.783826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:13.789077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70265d8-2c9d-4ebd-986e-546a2ba33c36 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:13.789523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70265d8-2c9d-4ebd-986e-546a2ba33c36 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:13.789636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70265d8-2c9d-4ebd-986e-546a2ba33c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:13.807514 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e70265d8-2c9d-4ebd-986e-546a2ba33c36 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:13.808696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e70265d8-2c9d-4ebd-986e-546a2ba33c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:13.816950 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:13.855334 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a2b17-f344-420f-80bd-961c2f415e7a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:13.866093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a2b17-f344-420f-80bd-961c2f415e7a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:13.869567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac4e96-3d01-4b81-8bfd-c0e965b88985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:13.870195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac4e96-3d01-4b81-8bfd-c0e965b88985 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:13.870508 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac4e96-3d01-4b81-8bfd-c0e965b88985 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:13.870786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac4e96-3d01-4b81-8bfd-c0e965b88985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:13.880255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac4e96-3d01-4b81-8bfd-c0e965b88985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:13.881670 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac4e96-3d01-4b81-8bfd-c0e965b88985 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:13.891764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 713/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:16.519620 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220465-536f-4a6b-9f82-c9f259d0aaf2 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:16.520198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220465-536f-4a6b-9f82-c9f259d0aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:16.520198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220465-536f-4a6b-9f82-c9f259d0aaf2 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:16.521528 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:16.526701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca90e5a-0591-4357-b857-57b3e7a89212 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:16.527124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca90e5a-0591-4357-b857-57b3e7a89212 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:16.527267 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca90e5a-0591-4357-b857-57b3e7a89212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:16.545019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fca90e5a-0591-4357-b857-57b3e7a89212 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:16.546211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fca90e5a-0591-4357-b857-57b3e7a89212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:16.554435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:16.593191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43220465-536f-4a6b-9f82-c9f259d0aaf2 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:16.595490 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-43220465-536f-4a6b-9f82-c9f259d0aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:16.607945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43220465-536f-4a6b-9f82-c9f259d0aaf2 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:16.611444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7661b-3151-4845-8d20-c0db5de23c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:16.612071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7661b-3151-4845-8d20-c0db5de23c91 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:16.612349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7661b-3151-4845-8d20-c0db5de23c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:16.612620 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7661b-3151-4845-8d20-c0db5de23c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:16.621176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7661b-3151-4845-8d20-c0db5de23c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:16.622613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7661b-3151-4845-8d20-c0db5de23c91 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:16.632178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 735/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:19.031703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02db50-d09c-4136-8912-30f39c47741b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:19.032276 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02db50-d09c-4136-8912-30f39c47741b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:19.032276 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02db50-d09c-4136-8912-30f39c47741b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:19.033533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:19.038739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb33d33-5cf5-4387-beac-6021ec46b9ac None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:19.039174 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb33d33-5cf5-4387-beac-6021ec46b9ac None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:19.039284 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb33d33-5cf5-4387-beac-6021ec46b9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:19.056645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-9eb33d33-5cf5-4387-beac-6021ec46b9ac None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:19.057820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9eb33d33-5cf5-4387-beac-6021ec46b9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:19.066206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:19.104099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02db50-d09c-4136-8912-30f39c47741b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:19.114511 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02db50-d09c-4136-8912-30f39c47741b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:19.117904 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e0db4-a9cc-447d-ab9f-ea5cbf132486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:19.118561 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e0db4-a9cc-447d-ab9f-ea5cbf132486 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:19.118840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e0db4-a9cc-447d-ab9f-ea5cbf132486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:19.119110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e0db4-a9cc-447d-ab9f-ea5cbf132486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:19.128079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e0db4-a9cc-447d-ab9f-ea5cbf132486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:19.129482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e0db4-a9cc-447d-ab9f-ea5cbf132486 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:19.138437 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 716/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:21.480870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917abee-f3c9-4200-b02d-92195f054e7b None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:21.481414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917abee-f3c9-4200-b02d-92195f054e7b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:21.481528 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917abee-f3c9-4200-b02d-92195f054e7b None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:21.482920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:21.489392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff84c1-2751-46e7-b698-ca0868d74fe0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:21.489823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff84c1-2751-46e7-b698-ca0868d74fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:21.489958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff84c1-2751-46e7-b698-ca0868d74fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:21.508761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-38ff84c1-2751-46e7-b698-ca0868d74fe0 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:21.509954 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-38ff84c1-2751-46e7-b698-ca0868d74fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:21.518828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:21.557784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917abee-f3c9-4200-b02d-92195f054e7b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:21.568589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917abee-f3c9-4200-b02d-92195f054e7b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:21.572182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aacfb-c934-4614-b84f-f1a8be6e7fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:21.572819 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aacfb-c934-4614-b84f-f1a8be6e7fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:21.573104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aacfb-c934-4614-b84f-f1a8be6e7fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:21.573384 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aacfb-c934-4614-b84f-f1a8be6e7fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:21.582775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aacfb-c934-4614-b84f-f1a8be6e7fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:21.584194 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aacfb-c934-4614-b84f-f1a8be6e7fa5 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:21.594180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 738/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:23.997926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43478ba-03f9-44a8-b7cc-7bd31e179c87 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:23.998479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43478ba-03f9-44a8-b7cc-7bd31e179c87 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:23.998479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43478ba-03f9-44a8-b7cc-7bd31e179c87 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:23.999838 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:24.005216 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d8ad8-6581-462a-930f-4cacad5daa39 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:24.005632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d8ad8-6581-462a-930f-4cacad5daa39 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:24.005803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d8ad8-6581-462a-930f-4cacad5daa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:24.024626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-d03d8ad8-6581-462a-930f-4cacad5daa39 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:24.025814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d03d8ad8-6581-462a-930f-4cacad5daa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:24.034685 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:26:24.073289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43478ba-03f9-44a8-b7cc-7bd31e179c87 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:24.084358 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43478ba-03f9-44a8-b7cc-7bd31e179c87 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:24.087859 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47606b-c6ca-46a9-93c5-455a29824c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:24.088495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47606b-c6ca-46a9-93c5-455a29824c12 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:24.088805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47606b-c6ca-46a9-93c5-455a29824c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:24.089081 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47606b-c6ca-46a9-93c5-455a29824c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:24.098567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47606b-c6ca-46a9-93c5-455a29824c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:24.099994 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47606b-c6ca-46a9-93c5-455a29824c12 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:24.109483 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 719/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:26.415460 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce4e00-0aed-4bf3-99bc-1f6d8a76dfdb None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:26.416045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce4e00-0aed-4bf3-99bc-1f6d8a76dfdb None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:26.416045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce4e00-0aed-4bf3-99bc-1f6d8a76dfdb None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:26.417429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:26.423047 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f1c21-369c-42b8-bc35-e4ee584814c4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:26.423444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f1c21-369c-42b8-bc35-e4ee584814c4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:26.423598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f1c21-369c-42b8-bc35-e4ee584814c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:26.441364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5f3f1c21-369c-42b8-bc35-e4ee584814c4 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:26.442573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5f3f1c21-369c-42b8-bc35-e4ee584814c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:26.450093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:26.487137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce4e00-0aed-4bf3-99bc-1f6d8a76dfdb None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:26.497729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce4e00-0aed-4bf3-99bc-1f6d8a76dfdb None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:26.501880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585c65e-90c7-44bf-8d7f-9c5267502938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:26.502538 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c65e-90c7-44bf-8d7f-9c5267502938 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:26.502818 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c65e-90c7-44bf-8d7f-9c5267502938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:26.503091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c65e-90c7-44bf-8d7f-9c5267502938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:26.511857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585c65e-90c7-44bf-8d7f-9c5267502938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:26.513316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585c65e-90c7-44bf-8d7f-9c5267502938 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:26.523600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 741/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:28.808507 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd2590-4d63-42e0-961f-eafcc7890e65 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:28.809044 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd2590-4d63-42e0-961f-eafcc7890e65 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:28.809044 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd2590-4d63-42e0-961f-eafcc7890e65 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:28.810483 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:28.816232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08d369-1fd8-4c16-8ce7-ed2e5a1e724f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:28.816666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08d369-1fd8-4c16-8ce7-ed2e5a1e724f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:28.816791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08d369-1fd8-4c16-8ce7-ed2e5a1e724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:28.835064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ad08d369-1fd8-4c16-8ce7-ed2e5a1e724f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:28.836246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ad08d369-1fd8-4c16-8ce7-ed2e5a1e724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:28.844067 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:28.881212 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd2590-4d63-42e0-961f-eafcc7890e65 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:28.892156 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd2590-4d63-42e0-961f-eafcc7890e65 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:28.895839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20805b2-6cea-465e-b172-3a543a4f20ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:28.896481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20805b2-6cea-465e-b172-3a543a4f20ee service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:28.896764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20805b2-6cea-465e-b172-3a543a4f20ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:28.897040 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20805b2-6cea-465e-b172-3a543a4f20ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:28.905932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20805b2-6cea-465e-b172-3a543a4f20ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:28.907390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20805b2-6cea-465e-b172-3a543a4f20ee service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:28.916443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 722/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:26:31.185538 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e5321-5102-4e29-b3d7-772d3f9c3aa1 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:31.186074 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e5321-5102-4e29-b3d7-772d3f9c3aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:31.186074 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e5321-5102-4e29-b3d7-772d3f9c3aa1 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:31.187727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:26:31.192902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bc283-e202-4389-bc10-8e482415b58a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:31.193328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bc283-e202-4389-bc10-8e482415b58a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:31.193455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bc283-e202-4389-bc10-8e482415b58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:31.210796 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f12bc283-e202-4389-bc10-8e482415b58a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:31.211979 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f12bc283-e202-4389-bc10-8e482415b58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:31.220284 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:31.256597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e5321-5102-4e29-b3d7-772d3f9c3aa1 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:31.268758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e5321-5102-4e29-b3d7-772d3f9c3aa1 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:31.272213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85671c0f-d2dd-453d-bc7c-bd53635928f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:31.272851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85671c0f-d2dd-453d-bc7c-bd53635928f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:31.273133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85671c0f-d2dd-453d-bc7c-bd53635928f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:31.273407 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85671c0f-d2dd-453d-bc7c-bd53635928f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:31.283010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85671c0f-d2dd-453d-bc7c-bd53635928f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:31.284422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85671c0f-d2dd-453d-bc7c-bd53635928f1 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:31.293463 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 744/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:26:33.534392 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28989096-d2f0-4615-95bc-39f0c45123d5 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:33.534968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28989096-d2f0-4615-95bc-39f0c45123d5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:33.534968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28989096-d2f0-4615-95bc-39f0c45123d5 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:33.536343 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:26:33.541689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee393af0-7df3-4b6f-b8d4-85d763f353d8 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:33.542113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee393af0-7df3-4b6f-b8d4-85d763f353d8 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:33.542253 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee393af0-7df3-4b6f-b8d4-85d763f353d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:33.560089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ee393af0-7df3-4b6f-b8d4-85d763f353d8 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:26:33.561301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ee393af0-7df3-4b6f-b8d4-85d763f353d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:26:33.569086 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:26:33.605946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28989096-d2f0-4615-95bc-39f0c45123d5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:26:33.616267 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28989096-d2f0-4615-95bc-39f0c45123d5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:26:33.620089 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054be798-51f0-414d-aea0-c0753cbb68a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:26:33.620715 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054be798-51f0-414d-aea0-c0753cbb68a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:26:33.620994 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054be798-51f0-414d-aea0-c0753cbb68a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:26:33.621268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054be798-51f0-414d-aea0-c0753cbb68a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:26:33.629995 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054be798-51f0-414d-aea0-c0753cbb68a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:26:33.631661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054be798-51f0-414d-aea0-c0753cbb68a1 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:26:33.641662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 725/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:27:07.371257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7842b09-1fb9-4e8e-a519-fc7f4179a38b None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:07.371837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7842b09-1fb9-4e8e-a519-fc7f4179a38b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:07.371837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7842b09-1fb9-4e8e-a519-fc7f4179a38b None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:07.373072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 746/1471] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:07.378564 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc1582-bb1a-4f79-b9c6-a3218fd35136 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:07.379001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc1582-bb1a-4f79-b9c6-a3218fd35136 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:07.379120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc1582-bb1a-4f79-b9c6-a3218fd35136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:07.396840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1bfc1582-bb1a-4f79-b9c6-a3218fd35136 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:07.398031 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1bfc1582-bb1a-4f79-b9c6-a3218fd35136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:07.406765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 726/1472] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:27:07.453708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8659c-bb5f-448b-a766-21fc30ec5adb None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:07.453996 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8659c-bb5f-448b-a766-21fc30ec5adb None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:07.454274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8659c-bb5f-448b-a766-21fc30ec5adb None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:07.455649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 747/1473] 10.222.0.44 () {54 vars in 962 bytes} [Thu May 5 15:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:07.460447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d0917-0e5e-48dd-9d38-4988f791279e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:07.460734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d0917-0e5e-48dd-9d38-4988f791279e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:07.461011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d0917-0e5e-48dd-9d38-4988f791279e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:07.479532 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e43d0917-0e5e-48dd-9d38-4988f791279e None None] MFA Rules not processed for user `34f973b13dd44e609110f9a967ae1fed`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:07.480721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e43d0917-0e5e-48dd-9d38-4988f791279e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:07.487205 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 727/1474] 10.222.0.44 () {58 vars in 1059 bytes} [Thu May 5 15:27:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:27:07.494404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8659c-bb5f-448b-a766-21fc30ec5adb None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:07.505096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8659c-bb5f-448b-a766-21fc30ec5adb None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:07.508552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25650a1d-d7ab-4b3a-8fa0-e8c91dbecdae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f973b13dd44e609110f9a967ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:07.509174 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25650a1d-d7ab-4b3a-8fa0-e8c91dbecdae service glance] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:07.509455 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25650a1d-d7ab-4b3a-8fa0-e8c91dbecdae service glance] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:07.509729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25650a1d-d7ab-4b3a-8fa0-e8c91dbecdae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:07.519359 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25650a1d-d7ab-4b3a-8fa0-e8c91dbecdae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:07.520777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25650a1d-d7ab-4b3a-8fa0-e8c91dbecdae service glance] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:07.530916 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 748/1475] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:27:09.867487 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ada74-8962-45a6-87b2-0d6b903d2b10 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:09.868040 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ada74-8962-45a6-87b2-0d6b903d2b10 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:09.868040 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ada74-8962-45a6-87b2-0d6b903d2b10 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:09.869389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 728/1476] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:09.875040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b5662-7e63-483d-98a7-1f12e4ec3c8d None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:09.875474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b5662-7e63-483d-98a7-1f12e4ec3c8d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:09.875582 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b5662-7e63-483d-98a7-1f12e4ec3c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:09.893258 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-404b5662-7e63-483d-98a7-1f12e4ec3c8d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:09.894801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-404b5662-7e63-483d-98a7-1f12e4ec3c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:09.902320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 749/1477] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:27:09.924924 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ada74-8962-45a6-87b2-0d6b903d2b10 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:09.937799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ada74-8962-45a6-87b2-0d6b903d2b10 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:09.942336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c6d99-0748-4322-b13d-0bb534094160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:09.942986 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c6d99-0748-4322-b13d-0bb534094160 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:09.943271 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c6d99-0748-4322-b13d-0bb534094160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:09.943549 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c6d99-0748-4322-b13d-0bb534094160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:09.944274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c6d99-0748-4322-b13d-0bb534094160 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:09.946032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-244c6d99-0748-4322-b13d-0bb534094160 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:27:09.946032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 05 15:27:09.946032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: May 05 15:27:09.947211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c6d99-0748-4322-b13d-0bb534094160 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:09.966583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 729/1478] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 5 15:27:09 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:27:12.238778 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334974e-feb2-429d-a65b-19de23c813b5 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:12.239321 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334974e-feb2-429d-a65b-19de23c813b5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:12.239321 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334974e-feb2-429d-a65b-19de23c813b5 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:12.240684 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 750/1479] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:12.245671 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcaea1-6ed6-4c3f-acac-70717a573cf1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:12.246072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcaea1-6ed6-4c3f-acac-70717a573cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:12.246258 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcaea1-6ed6-4c3f-acac-70717a573cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:12.265266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-84bcaea1-6ed6-4c3f-acac-70717a573cf1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:12.266496 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-84bcaea1-6ed6-4c3f-acac-70717a573cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:12.274471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 730/1480] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:27:12.316688 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334974e-feb2-429d-a65b-19de23c813b5 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:12.331492 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334974e-feb2-429d-a65b-19de23c813b5 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:12.337037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2caa7-bcd5-4aa1-9471-ebbe925228e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:12.337697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2caa7-bcd5-4aa1-9471-ebbe925228e4 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:12.337973 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2caa7-bcd5-4aa1-9471-ebbe925228e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:12.338241 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2caa7-bcd5-4aa1-9471-ebbe925228e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:12.346274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2caa7-bcd5-4aa1-9471-ebbe925228e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:12.347851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2caa7-bcd5-4aa1-9471-ebbe925228e4 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:12.356899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 751/1481] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:27:14.778249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b327e-0427-4b87-b4b9-d1b379acdcf6 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:14.778804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b327e-0427-4b87-b4b9-d1b379acdcf6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:14.778924 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b327e-0427-4b87-b4b9-d1b379acdcf6 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:14.781377 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 731/1482] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:14.786675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396071-26a2-439f-b2ff-006e7783c4fc None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:14.787139 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396071-26a2-439f-b2ff-006e7783c4fc None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:14.787313 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396071-26a2-439f-b2ff-006e7783c4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:14.804984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-76396071-26a2-439f-b2ff-006e7783c4fc None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:14.806164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-76396071-26a2-439f-b2ff-006e7783c4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:14.813804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 752/1483] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:27:14.849619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b327e-0427-4b87-b4b9-d1b379acdcf6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:14.860112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b327e-0427-4b87-b4b9-d1b379acdcf6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:14.863574 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea2c8e-81da-49d4-aabe-2223ae8d0b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:14.864203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea2c8e-81da-49d4-aabe-2223ae8d0b6f service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:14.864481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea2c8e-81da-49d4-aabe-2223ae8d0b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:14.864752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea2c8e-81da-49d4-aabe-2223ae8d0b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:14.873326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea2c8e-81da-49d4-aabe-2223ae8d0b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:14.874899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea2c8e-81da-49d4-aabe-2223ae8d0b6f service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:14.884005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 732/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:27:17.233073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129ca11-cd59-4461-b0aa-38c9ad1fe938 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:17.233656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129ca11-cd59-4461-b0aa-38c9ad1fe938 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:17.233656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129ca11-cd59-4461-b0aa-38c9ad1fe938 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:17.235021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 753/1485] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:17.240091 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d582f6-4fbe-4823-9331-9563aa39d8f6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:17.240530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d582f6-4fbe-4823-9331-9563aa39d8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:17.240644 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d582f6-4fbe-4823-9331-9563aa39d8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:17.257918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d5d582f6-4fbe-4823-9331-9563aa39d8f6 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:17.259186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d5d582f6-4fbe-4823-9331-9563aa39d8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:17.267531 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 733/1486] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:27:17.305858 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129ca11-cd59-4461-b0aa-38c9ad1fe938 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:17.316446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129ca11-cd59-4461-b0aa-38c9ad1fe938 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:17.319880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f75ab-f1f1-443a-90b5-25aa46353406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:17.320509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f75ab-f1f1-443a-90b5-25aa46353406 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:17.320786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f75ab-f1f1-443a-90b5-25aa46353406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:17.321057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f75ab-f1f1-443a-90b5-25aa46353406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:17.330233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f75ab-f1f1-443a-90b5-25aa46353406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:17.331667 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f75ab-f1f1-443a-90b5-25aa46353406 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:17.340765 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 754/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:27:19.731205 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b635a2-bb7b-4b45-9703-e446ce10f69c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:19.731772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b635a2-bb7b-4b45-9703-e446ce10f69c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:19.731772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b635a2-bb7b-4b45-9703-e446ce10f69c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:19.733346 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 734/1488] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:19.738650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4af47-0a67-40c4-b287-abda3f506ac4 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:19.739058 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4af47-0a67-40c4-b287-abda3f506ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:19.739268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4af47-0a67-40c4-b287-abda3f506ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:19.757120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-f5d4af47-0a67-40c4-b287-abda3f506ac4 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:19.758325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-f5d4af47-0a67-40c4-b287-abda3f506ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:19.767848 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 755/1489] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:27:19.807162 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b635a2-bb7b-4b45-9703-e446ce10f69c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:19.818118 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b635a2-bb7b-4b45-9703-e446ce10f69c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:19.821569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef67c43-f54b-423a-bdd7-71eabc87ad69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:19.822196 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef67c43-f54b-423a-bdd7-71eabc87ad69 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:19.822505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef67c43-f54b-423a-bdd7-71eabc87ad69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:19.822781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef67c43-f54b-423a-bdd7-71eabc87ad69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:19.832098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef67c43-f54b-423a-bdd7-71eabc87ad69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:19.833506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef67c43-f54b-423a-bdd7-71eabc87ad69 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:19.842593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 735/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:27:22.442889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9da0c-426c-40ca-a5a1-272b30bd6c0e None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:22.443493 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9da0c-426c-40ca-a5a1-272b30bd6c0e None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:22.443493 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9da0c-426c-40ca-a5a1-272b30bd6c0e None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:22.444811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 756/1491] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 5 15:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:22.449971 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d06d6-228e-4bdc-a93f-f7a54dfc9e74 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:22.450398 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d06d6-228e-4bdc-a93f-f7a54dfc9e74 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:22.450560 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d06d6-228e-4bdc-a93f-f7a54dfc9e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:22.469024 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-167d06d6-228e-4bdc-a93f-f7a54dfc9e74 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:22.470212 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-167d06d6-228e-4bdc-a93f-f7a54dfc9e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:22.478133 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 736/1492] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 5 15:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:27:22.516646 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9da0c-426c-40ca-a5a1-272b30bd6c0e None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:22.527161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9da0c-426c-40ca-a5a1-272b30bd6c0e None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:22.531429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eba7ec-0068-4b83-b484-ee1a717dc567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:22.532071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eba7ec-0068-4b83-b484-ee1a717dc567 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:22.532358 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eba7ec-0068-4b83-b484-ee1a717dc567 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:22.532639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eba7ec-0068-4b83-b484-ee1a717dc567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:22.541615 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eba7ec-0068-4b83-b484-ee1a717dc567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:22.543080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eba7ec-0068-4b83-b484-ee1a717dc567 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:22.552780 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 757/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:28:58.844527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775348-f172-4aea-a8dc-3ae6556bfead None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.845088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775348-f172-4aea-a8dc-3ae6556bfead None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.845198 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775348-f172-4aea-a8dc-3ae6556bfead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.862739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2b775348-f172-4aea-a8dc-3ae6556bfead None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:58.863914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2b775348-f172-4aea-a8dc-3ae6556bfead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:58.871660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 737/1494] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:28:58.879380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cca9d-1dc6-412d-a5dc-538266fbdf3a None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.879839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cca9d-1dc6-412d-a5dc-538266fbdf3a None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.879976 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cca9d-1dc6-412d-a5dc-538266fbdf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.898177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b01cca9d-1dc6-412d-a5dc-538266fbdf3a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:58.899389 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b01cca9d-1dc6-412d-a5dc-538266fbdf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:58.908359 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 758/1495] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:28:58.912905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775348-f172-4aea-a8dc-3ae6556bfead None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:58.922520 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775348-f172-4aea-a8dc-3ae6556bfead None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:58.927178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bd3bb-7a12-40d1-8d43-d703ea39b3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:58.927823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd3bb-7a12-40d1-8d43-d703ea39b3ee admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.928098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd3bb-7a12-40d1-8d43-d703ea39b3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.928408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd3bb-7a12-40d1-8d43-d703ea39b3ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.929113 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bd3bb-7a12-40d1-8d43-d703ea39b3ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:58.929416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bd3bb-7a12-40d1-8d43-d703ea39b3ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:58.930451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-620bd3bb-7a12-40d1-8d43-d703ea39b3ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 15:28:58.930451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 05 15:28:58.930451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: May 05 15:28:58.931323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bd3bb-7a12-40d1-8d43-d703ea39b3ee admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:58.942460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 738/1496] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:58.951454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cca9d-1dc6-412d-a5dc-538266fbdf3a None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:58.960382 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cca9d-1dc6-412d-a5dc-538266fbdf3a None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:58.965885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acac8c-7b18-4bbc-962e-73697db238a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:58.966572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acac8c-7b18-4bbc-962e-73697db238a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.966858 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acac8c-7b18-4bbc-962e-73697db238a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.967133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acac8c-7b18-4bbc-962e-73697db238a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.967815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acac8c-7b18-4bbc-962e-73697db238a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:58.969553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: WARNING py.warnings [None req-31acac8c-7b18-4bbc-962e-73697db238a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:28:58.969553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: warnings.warn(msg) May 05 15:28:58.969553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: May 05 15:28:58.970791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acac8c-7b18-4bbc-962e-73697db238a1 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:59.205064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 759/1497] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:28:58 2022] POST /identity/v3/projects => generated 375 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:28:59.209374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bd3bb-7a12-40d1-8d43-d703ea39b3ee admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:59.219744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bd3bb-7a12-40d1-8d43-d703ea39b3ee admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:59.276118 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a0715-e3bd-480b-a0a1-5cf4a3347644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:59.276820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a0715-e3bd-480b-a0a1-5cf4a3347644 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:59.277229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a0715-e3bd-480b-a0a1-5cf4a3347644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:59.277509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a0715-e3bd-480b-a0a1-5cf4a3347644 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:59.278188 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a0715-e3bd-480b-a0a1-5cf4a3347644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:59.279229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-378a0715-e3bd-480b-a0a1-5cf4a3347644 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:28:59.279229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 05 15:28:59.279229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: May 05 15:28:59.280432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a0715-e3bd-480b-a0a1-5cf4a3347644 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:59.385436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 739/1498] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:28:59 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:28:59.389781 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acac8c-7b18-4bbc-962e-73697db238a1 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:59.399745 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acac8c-7b18-4bbc-962e-73697db238a1 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:59.404432 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce46916-7cb4-45e4-bb3f-0fc8887ce412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:59.405097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce46916-7cb4-45e4-bb3f-0fc8887ce412 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:59.405427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce46916-7cb4-45e4-bb3f-0fc8887ce412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:59.405689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce46916-7cb4-45e4-bb3f-0fc8887ce412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:59.406454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce46916-7cb4-45e4-bb3f-0fc8887ce412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:59.407583 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: WARNING py.warnings [None req-fce46916-7cb4-45e4-bb3f-0fc8887ce412 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 15:28:59.407583 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: warnings.warn(msg) May 05 15:28:59.407583 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: May 05 15:28:59.408464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce46916-7cb4-45e4-bb3f-0fc8887ce412 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:59.421689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 760/1499] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:28:59.425784 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a0715-e3bd-480b-a0a1-5cf4a3347644 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:59.436082 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a0715-e3bd-480b-a0a1-5cf4a3347644 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:59.440653 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58d7eb-8418-434a-b9f6-83135da6f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:59.441305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58d7eb-8418-434a-b9f6-83135da6f9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:59.441588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58d7eb-8418-434a-b9f6-83135da6f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:59.441867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58d7eb-8418-434a-b9f6-83135da6f9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:59.442640 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58d7eb-8418-434a-b9f6-83135da6f9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:59.443650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-4b58d7eb-8418-434a-b9f6-83135da6f9b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 15:28:59.443650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 05 15:28:59.443650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: May 05 15:28:59.444543 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58d7eb-8418-434a-b9f6-83135da6f9b2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:59.457564 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 740/1500] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:28:59.461794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce46916-7cb4-45e4-bb3f-0fc8887ce412 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:59.471579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce46916-7cb4-45e4-bb3f-0fc8887ce412 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:59.476067 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46645-7f5f-4aa7-9948-69e9d2a29581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:59.476934 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46645-7f5f-4aa7-9948-69e9d2a29581 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:59.477216 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46645-7f5f-4aa7-9948-69e9d2a29581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:59.477489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46645-7f5f-4aa7-9948-69e9d2a29581 admin admin] PATH_INFO: `/v3/projects/d7683117cf2747aabb4196a61d9249ae/users/c7db6be908914a449c7e7bcae20331fb/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:59.492332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac46645-7f5f-4aa7-9948-69e9d2a29581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7683117cf2747aabb4196a61d9249ae, user_id=c7db6be908914a449c7e7bcae20331fb, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:59.493363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: WARNING py.warnings [None req-dac46645-7f5f-4aa7-9948-69e9d2a29581 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:28:59.493363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: warnings.warn(msg) May 05 15:28:59.493363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: May 05 15:28:59.495341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac46645-7f5f-4aa7-9948-69e9d2a29581 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:59.568254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 761/1501] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:28:59 2022] PUT /identity/v3/projects/d7683117cf2747aabb4196a61d9249ae/users/c7db6be908914a449c7e7bcae20331fb/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:59.579839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c563c49-1b18-46f5-a89c-2368fc15a23f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:59.580239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c563c49-1b18-46f5-a89c-2368fc15a23f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:59.580522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c563c49-1b18-46f5-a89c-2368fc15a23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:59.607617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1c563c49-1b18-46f5-a89c-2368fc15a23f None None] MFA Rules not processed for user `c7db6be908914a449c7e7bcae20331fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:59.608825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1c563c49-1b18-46f5-a89c-2368fc15a23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:59.670430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 741/1502] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:28:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:28:59.681343 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46645-7f5f-4aa7-9948-69e9d2a29581 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:59.750975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46645-7f5f-4aa7-9948-69e9d2a29581 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:59.756539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db57ea-6983-4aab-be2f-b8be5a772f39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:59.757208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db57ea-6983-4aab-be2f-b8be5a772f39 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:59.757495 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db57ea-6983-4aab-be2f-b8be5a772f39 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:59.757776 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db57ea-6983-4aab-be2f-b8be5a772f39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:59.765823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db57ea-6983-4aab-be2f-b8be5a772f39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:59.767485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db57ea-6983-4aab-be2f-b8be5a772f39 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:59.776147 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 762/1503] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:28:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:28:59.847735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2aeabb-9102-4410-b892-6819173f41f4 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:59.848150 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2aeabb-9102-4410-b892-6819173f41f4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:59.848322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2aeabb-9102-4410-b892-6819173f41f4 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:59.849593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 742/1504] 10.222.0.44 () {52 vars in 829 bytes} [Thu May 5 15:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:59.853161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db57ea-6983-4aab-be2f-b8be5a772f39 service nova] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:59.912851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db57ea-6983-4aab-be2f-b8be5a772f39 service nova] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:59.918178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:59.919184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:59.919464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:59.919736 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] PATH_INFO: `/v3/users/c7db6be908914a449c7e7bcae20331fb` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:59.920934 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7db6be908914a449c7e7bcae20331fb)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:59.921936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: WARNING py.warnings [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:28:59.921936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: warnings.warn(msg) May 05 15:28:59.921936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: May 05 15:28:59.923183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:00.140377 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7db6be908914a449c7e7bcae20331fb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:29:00.153048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7db6be908914a449c7e7bcae20331fb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:29:00.247447 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7db6be908914a449c7e7bcae20331fb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:29:00.248092 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7db6be908914a449c7e7bcae20331fb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:29:00.266748 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7db6be908914a449c7e7bcae20331fb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:29:00.272616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 763/1505] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:28:59 2022] DELETE /identity/v3/users/c7db6be908914a449c7e7bcae20331fb => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:29:00.277858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99fc7d-c07c-4463-ba0c-caa48dea2afc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:00.281457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99fc7d-c07c-4463-ba0c-caa48dea2afc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:00.281457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99fc7d-c07c-4463-ba0c-caa48dea2afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:00.295566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1f99fc7d-c07c-4463-ba0c-caa48dea2afc None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:00.296743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1f99fc7d-c07c-4463-ba0c-caa48dea2afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:00.353389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 743/1506] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:29:00.362961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:00.364347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:00.419733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818e4b8-0b5a-4595-bb05-46c2446d848f admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:00.423295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8553e-ec17-4280-9a66-eb3edf38f69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:00.424190 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8553e-ec17-4280-9a66-eb3edf38f69f service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:00.424470 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8553e-ec17-4280-9a66-eb3edf38f69f service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:00.424743 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8553e-ec17-4280-9a66-eb3edf38f69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:00.433353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8553e-ec17-4280-9a66-eb3edf38f69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:00.434874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8553e-ec17-4280-9a66-eb3edf38f69f service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:00.444049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 764/1507] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:29:00.936087 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99fc7d-c07c-4463-ba0c-caa48dea2afc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:00.938570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1f99fc7d-c07c-4463-ba0c-caa48dea2afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:00.951017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99fc7d-c07c-4463-ba0c-caa48dea2afc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:00.955591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fddd1-5ced-4766-9118-d42d92870231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:00.956495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fddd1-5ced-4766-9118-d42d92870231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:00.956779 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fddd1-5ced-4766-9118-d42d92870231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:00.957056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fddd1-5ced-4766-9118-d42d92870231 admin admin] PATH_INFO: `/v3/projects/d7683117cf2747aabb4196a61d9249ae` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:00.958555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fddd1-5ced-4766-9118-d42d92870231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7683117cf2747aabb4196a61d9249ae)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:00.959575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-8f4fddd1-5ced-4766-9118-d42d92870231 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:29:00.959575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 05 15:29:00.959575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: May 05 15:29:00.960896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fddd1-5ced-4766-9118-d42d92870231 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:01.087675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8f4fddd1-5ced-4766-9118-d42d92870231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7683117cf2747aabb4196a61d9249ae', 'request_id': 'req-8f4fddd1-5ced-4766-9118-d42d92870231'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:29:01.101500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8f4fddd1-5ced-4766-9118-d42d92870231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7683117cf2747aabb4196a61d9249ae', 'request_id': 'req-8f4fddd1-5ced-4766-9118-d42d92870231'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:29:01.185495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8f4fddd1-5ced-4766-9118-d42d92870231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7683117cf2747aabb4196a61d9249ae', 'request_id': 'req-8f4fddd1-5ced-4766-9118-d42d92870231'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:29:01.196184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8f4fddd1-5ced-4766-9118-d42d92870231 admin admin] The token cache is being invalidate because project d7683117cf2747aabb4196a61d9249ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:29:01.196472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8f4fddd1-5ced-4766-9118-d42d92870231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:29:01.197190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8f4fddd1-5ced-4766-9118-d42d92870231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:29:01.199279 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 744/1508] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:29:00 2022] DELETE /identity/v3/projects/d7683117cf2747aabb4196a61d9249ae => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:45.101567 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed553a-11b7-44e2-97c3-76ba0202f27b None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:45.102133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed553a-11b7-44e2-97c3-76ba0202f27b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:45.102133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed553a-11b7-44e2-97c3-76ba0202f27b None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:45.103440 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 765/1509] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:45.108628 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f434b-c78d-4dd5-bda5-546ddebc3eba None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:45.109093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f434b-c78d-4dd5-bda5-546ddebc3eba None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:45.109201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f434b-c78d-4dd5-bda5-546ddebc3eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:45.126970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-329f434b-c78d-4dd5-bda5-546ddebc3eba None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:45.128181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-329f434b-c78d-4dd5-bda5-546ddebc3eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:45.188643 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 745/1510] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:45.345633 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed553a-11b7-44e2-97c3-76ba0202f27b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:45.347370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9bed553a-11b7-44e2-97c3-76ba0202f27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:45.419737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed553a-11b7-44e2-97c3-76ba0202f27b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:45.425506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c6005-c753-40cf-92a3-0b54bf50b203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:45.426150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c6005-c753-40cf-92a3-0b54bf50b203 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:45.426464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c6005-c753-40cf-92a3-0b54bf50b203 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:45.426739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c6005-c753-40cf-92a3-0b54bf50b203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:45.435544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c6005-c753-40cf-92a3-0b54bf50b203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:45.437108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c6005-c753-40cf-92a3-0b54bf50b203 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:45.446574 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 766/1511] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:45.679667 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b9bde-c8c6-4167-b900-90ea9780fbe3 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:45.679880 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b9bde-c8c6-4167-b900-90ea9780fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:45.680166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b9bde-c8c6-4167-b900-90ea9780fbe3 None None] PATH_INFO: `/v3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:45.681550 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 746/1512] 10.222.0.49 () {54 vars in 925 bytes} [Thu May 5 15:30:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:45.688669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3b28-22e9-4a72-9db4-63d0854f32df None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:45.688966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3b28-22e9-4a72-9db4-63d0854f32df None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:45.689252 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3b28-22e9-4a72-9db4-63d0854f32df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:45.718521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-80bd3b28-22e9-4a72-9db4-63d0854f32df None None] MFA Rules not processed for user `db978c3b147c4b259b623e8c64e7c13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:45.720841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-80bd3b28-22e9-4a72-9db4-63d0854f32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:45.791595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 767/1513] 10.222.0.49 () {58 vars in 1015 bytes} [Thu May 5 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:46.757538 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931313b6-1f5c-45a1-863c-92aa79a2bfbf None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:46.758068 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931313b6-1f5c-45a1-863c-92aa79a2bfbf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:46.758068 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931313b6-1f5c-45a1-863c-92aa79a2bfbf None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:46.759621 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 747/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:46.764642 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857709f2-ad2f-48be-8642-3ba3a85ec735 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:46.765108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857709f2-ad2f-48be-8642-3ba3a85ec735 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:46.765239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857709f2-ad2f-48be-8642-3ba3a85ec735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:46.782702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-857709f2-ad2f-48be-8642-3ba3a85ec735 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:46.783892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-857709f2-ad2f-48be-8642-3ba3a85ec735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:46.791593 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 768/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:46.942882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931313b6-1f5c-45a1-863c-92aa79a2bfbf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:46.956856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931313b6-1f5c-45a1-863c-92aa79a2bfbf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:46.962120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02564f-c225-4b8d-b722-dac26b67badb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:46.962779 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02564f-c225-4b8d-b722-dac26b67badb service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:46.963065 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02564f-c225-4b8d-b722-dac26b67badb service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:46.963342 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02564f-c225-4b8d-b722-dac26b67badb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:46.972130 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02564f-c225-4b8d-b722-dac26b67badb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:46.973724 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02564f-c225-4b8d-b722-dac26b67badb service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:46.983563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 748/1516] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:30:49.791933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37af5f-cea5-437b-9240-96d626d990e3 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:49.792979 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37af5f-cea5-437b-9240-96d626d990e3 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:49.792979 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37af5f-cea5-437b-9240-96d626d990e3 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:49.794640 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 769/1517] 10.222.0.44 () {54 vars in 960 bytes} [Thu May 5 15:30:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:49.799912 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736933f6-0d53-42af-8294-5dd3ec111f0d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:49.800372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736933f6-0d53-42af-8294-5dd3ec111f0d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:49.800475 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736933f6-0d53-42af-8294-5dd3ec111f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:49.820576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-736933f6-0d53-42af-8294-5dd3ec111f0d None None] MFA Rules not processed for user `db978c3b147c4b259b623e8c64e7c13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:49.821847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-736933f6-0d53-42af-8294-5dd3ec111f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:49.830984 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 749/1518] 10.222.0.44 () {58 vars in 1057 bytes} [Thu May 5 15:30:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:49.838521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37af5f-cea5-437b-9240-96d626d990e3 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:49.852168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37af5f-cea5-437b-9240-96d626d990e3 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:49.858138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66fe92-a187-4f8c-b45c-b580ed608cc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db978c3b147c4b259b623e8c64e7c13a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:49.858826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66fe92-a187-4f8c-b45c-b580ed608cc7 service placement] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:49.859111 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66fe92-a187-4f8c-b45c-b580ed608cc7 service placement] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:49.859388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66fe92-a187-4f8c-b45c-b580ed608cc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:49.867683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66fe92-a187-4f8c-b45c-b580ed608cc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:49.869273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66fe92-a187-4f8c-b45c-b580ed608cc7 service placement] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:49.882326 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 770/1519] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:30:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:30:58.655919 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5dd1f-eaa6-45a8-9d63-4fc8abcf1ba3 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.656527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5dd1f-eaa6-45a8-9d63-4fc8abcf1ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.656527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5dd1f-eaa6-45a8-9d63-4fc8abcf1ba3 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.657837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 750/1520] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:58.662604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ff3ca-9609-46ce-9591-74ada485a1f8 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.663054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ff3ca-9609-46ce-9591-74ada485a1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.663158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ff3ca-9609-46ce-9591-74ada485a1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.681754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-601ff3ca-9609-46ce-9591-74ada485a1f8 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:58.683632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-601ff3ca-9609-46ce-9591-74ada485a1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:58.691287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 771/1521] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:30:58.852576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5dd1f-eaa6-45a8-9d63-4fc8abcf1ba3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:58.867975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5dd1f-eaa6-45a8-9d63-4fc8abcf1ba3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:58.874463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd30f7-4416-42dd-8fe7-eaa6757f3944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:58.875094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd30f7-4416-42dd-8fe7-eaa6757f3944 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.875374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd30f7-4416-42dd-8fe7-eaa6757f3944 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.875649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd30f7-4416-42dd-8fe7-eaa6757f3944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.883629 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd30f7-4416-42dd-8fe7-eaa6757f3944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:58.885407 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd30f7-4416-42dd-8fe7-eaa6757f3944 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:58.895142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 751/1522] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:00.124196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa6493-4813-4a90-9c27-f9f7304962be None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.124723 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa6493-4813-4a90-9c27-f9f7304962be None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.124723 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa6493-4813-4a90-9c27-f9f7304962be None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:00.126050 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 772/1523] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:31:00.130758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db46a4-2953-4b5d-8dab-70de1844446a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.131186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db46a4-2953-4b5d-8dab-70de1844446a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.131325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db46a4-2953-4b5d-8dab-70de1844446a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:00.149493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-69db46a4-2953-4b5d-8dab-70de1844446a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:00.150748 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-69db46a4-2953-4b5d-8dab-70de1844446a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:00.159639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 752/1524] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:00.309618 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa6493-4813-4a90-9c27-f9f7304962be None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:00.324228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa6493-4813-4a90-9c27-f9f7304962be None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:00.329495 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552d097-ef97-4e60-8cd3-90c1021f4d5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:00.330131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552d097-ef97-4e60-8cd3-90c1021f4d5a service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.330456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552d097-ef97-4e60-8cd3-90c1021f4d5a service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.330734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552d097-ef97-4e60-8cd3-90c1021f4d5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:00.338669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552d097-ef97-4e60-8cd3-90c1021f4d5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:00.341166 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552d097-ef97-4e60-8cd3-90c1021f4d5a service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:00.350306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 773/1525] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:04.529224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519adc1-2a91-43a3-aeef-c0f663caec0b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:04.529771 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519adc1-2a91-43a3-aeef-c0f663caec0b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:04.529771 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519adc1-2a91-43a3-aeef-c0f663caec0b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:04.531137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 753/1526] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:31:04.536198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829293f5-4ff9-45ac-8fed-a9811648978b None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:04.537078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829293f5-4ff9-45ac-8fed-a9811648978b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:04.537581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829293f5-4ff9-45ac-8fed-a9811648978b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:04.556001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-829293f5-4ff9-45ac-8fed-a9811648978b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:04.557182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-829293f5-4ff9-45ac-8fed-a9811648978b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:04.565584 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 774/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:04.600861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519adc1-2a91-43a3-aeef-c0f663caec0b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:04.602594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b519adc1-2a91-43a3-aeef-c0f663caec0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:04.658090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519adc1-2a91-43a3-aeef-c0f663caec0b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:04.661662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efead1-dab6-4c10-9687-a363505361f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:04.662328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efead1-dab6-4c10-9687-a363505361f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:04.662620 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efead1-dab6-4c10-9687-a363505361f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:04.662903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efead1-dab6-4c10-9687-a363505361f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:04.672513 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efead1-dab6-4c10-9687-a363505361f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:04.673942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efead1-dab6-4c10-9687-a363505361f3 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:04.684044 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 754/1528] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:06.978668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca4b92-f6e8-47d1-9fd0-38710ca5e803 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:06.979239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca4b92-f6e8-47d1-9fd0-38710ca5e803 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:06.979239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca4b92-f6e8-47d1-9fd0-38710ca5e803 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:06.981165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 775/1529] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:31:06.986360 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f4d1c-bc7e-4cb5-be16-028c54793228 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:06.986784 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f4d1c-bc7e-4cb5-be16-028c54793228 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:06.986926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f4d1c-bc7e-4cb5-be16-028c54793228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:07.006472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4e1f4d1c-bc7e-4cb5-be16-028c54793228 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:07.007683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4e1f4d1c-bc7e-4cb5-be16-028c54793228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:07.016298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 755/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:31:07.052603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca4b92-f6e8-47d1-9fd0-38710ca5e803 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:07.054407 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-cdca4b92-f6e8-47d1-9fd0-38710ca5e803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:07.067491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca4b92-f6e8-47d1-9fd0-38710ca5e803 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:07.070993 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965cf5c-67fc-40f4-873f-cf850b4c3de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:07.077727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965cf5c-67fc-40f4-873f-cf850b4c3de8 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:07.077727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965cf5c-67fc-40f4-873f-cf850b4c3de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:07.077727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965cf5c-67fc-40f4-873f-cf850b4c3de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:07.083106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965cf5c-67fc-40f4-873f-cf850b4c3de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:07.084593 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965cf5c-67fc-40f4-873f-cf850b4c3de8 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:07.094663 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 776/1531] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:10.903915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175d475-06cb-4d27-aa91-349e279142f8 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:10.904475 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175d475-06cb-4d27-aa91-349e279142f8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:10.904475 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175d475-06cb-4d27-aa91-349e279142f8 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:10.905829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 756/1532] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:31:10.910903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e512a5b-5450-4111-9d45-153833b493f5 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:10.911364 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e512a5b-5450-4111-9d45-153833b493f5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:10.911481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e512a5b-5450-4111-9d45-153833b493f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:10.929243 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6e512a5b-5450-4111-9d45-153833b493f5 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:10.930447 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6e512a5b-5450-4111-9d45-153833b493f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:10.938816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 777/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:11.208024 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175d475-06cb-4d27-aa91-349e279142f8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:11.209686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d175d475-06cb-4d27-aa91-349e279142f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:11.265328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175d475-06cb-4d27-aa91-349e279142f8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:11.268815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d55a5-16ea-47cc-a083-8f5325c62b25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:11.269447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d55a5-16ea-47cc-a083-8f5325c62b25 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:11.269726 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d55a5-16ea-47cc-a083-8f5325c62b25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:11.270001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d55a5-16ea-47cc-a083-8f5325c62b25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:11.279274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d55a5-16ea-47cc-a083-8f5325c62b25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:11.280674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d55a5-16ea-47cc-a083-8f5325c62b25 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:11.289815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 757/1534] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:31:13.575927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bd330-3fc8-464b-91a7-13445c300bce None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.576451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bd330-3fc8-464b-91a7-13445c300bce None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.576451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bd330-3fc8-464b-91a7-13445c300bce None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.577774 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 778/1535] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:31:13.583058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef0f3d-8527-47c3-b654-b2bdf8563eb1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.583467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef0f3d-8527-47c3-b654-b2bdf8563eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.583634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef0f3d-8527-47c3-b654-b2bdf8563eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.602038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-74ef0f3d-8527-47c3-b654-b2bdf8563eb1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:13.603306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-74ef0f3d-8527-47c3-b654-b2bdf8563eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:13.611771 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 758/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:13.891419 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380c24b-5740-4999-8c0e-99c52d11f0e1 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.891710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380c24b-5740-4999-8c0e-99c52d11f0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.892081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380c24b-5740-4999-8c0e-99c52d11f0e1 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.893380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 779/1537] 10.222.0.44 () {54 vars in 963 bytes} [Thu May 5 15:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:31:13.898319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8e268-67f1-47df-b946-651f0ba2bc42 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.898613 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8e268-67f1-47df-b946-651f0ba2bc42 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.898898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8e268-67f1-47df-b946-651f0ba2bc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.917526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-69f8e268-67f1-47df-b946-651f0ba2bc42 None None] MFA Rules not processed for user `7fe051e3e2084f89a95a95aa4fd857df`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:13.918748 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-69f8e268-67f1-47df-b946-651f0ba2bc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:13.925293 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 759/1538] 10.222.0.44 () {58 vars in 1060 bytes} [Thu May 5 15:31:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:31:13.932844 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380c24b-5740-4999-8c0e-99c52d11f0e1 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:13.943205 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380c24b-5740-4999-8c0e-99c52d11f0e1 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:13.946652 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff3cc-93bf-4a96-ac34-2a730b34cdce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:13.947275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff3cc-93bf-4a96-ac34-2a730b34cdce service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:13.947556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff3cc-93bf-4a96-ac34-2a730b34cdce service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:13.947830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff3cc-93bf-4a96-ac34-2a730b34cdce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:13.956508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ff3cc-93bf-4a96-ac34-2a730b34cdce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:13.957914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ff3cc-93bf-4a96-ac34-2a730b34cdce service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:13.967735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 780/1539] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:43.167623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2b965-d45a-4fb4-acd6-8fc073b6e838 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:43.168806 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2b965-d45a-4fb4-acd6-8fc073b6e838 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:43.169255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2b965-d45a-4fb4-acd6-8fc073b6e838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:43.198850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-65d2b965-d45a-4fb4-acd6-8fc073b6e838 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:43.200428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-65d2b965-d45a-4fb4-acd6-8fc073b6e838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:43.209925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 760/1540] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:43.231940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65d96-e79a-42a0-80ca-412468e343b5 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:43.232473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65d96-e79a-42a0-80ca-412468e343b5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:43.232564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65d96-e79a-42a0-80ca-412468e343b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:43.259713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-4ca65d96-e79a-42a0-80ca-412468e343b5 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:43.260950 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4ca65d96-e79a-42a0-80ca-412468e343b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:43.271233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 781/1541] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:43.276379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2b965-d45a-4fb4-acd6-8fc073b6e838 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:43.290785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2b965-d45a-4fb4-acd6-8fc073b6e838 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:43.299476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1582e22-fbbc-48b3-af64-394d2476da92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:43.300413 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1582e22-fbbc-48b3-af64-394d2476da92 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:43.301197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1582e22-fbbc-48b3-af64-394d2476da92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:43.301683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1582e22-fbbc-48b3-af64-394d2476da92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:43.302652 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1582e22-fbbc-48b3-af64-394d2476da92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:43.303191 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1582e22-fbbc-48b3-af64-394d2476da92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:43.305167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1582e22-fbbc-48b3-af64-394d2476da92 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:43.320204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 761/1542] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:43.328924 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca65d96-e79a-42a0-80ca-412468e343b5 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:43.339088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca65d96-e79a-42a0-80ca-412468e343b5 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:43.346323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70e176-5eab-4a5f-a1f8-73fb4c7153a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:43.347010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70e176-5eab-4a5f-a1f8-73fb4c7153a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:43.347298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70e176-5eab-4a5f-a1f8-73fb4c7153a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:43.347579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70e176-5eab-4a5f-a1f8-73fb4c7153a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:43.348282 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70e176-5eab-4a5f-a1f8-73fb4c7153a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:43.350194 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70e176-5eab-4a5f-a1f8-73fb4c7153a8 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:43.448410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 782/1543] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:32:43 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:43.460047 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1582e22-fbbc-48b3-af64-394d2476da92 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:43.473884 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1582e22-fbbc-48b3-af64-394d2476da92 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:43.551964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfeec4a-702e-4a74-b029-a09a5b9458a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:43.553044 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfeec4a-702e-4a74-b029-a09a5b9458a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:43.553547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfeec4a-702e-4a74-b029-a09a5b9458a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:43.554073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfeec4a-702e-4a74-b029-a09a5b9458a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:43.555139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfeec4a-702e-4a74-b029-a09a5b9458a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:43.557420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfeec4a-702e-4a74-b029-a09a5b9458a7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:43.686008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 762/1544] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:32:43 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:43.690629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70e176-5eab-4a5f-a1f8-73fb4c7153a8 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:43.706064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70e176-5eab-4a5f-a1f8-73fb4c7153a8 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:43.713779 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66203a3-a325-4e37-be80-ebd6b14d6470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:43.713779 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66203a3-a325-4e37-be80-ebd6b14d6470 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:43.713779 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66203a3-a325-4e37-be80-ebd6b14d6470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:43.713779 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66203a3-a325-4e37-be80-ebd6b14d6470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:43.714181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66203a3-a325-4e37-be80-ebd6b14d6470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:43.715596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66203a3-a325-4e37-be80-ebd6b14d6470 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:43.733166 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 783/1545] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:43.738302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfeec4a-702e-4a74-b029-a09a5b9458a7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:43.759831 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfeec4a-702e-4a74-b029-a09a5b9458a7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:43.768374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf0c1f-b409-40a9-9329-2ac5bfd6412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:43.769318 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf0c1f-b409-40a9-9329-2ac5bfd6412b admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:43.769831 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf0c1f-b409-40a9-9329-2ac5bfd6412b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:43.770412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf0c1f-b409-40a9-9329-2ac5bfd6412b admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:43.771361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf0c1f-b409-40a9-9329-2ac5bfd6412b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:43.773205 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf0c1f-b409-40a9-9329-2ac5bfd6412b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:43.787738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 763/1546] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:43.793880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66203a3-a325-4e37-be80-ebd6b14d6470 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:43.808009 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66203a3-a325-4e37-be80-ebd6b14d6470 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:43.818148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da0546-405c-4592-9397-c8ca8fa5dc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:43.819217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da0546-405c-4592-9397-c8ca8fa5dc11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:43.819511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da0546-405c-4592-9397-c8ca8fa5dc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:43.819796 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da0546-405c-4592-9397-c8ca8fa5dc11 admin admin] PATH_INFO: `/v3/projects/a9c3dfa3088a4ce38b4253a372e380ee/users/d48921eb725f4d24ad667db4af315335/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:43.835809 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da0546-405c-4592-9397-c8ca8fa5dc11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c3dfa3088a4ce38b4253a372e380ee, user_id=d48921eb725f4d24ad667db4af315335, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:43.838737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da0546-405c-4592-9397-c8ca8fa5dc11 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:43.921068 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 784/1547] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:43 2022] PUT /identity/v3/projects/a9c3dfa3088a4ce38b4253a372e380ee/users/d48921eb725f4d24ad667db4af315335/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:43.935883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdc7dd-b7aa-4412-afcf-50ac052857d1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:43.937292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdc7dd-b7aa-4412-afcf-50ac052857d1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:43.937851 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdc7dd-b7aa-4412-afcf-50ac052857d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:43.977746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-06fdc7dd-b7aa-4412-afcf-50ac052857d1 None None] MFA Rules not processed for user `d48921eb725f4d24ad667db4af315335`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:43.979584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-06fdc7dd-b7aa-4412-afcf-50ac052857d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.060869 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 764/1548] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:44.092099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825fea-2a63-48e2-9895-92dd1a8aef85 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.092467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825fea-2a63-48e2-9895-92dd1a8aef85 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.092675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825fea-2a63-48e2-9895-92dd1a8aef85 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.094212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 785/1549] 10.222.0.44 () {54 vars in 960 bytes} [Thu May 5 15:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:44.100689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c2c6c-dabe-4097-800b-afe4898036f9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.101333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c2c6c-dabe-4097-800b-afe4898036f9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.101850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c2c6c-dabe-4097-800b-afe4898036f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.132252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ca4c2c6c-dabe-4097-800b-afe4898036f9 None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:44.133950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ca4c2c6c-dabe-4097-800b-afe4898036f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.134305 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933bbcd-8d75-4df3-8247-5486bcabb0ea None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.135106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933bbcd-8d75-4df3-8247-5486bcabb0ea None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.135391 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933bbcd-8d75-4df3-8247-5486bcabb0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.171236 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-4933bbcd-8d75-4df3-8247-5486bcabb0ea None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:44.172153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4933bbcd-8d75-4df3-8247-5486bcabb0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.281718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 786/1550] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:32:44.283930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5fcdf-85b2-4eda-a83e-e0b4e330f620 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.284225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5fcdf-85b2-4eda-a83e-e0b4e330f620 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.284511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5fcdf-85b2-4eda-a83e-e0b4e330f620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.301528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 765/1551] 10.222.0.44 () {58 vars in 1057 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:44.317396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56861bb-f876-41f6-b8d5-03d699b4ec3f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.318173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56861bb-f876-41f6-b8d5-03d699b4ec3f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.320595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-eae5fcdf-85b2-4eda-a83e-e0b4e330f620 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:44.321461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56861bb-f876-41f6-b8d5-03d699b4ec3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.322680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-eae5fcdf-85b2-4eda-a83e-e0b4e330f620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.342119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 787/1552] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:44.347702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5fcdf-85b2-4eda-a83e-e0b4e330f620 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:44.355506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c56861bb-f876-41f6-b8d5-03d699b4ec3f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:44.357066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c56861bb-f876-41f6-b8d5-03d699b4ec3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.368508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5fcdf-85b2-4eda-a83e-e0b4e330f620 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:44.381790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 766/1553] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:44.388662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db8b58-6f54-47a5-a22a-d98ac6f88072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:44.389347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db8b58-6f54-47a5-a22a-d98ac6f88072 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.389637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db8b58-6f54-47a5-a22a-d98ac6f88072 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.389916 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db8b58-6f54-47a5-a22a-d98ac6f88072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.391360 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1260a-1dc3-4cee-b638-c48f07803c41 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.391490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1260a-1dc3-4cee-b638-c48f07803c41 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.391711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1260a-1dc3-4cee-b638-c48f07803c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.402771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db8b58-6f54-47a5-a22a-d98ac6f88072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:44.405498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db8b58-6f54-47a5-a22a-d98ac6f88072 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:44.417978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 788/1554] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:44.417978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0357fb-03df-4825-b514-ed235b7f7544 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.418307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0357fb-03df-4825-b514-ed235b7f7544 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.418556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0357fb-03df-4825-b514-ed235b7f7544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.425206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-95d1260a-1dc3-4cee-b638-c48f07803c41 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:44.427179 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-95d1260a-1dc3-4cee-b638-c48f07803c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.440885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6c0357fb-03df-4825-b514-ed235b7f7544 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:44.442811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6c0357fb-03df-4825-b514-ed235b7f7544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.448162 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 767/1555] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:44.449649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1260a-1dc3-4cee-b638-c48f07803c41 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:44.463794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 789/1556] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:44.465514 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa7c4-c3c6-4a7d-8564-9c836f04762c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.465810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa7c4-c3c6-4a7d-8564-9c836f04762c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.466094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa7c4-c3c6-4a7d-8564-9c836f04762c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.473221 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1260a-1dc3-4cee-b638-c48f07803c41 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:44.488239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcf96-b60c-498e-9588-216fab967272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:44.488942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcf96-b60c-498e-9588-216fab967272 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.489232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcf96-b60c-498e-9588-216fab967272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.489515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcf96-b60c-498e-9588-216fab967272 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.490261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcf96-b60c-498e-9588-216fab967272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:44.490605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcf96-b60c-498e-9588-216fab967272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:44.493144 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcf96-b60c-498e-9588-216fab967272 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:44.498941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-008aa7c4-c3c6-4a7d-8564-9c836f04762c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:44.500409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-008aa7c4-c3c6-4a7d-8564-9c836f04762c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.506857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 768/1557] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:44.507997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcf96-b60c-498e-9588-216fab967272 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:44.517161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 790/1558] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:44.519042 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32643ce8-364d-4deb-a572-3c6563a90787 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.519571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32643ce8-364d-4deb-a572-3c6563a90787 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.520066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcf96-b60c-498e-9588-216fab967272 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:44.520183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32643ce8-364d-4deb-a572-3c6563a90787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.528808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1f1e2-8de6-4201-8696-4612027eb408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:44.529478 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1f1e2-8de6-4201-8696-4612027eb408 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.529761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1f1e2-8de6-4201-8696-4612027eb408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.530039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1f1e2-8de6-4201-8696-4612027eb408 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.530814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1f1e2-8de6-4201-8696-4612027eb408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:44.531124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1f1e2-8de6-4201-8696-4612027eb408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:44.533037 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1f1e2-8de6-4201-8696-4612027eb408 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:44.545682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-32643ce8-364d-4deb-a572-3c6563a90787 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:44.547437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-32643ce8-364d-4deb-a572-3c6563a90787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.549834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 769/1559] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:44.551512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e128f4-3b19-4d62-b419-ea6f28ec5941 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.551821 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e128f4-3b19-4d62-b419-ea6f28ec5941 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.552082 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e128f4-3b19-4d62-b419-ea6f28ec5941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.558390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 791/1560] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:44.560083 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36ff2-c8bf-4521-92d8-92dcf0cdcfad None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.560605 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36ff2-c8bf-4521-92d8-92dcf0cdcfad None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.561095 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36ff2-c8bf-4521-92d8-92dcf0cdcfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.576902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a6e128f4-3b19-4d62-b419-ea6f28ec5941 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:44.578292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a6e128f4-3b19-4d62-b419-ea6f28ec5941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.587448 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 770/1561] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:44.588517 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e128f4-3b19-4d62-b419-ea6f28ec5941 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:44.594364 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a6f36ff2-c8bf-4521-92d8-92dcf0cdcfad None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:44.595588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a6f36ff2-c8bf-4521-92d8-92dcf0cdcfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.598915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e128f4-3b19-4d62-b419-ea6f28ec5941 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:44.604410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a5715-4a6a-47cb-a5a2-e3c8464828d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:44.604572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 792/1562] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:44.605428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a5715-4a6a-47cb-a5a2-e3c8464828d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.605863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a5715-4a6a-47cb-a5a2-e3c8464828d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.606332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a5715-4a6a-47cb-a5a2-e3c8464828d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.607169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a5715-4a6a-47cb-a5a2-e3c8464828d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:44.607906 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df34e-4ca2-4c7e-b0a0-5f47ea5838a6 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.608334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df34e-4ca2-4c7e-b0a0-5f47ea5838a6 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.608676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-092a5715-4a6a-47cb-a5a2-e3c8464828d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:32:44.608676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 05 15:32:44.608676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: May 05 15:32:44.609130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df34e-4ca2-4c7e-b0a0-5f47ea5838a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.610417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a5715-4a6a-47cb-a5a2-e3c8464828d0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:44.631637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-d17df34e-4ca2-4c7e-b0a0-5f47ea5838a6 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:44.632882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d17df34e-4ca2-4c7e-b0a0-5f47ea5838a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.641637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 793/1563] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:44.642527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17df34e-4ca2-4c7e-b0a0-5f47ea5838a6 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:44.652763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17df34e-4ca2-4c7e-b0a0-5f47ea5838a6 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:44.657745 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d96fd-c147-4227-b277-b6be27f01baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:44.661277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d96fd-c147-4227-b277-b6be27f01baf admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.661277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d96fd-c147-4227-b277-b6be27f01baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.661277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d96fd-c147-4227-b277-b6be27f01baf admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.661277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d96fd-c147-4227-b277-b6be27f01baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:44.661929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d96fd-c147-4227-b277-b6be27f01baf admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:44.707332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 771/1564] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:44.708836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430a6f8-4a0a-43b3-891a-3b56cfa49656 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.709136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430a6f8-4a0a-43b3-891a-3b56cfa49656 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.709460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430a6f8-4a0a-43b3-891a-3b56cfa49656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.727948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1430a6f8-4a0a-43b3-891a-3b56cfa49656 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:44.732065 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1430a6f8-4a0a-43b3-891a-3b56cfa49656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.760843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 794/1565] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:44.770672 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d96fd-c147-4227-b277-b6be27f01baf admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:44.796853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 772/1566] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:44.798608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982511-5c25-4302-b40c-a3b6f79c47c9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.798608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982511-5c25-4302-b40c-a3b6f79c47c9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.798834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982511-5c25-4302-b40c-a3b6f79c47c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.818257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-96982511-5c25-4302-b40c-a3b6f79c47c9 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:44.819410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-96982511-5c25-4302-b40c-a3b6f79c47c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:44.833625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d96fd-c147-4227-b277-b6be27f01baf admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:44.838532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84fb2d-0e48-4aad-8d09-e9114b7553b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:44.839280 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84fb2d-0e48-4aad-8d09-e9114b7553b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.839625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84fb2d-0e48-4aad-8d09-e9114b7553b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.839969 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84fb2d-0e48-4aad-8d09-e9114b7553b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.840812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84fb2d-0e48-4aad-8d09-e9114b7553b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:44.841186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84fb2d-0e48-4aad-8d09-e9114b7553b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:44.842196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: WARNING py.warnings [None req-fd84fb2d-0e48-4aad-8d09-e9114b7553b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 15:32:44.842196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: warnings.warn(msg) May 05 15:32:44.842196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: May 05 15:32:44.843112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84fb2d-0e48-4aad-8d09-e9114b7553b7 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:44.862758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 795/1567] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:44.862758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de103dd0-bafd-42d3-a256-9ba0d17b248f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.862758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de103dd0-bafd-42d3-a256-9ba0d17b248f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.862758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de103dd0-bafd-42d3-a256-9ba0d17b248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.887108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 773/1568] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:44.891473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96982511-5c25-4302-b40c-a3b6f79c47c9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:44.906781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96982511-5c25-4302-b40c-a3b6f79c47c9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:44.911607 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd82c29-dd1b-4bab-a8c2-1a00ce81bbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:44.912346 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd82c29-dd1b-4bab-a8c2-1a00ce81bbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.912619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd82c29-dd1b-4bab-a8c2-1a00ce81bbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.912898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd82c29-dd1b-4bab-a8c2-1a00ce81bbf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.913666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd82c29-dd1b-4bab-a8c2-1a00ce81bbf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:44.914012 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd82c29-dd1b-4bab-a8c2-1a00ce81bbf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:44.916394 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd82c29-dd1b-4bab-a8c2-1a00ce81bbf2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:44.932856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 774/1569] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:44.932856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd82c29-dd1b-4bab-a8c2-1a00ce81bbf2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:44.943826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd82c29-dd1b-4bab-a8c2-1a00ce81bbf2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:44.949420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be55a0-58e5-48ce-9fd3-96bc40c63128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:44.950121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be55a0-58e5-48ce-9fd3-96bc40c63128 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:44.950591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be55a0-58e5-48ce-9fd3-96bc40c63128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:44.950877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be55a0-58e5-48ce-9fd3-96bc40c63128 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:44.951598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be55a0-58e5-48ce-9fd3-96bc40c63128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:44.953653 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be55a0-58e5-48ce-9fd3-96bc40c63128 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.015795 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-de103dd0-bafd-42d3-a256-9ba0d17b248f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:45.017003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-de103dd0-bafd-42d3-a256-9ba0d17b248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:45.024744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 796/1570] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:45.026295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de103dd0-bafd-42d3-a256-9ba0d17b248f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.035466 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de103dd0-bafd-42d3-a256-9ba0d17b248f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.040675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fee211-1e36-49ce-81a9-a1069d1787af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.041318 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee211-1e36-49ce-81a9-a1069d1787af admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.041593 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee211-1e36-49ce-81a9-a1069d1787af admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.041861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee211-1e36-49ce-81a9-a1069d1787af admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.042571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fee211-1e36-49ce-81a9-a1069d1787af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.043566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: WARNING py.warnings [None req-e6fee211-1e36-49ce-81a9-a1069d1787af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:32:45.043566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: warnings.warn(msg) May 05 15:32:45.043566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: May 05 15:32:45.045810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fee211-1e36-49ce-81a9-a1069d1787af admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.066525 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 775/1571] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:32:44 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:45.066525 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be55a0-58e5-48ce-9fd3-96bc40c63128 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.075975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be55a0-58e5-48ce-9fd3-96bc40c63128 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.080485 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d90cf-ddab-45c2-9ae8-ff0dae279824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.081140 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d90cf-ddab-45c2-9ae8-ff0dae279824 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.081417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d90cf-ddab-45c2-9ae8-ff0dae279824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.081695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d90cf-ddab-45c2-9ae8-ff0dae279824 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.082430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d90cf-ddab-45c2-9ae8-ff0dae279824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:45.082733 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d90cf-ddab-45c2-9ae8-ff0dae279824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.084309 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d90cf-ddab-45c2-9ae8-ff0dae279824 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.096017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 776/1572] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:45.096909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d90cf-ddab-45c2-9ae8-ff0dae279824 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.106770 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d90cf-ddab-45c2-9ae8-ff0dae279824 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.111572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62360e3-8a6c-48be-abb5-ffad4cdbdeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.115609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62360e3-8a6c-48be-abb5-ffad4cdbdeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.115609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62360e3-8a6c-48be-abb5-ffad4cdbdeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.115609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62360e3-8a6c-48be-abb5-ffad4cdbdeb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.115609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62360e3-8a6c-48be-abb5-ffad4cdbdeb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.115609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62360e3-8a6c-48be-abb5-ffad4cdbdeb2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.117181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 797/1573] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:32:45 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:45.119032 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4d640-d3f0-43ec-a014-c30ebef66123 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.119316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4d640-d3f0-43ec-a014-c30ebef66123 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.119586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4d640-d3f0-43ec-a014-c30ebef66123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.137907 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-cbf4d640-d3f0-43ec-a014-c30ebef66123 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:45.139153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-cbf4d640-d3f0-43ec-a014-c30ebef66123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:45.147120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 798/1574] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:45.148575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4d640-d3f0-43ec-a014-c30ebef66123 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.157903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4d640-d3f0-43ec-a014-c30ebef66123 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.162230 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423d193-68a8-4e30-b7b3-c4ac3f2c0f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.167158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423d193-68a8-4e30-b7b3-c4ac3f2c0f84 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.167158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423d193-68a8-4e30-b7b3-c4ac3f2c0f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.167158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423d193-68a8-4e30-b7b3-c4ac3f2c0f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.167158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423d193-68a8-4e30-b7b3-c4ac3f2c0f84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.167158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423d193-68a8-4e30-b7b3-c4ac3f2c0f84 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.189254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 777/1575] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:32:45 2022] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:45.190809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f6cb7-436f-4be8-8ea9-bace71254818 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.191101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f6cb7-436f-4be8-8ea9-bace71254818 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.191382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f6cb7-436f-4be8-8ea9-bace71254818 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.192683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 778/1576] 10.222.0.44 () {54 vars in 960 bytes} [Thu May 5 15:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:45.193425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f6cb7-436f-4be8-8ea9-bace71254818 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.254069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f6cb7-436f-4be8-8ea9-bace71254818 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.259042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616adb8-c6cb-4bb3-9686-bd8a26868035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.264799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616adb8-c6cb-4bb3-9686-bd8a26868035 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.264799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616adb8-c6cb-4bb3-9686-bd8a26868035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.264799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616adb8-c6cb-4bb3-9686-bd8a26868035 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.264799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616adb8-c6cb-4bb3-9686-bd8a26868035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:45.264799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616adb8-c6cb-4bb3-9686-bd8a26868035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.264799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616adb8-c6cb-4bb3-9686-bd8a26868035 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.274972 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 779/1577] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:45.275882 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616adb8-c6cb-4bb3-9686-bd8a26868035 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.285022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616adb8-c6cb-4bb3-9686-bd8a26868035 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.289591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdbfec-e354-4139-813d-7258ee3133b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.293390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdbfec-e354-4139-813d-7258ee3133b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.293390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdbfec-e354-4139-813d-7258ee3133b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.293390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdbfec-e354-4139-813d-7258ee3133b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.293390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdbfec-e354-4139-813d-7258ee3133b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.293718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 799/1578] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:32:45 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:45.293718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423d193-68a8-4e30-b7b3-c4ac3f2c0f84 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.294500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdbfec-e354-4139-813d-7258ee3133b1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.303750 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 780/1579] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:45.304686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdbfec-e354-4139-813d-7258ee3133b1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.313931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdbfec-e354-4139-813d-7258ee3133b1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.357954 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423d193-68a8-4e30-b7b3-c4ac3f2c0f84 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.362562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe09a2-a4ca-48d5-8983-dc4923eec427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.363215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe09a2-a4ca-48d5-8983-dc4923eec427 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.363504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe09a2-a4ca-48d5-8983-dc4923eec427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.363907 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe09a2-a4ca-48d5-8983-dc4923eec427 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.364603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe09a2-a4ca-48d5-8983-dc4923eec427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.366571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe09a2-a4ca-48d5-8983-dc4923eec427 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.367728 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8e5f-e9ad-4ec6-9000-237474e7ef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.368470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8e5f-e9ad-4ec6-9000-237474e7ef8c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.368760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8e5f-e9ad-4ec6-9000-237474e7ef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.369041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8e5f-e9ad-4ec6-9000-237474e7ef8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.369753 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e8e5f-e9ad-4ec6-9000-237474e7ef8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.371371 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e8e5f-e9ad-4ec6-9000-237474e7ef8c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.380876 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 781/1580] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:45.386662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8e5f-e9ad-4ec6-9000-237474e7ef8c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.392026 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8e5f-e9ad-4ec6-9000-237474e7ef8c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.396520 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd715fa8-9c87-490c-821b-45fb17336c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.397142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd715fa8-9c87-490c-821b-45fb17336c6f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.397422 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd715fa8-9c87-490c-821b-45fb17336c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.397696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd715fa8-9c87-490c-821b-45fb17336c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.398425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd715fa8-9c87-490c-821b-45fb17336c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:45.398728 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd715fa8-9c87-490c-821b-45fb17336c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.401112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd715fa8-9c87-490c-821b-45fb17336c6f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.412590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 782/1581] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:45.413464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd715fa8-9c87-490c-821b-45fb17336c6f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.422719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd715fa8-9c87-490c-821b-45fb17336c6f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.427617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730c919-0b15-4135-8010-da3ff7cb3c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.428249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730c919-0b15-4135-8010-da3ff7cb3c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.428562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730c919-0b15-4135-8010-da3ff7cb3c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.428845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730c919-0b15-4135-8010-da3ff7cb3c89 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.429518 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730c919-0b15-4135-8010-da3ff7cb3c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.432221 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730c919-0b15-4135-8010-da3ff7cb3c89 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.457859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 800/1582] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:32:45 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:45.459202 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eee52d-b0b7-4422-b596-f3286b422359 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.459498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eee52d-b0b7-4422-b596-f3286b422359 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.459780 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eee52d-b0b7-4422-b596-f3286b422359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.478057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-d8eee52d-b0b7-4422-b596-f3286b422359 None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:45.479362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d8eee52d-b0b7-4422-b596-f3286b422359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:45.497098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 783/1583] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:32:45 2022] POST /identity/v3/users => generated 296 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:45.501704 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730c919-0b15-4135-8010-da3ff7cb3c89 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.507776 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730c919-0b15-4135-8010-da3ff7cb3c89 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.545866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 801/1584] 10.222.0.44 () {58 vars in 1057 bytes} [Thu May 5 15:32:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:45.546744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eee52d-b0b7-4422-b596-f3286b422359 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.563576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325eb6e-a57b-4fb0-b870-8b863a09f3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.564237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325eb6e-a57b-4fb0-b870-8b863a09f3ff admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.564519 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325eb6e-a57b-4fb0-b870-8b863a09f3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.564794 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325eb6e-a57b-4fb0-b870-8b863a09f3ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.565480 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325eb6e-a57b-4fb0-b870-8b863a09f3ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.567408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325eb6e-a57b-4fb0-b870-8b863a09f3ff admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.608592 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eee52d-b0b7-4422-b596-f3286b422359 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.612996 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6735ba6-e37d-47d0-9cb8-83504b04c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.613662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735ba6-e37d-47d0-9cb8-83504b04c89d admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.613945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735ba6-e37d-47d0-9cb8-83504b04c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.614220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735ba6-e37d-47d0-9cb8-83504b04c89d admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.614939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6735ba6-e37d-47d0-9cb8-83504b04c89d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.616901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6735ba6-e37d-47d0-9cb8-83504b04c89d admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.645710 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 784/1585] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:32:45 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:45.646719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325eb6e-a57b-4fb0-b870-8b863a09f3ff admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.708193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325eb6e-a57b-4fb0-b870-8b863a09f3ff admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.713206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0fe20-faa0-47da-bbca-f8992dd3bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.715688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0fe20-faa0-47da-bbca-f8992dd3bb92 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.715688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0fe20-faa0-47da-bbca-f8992dd3bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.715688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0fe20-faa0-47da-bbca-f8992dd3bb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.715688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0fe20-faa0-47da-bbca-f8992dd3bb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.716756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0fe20-faa0-47da-bbca-f8992dd3bb92 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.717491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 802/1586] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:32:45 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:45.718130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6735ba6-e37d-47d0-9cb8-83504b04c89d admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.727022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 785/1587] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:45.727607 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6735ba6-e37d-47d0-9cb8-83504b04c89d admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.727810 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0fe20-faa0-47da-bbca-f8992dd3bb92 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.732419 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93e07b-b934-4061-9b18-7f72cfd82d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.733092 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93e07b-b934-4061-9b18-7f72cfd82d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.733376 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93e07b-b934-4061-9b18-7f72cfd82d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.733654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93e07b-b934-4061-9b18-7f72cfd82d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.734418 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93e07b-b934-4061-9b18-7f72cfd82d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.735992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93e07b-b934-4061-9b18-7f72cfd82d04 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.737647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0fe20-faa0-47da-bbca-f8992dd3bb92 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.742268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dcd75-f978-49eb-88e6-ce5968e52fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.743481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dcd75-f978-49eb-88e6-ce5968e52fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.743880 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dcd75-f978-49eb-88e6-ce5968e52fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.744158 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dcd75-f978-49eb-88e6-ce5968e52fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.744831 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dcd75-f978-49eb-88e6-ce5968e52fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.746626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 803/1588] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:45.746751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dcd75-f978-49eb-88e6-ce5968e52fe0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.747404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93e07b-b934-4061-9b18-7f72cfd82d04 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.757084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93e07b-b934-4061-9b18-7f72cfd82d04 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.762540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce7fa8-f689-41c9-b5d5-0ef4dd52b831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.762910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce7fa8-f689-41c9-b5d5-0ef4dd52b831 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.763133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce7fa8-f689-41c9-b5d5-0ef4dd52b831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.763358 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce7fa8-f689-41c9-b5d5-0ef4dd52b831 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.764042 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce7fa8-f689-41c9-b5d5-0ef4dd52b831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.765951 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce7fa8-f689-41c9-b5d5-0ef4dd52b831 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.821333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 786/1589] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:32:45 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:45.822740 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dcd75-f978-49eb-88e6-ce5968e52fe0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.872478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 804/1590] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:32:45 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:45.873997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01c240-5381-4b89-9556-0a415a7c449e None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.874139 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01c240-5381-4b89-9556-0a415a7c449e None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.874497 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01c240-5381-4b89-9556-0a415a7c449e None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.875990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 805/1591] 10.222.0.44 () {54 vars in 912 bytes} [Thu May 5 15:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:45.876885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01c240-5381-4b89-9556-0a415a7c449e None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.884362 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dcd75-f978-49eb-88e6-ce5968e52fe0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.889172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8455da7-21c9-42dd-8dbd-48c2fdcdc80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.889658 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01c240-5381-4b89-9556-0a415a7c449e None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.889843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8455da7-21c9-42dd-8dbd-48c2fdcdc80b admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.890154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8455da7-21c9-42dd-8dbd-48c2fdcdc80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.890486 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8455da7-21c9-42dd-8dbd-48c2fdcdc80b admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.891406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8455da7-21c9-42dd-8dbd-48c2fdcdc80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.893039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8455da7-21c9-42dd-8dbd-48c2fdcdc80b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.894438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115463b5-dbda-475a-b467-aca9fc6fd993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.895083 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115463b5-dbda-475a-b467-aca9fc6fd993 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.895361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115463b5-dbda-475a-b467-aca9fc6fd993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.895635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115463b5-dbda-475a-b467-aca9fc6fd993 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.896324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115463b5-dbda-475a-b467-aca9fc6fd993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.898163 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115463b5-dbda-475a-b467-aca9fc6fd993 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.903745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 787/1592] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:45.904352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8455da7-21c9-42dd-8dbd-48c2fdcdc80b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.913908 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8455da7-21c9-42dd-8dbd-48c2fdcdc80b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.919934 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e73fd-9196-4488-8bc1-422f434ad9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.920577 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e73fd-9196-4488-8bc1-422f434ad9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.920858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e73fd-9196-4488-8bc1-422f434ad9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.921132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e73fd-9196-4488-8bc1-422f434ad9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.921863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e73fd-9196-4488-8bc1-422f434ad9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.923522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e73fd-9196-4488-8bc1-422f434ad9e4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.933999 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 788/1593] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:45.934936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e73fd-9196-4488-8bc1-422f434ad9e4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.944418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e73fd-9196-4488-8bc1-422f434ad9e4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.949452 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366952c8-5e52-4f6b-8411-83f37be95766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.950342 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366952c8-5e52-4f6b-8411-83f37be95766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.950626 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366952c8-5e52-4f6b-8411-83f37be95766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.950900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366952c8-5e52-4f6b-8411-83f37be95766 admin admin] PATH_INFO: `/v3/projects/7bf48eb17c8e4f3fb2df34bc51db4b70/users/609c5fce0bae46b696fca1971f9dcdea/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:45.965620 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366952c8-5e52-4f6b-8411-83f37be95766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf48eb17c8e4f3fb2df34bc51db4b70, user_id=609c5fce0bae46b696fca1971f9dcdea, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:45.966677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-366952c8-5e52-4f6b-8411-83f37be95766 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:32:45.966677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 05 15:32:45.966677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: May 05 15:32:45.968583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366952c8-5e52-4f6b-8411-83f37be95766 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:45.970382 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 806/1594] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:32:45 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:45.971184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115463b5-dbda-475a-b467-aca9fc6fd993 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:45.981659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115463b5-dbda-475a-b467-aca9fc6fd993 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:45.986218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031c85b-e013-4110-acfd-c821caebe2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:45.987113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031c85b-e013-4110-acfd-c821caebe2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:45.987398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031c85b-e013-4110-acfd-c821caebe2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:45.987704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031c85b-e013-4110-acfd-c821caebe2a9 admin admin] PATH_INFO: `/v3/projects/bedb0fa11b034325ad09ea0ec7f8e288/users/82f193153bf04ff8b39a9ecf3da423ce/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.002966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031c85b-e013-4110-acfd-c821caebe2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bedb0fa11b034325ad09ea0ec7f8e288, user_id=82f193153bf04ff8b39a9ecf3da423ce, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.005608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031c85b-e013-4110-acfd-c821caebe2a9 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.062661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 789/1595] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:45 2022] PUT /identity/v3/projects/7bf48eb17c8e4f3fb2df34bc51db4b70/users/609c5fce0bae46b696fca1971f9dcdea/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:46.063501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366952c8-5e52-4f6b-8411-83f37be95766 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.084763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 807/1596] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:45 2022] PUT /identity/v3/projects/bedb0fa11b034325ad09ea0ec7f8e288/users/82f193153bf04ff8b39a9ecf3da423ce/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:46.085756 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031c85b-e013-4110-acfd-c821caebe2a9 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.131839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366952c8-5e52-4f6b-8411-83f37be95766 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.148115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031c85b-e013-4110-acfd-c821caebe2a9 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.154366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6dbd3-b1f5-4925-8bf5-fe607c2e90de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.157737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6dbd3-b1f5-4925-8bf5-fe607c2e90de admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.157737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6dbd3-b1f5-4925-8bf5-fe607c2e90de admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.157737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6dbd3-b1f5-4925-8bf5-fe607c2e90de admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.157737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6dbd3-b1f5-4925-8bf5-fe607c2e90de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.158090 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6dbd3-b1f5-4925-8bf5-fe607c2e90de admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.171086 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 808/1597] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:46.171086 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d8d5f-2756-43b1-bd10-a877d9057517 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.171086 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d8d5f-2756-43b1-bd10-a877d9057517 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.171086 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d8d5f-2756-43b1-bd10-a877d9057517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.188724 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7d54c-b62a-46a2-b302-2fe6cf8589f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.189397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7d54c-b62a-46a2-b302-2fe6cf8589f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.189680 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7d54c-b62a-46a2-b302-2fe6cf8589f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.189958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7d54c-b62a-46a2-b302-2fe6cf8589f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.190608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-162d8d5f-2756-43b1-bd10-a877d9057517 None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:46.190714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7d54c-b62a-46a2-b302-2fe6cf8589f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.192097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-162d8d5f-2756-43b1-bd10-a877d9057517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:46.192853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7d54c-b62a-46a2-b302-2fe6cf8589f0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.257876 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 809/1598] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:46.259331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d8d5f-2756-43b1-bd10-a877d9057517 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.269860 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d8d5f-2756-43b1-bd10-a877d9057517 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.274556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447b325-f039-4e39-bfa6-f58691183dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.275219 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447b325-f039-4e39-bfa6-f58691183dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.281596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447b325-f039-4e39-bfa6-f58691183dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.281596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447b325-f039-4e39-bfa6-f58691183dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.281596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447b325-f039-4e39-bfa6-f58691183dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.281596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447b325-f039-4e39-bfa6-f58691183dfa admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.287905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 810/1599] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:46.288734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447b325-f039-4e39-bfa6-f58691183dfa admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.298376 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447b325-f039-4e39-bfa6-f58691183dfa admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.303122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee7715-8c60-4e27-8217-a9707e3f1fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.308794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee7715-8c60-4e27-8217-a9707e3f1fbb admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.308794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee7715-8c60-4e27-8217-a9707e3f1fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.308794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee7715-8c60-4e27-8217-a9707e3f1fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.308794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee7715-8c60-4e27-8217-a9707e3f1fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.308794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee7715-8c60-4e27-8217-a9707e3f1fbb admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.316517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 811/1600] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:46.317262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee7715-8c60-4e27-8217-a9707e3f1fbb admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.326585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee7715-8c60-4e27-8217-a9707e3f1fbb admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.331094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db029ab-427b-4b1d-a0fd-63e4ace8d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.339158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db029ab-427b-4b1d-a0fd-63e4ace8d0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.339158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db029ab-427b-4b1d-a0fd-63e4ace8d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.339158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db029ab-427b-4b1d-a0fd-63e4ace8d0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.339158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db029ab-427b-4b1d-a0fd-63e4ace8d0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.339158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db029ab-427b-4b1d-a0fd-63e4ace8d0ed admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.345427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 812/1601] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:46.346654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb525e-c550-46a0-bc5b-1b94b6ed9d3e None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.346935 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb525e-c550-46a0-bc5b-1b94b6ed9d3e None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.347207 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb525e-c550-46a0-bc5b-1b94b6ed9d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.363458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 790/1602] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:32:46 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:46.364004 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ce8b0-ece4-4e87-be4c-b78b553a4933 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.364303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ce8b0-ece4-4e87-be4c-b78b553a4933 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.367891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ce8b0-ece4-4e87-be4c-b78b553a4933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.375126 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-5bdb525e-c550-46a0-bc5b-1b94b6ed9d3e None None] MFA Rules not processed for user `609c5fce0bae46b696fca1971f9dcdea`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:46.376347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-5bdb525e-c550-46a0-bc5b-1b94b6ed9d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:46.390917 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cb4ce8b0-ece4-4e87-be4c-b78b553a4933 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:46.392413 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cb4ce8b0-ece4-4e87-be4c-b78b553a4933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:46.401711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 791/1603] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:46.402677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ce8b0-ece4-4e87-be4c-b78b553a4933 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.412649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ce8b0-ece4-4e87-be4c-b78b553a4933 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.418090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870ccf2-b955-4a0e-923e-54388ac1f39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.418794 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870ccf2-b955-4a0e-923e-54388ac1f39b admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.419075 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870ccf2-b955-4a0e-923e-54388ac1f39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.419347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870ccf2-b955-4a0e-923e-54388ac1f39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.420094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870ccf2-b955-4a0e-923e-54388ac1f39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.421740 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870ccf2-b955-4a0e-923e-54388ac1f39b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.432098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 792/1604] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:46.432898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870ccf2-b955-4a0e-923e-54388ac1f39b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.452747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 813/1605] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:46.453566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb525e-c550-46a0-bc5b-1b94b6ed9d3e None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.465132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb525e-c550-46a0-bc5b-1b94b6ed9d3e None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.469760 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a94db-b5a9-4e9e-a80c-49815b6666a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.470683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a94db-b5a9-4e9e-a80c-49815b6666a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.470987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a94db-b5a9-4e9e-a80c-49815b6666a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.471258 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a94db-b5a9-4e9e-a80c-49815b6666a2 admin admin] PATH_INFO: `/v3/projects/2ecd98a479c547e69296da5873ea6052/users/4956411c8fc945eea06f127a1b4f3c70/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.487476 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a94db-b5a9-4e9e-a80c-49815b6666a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ecd98a479c547e69296da5873ea6052, user_id=4956411c8fc945eea06f127a1b4f3c70, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.487713 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870ccf2-b955-4a0e-923e-54388ac1f39b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.490398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a94db-b5a9-4e9e-a80c-49815b6666a2 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.491519 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8c95d-6052-4e1b-b0f5-92656b0e9b98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.492219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8c95d-6052-4e1b-b0f5-92656b0e9b98 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.492639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8c95d-6052-4e1b-b0f5-92656b0e9b98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.493485 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8c95d-6052-4e1b-b0f5-92656b0e9b98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.507124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8c95d-6052-4e1b-b0f5-92656b0e9b98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.510029 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8c95d-6052-4e1b-b0f5-92656b0e9b98 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.522030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 793/1606] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:46.522897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8c95d-6052-4e1b-b0f5-92656b0e9b98 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.537483 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8c95d-6052-4e1b-b0f5-92656b0e9b98 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.543901 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f049f76-de0b-45f1-9d36-6b86e31b9445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.544788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f049f76-de0b-45f1-9d36-6b86e31b9445 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.545073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f049f76-de0b-45f1-9d36-6b86e31b9445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.545351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f049f76-de0b-45f1-9d36-6b86e31b9445 admin admin] PATH_INFO: `/v3/projects/c48ef1a481ef4cf3b16677fb79fc9281/users/328bcfc199a1469da9fe91bdb0f30ff7/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.565114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 814/1607] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:46 2022] PUT /identity/v3/projects/2ecd98a479c547e69296da5873ea6052/users/4956411c8fc945eea06f127a1b4f3c70/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:46.566605 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a94db-b5a9-4e9e-a80c-49815b6666a2 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.575721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f049f76-de0b-45f1-9d36-6b86e31b9445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48ef1a481ef4cf3b16677fb79fc9281, user_id=328bcfc199a1469da9fe91bdb0f30ff7, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.579960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f049f76-de0b-45f1-9d36-6b86e31b9445 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.637279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a94db-b5a9-4e9e-a80c-49815b6666a2 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.642267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedecf3f-9af1-46c9-8905-a4be0293ccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.643004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedecf3f-9af1-46c9-8905-a4be0293ccfa admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.643235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedecf3f-9af1-46c9-8905-a4be0293ccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.643492 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedecf3f-9af1-46c9-8905-a4be0293ccfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.644263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedecf3f-9af1-46c9-8905-a4be0293ccfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.645828 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedecf3f-9af1-46c9-8905-a4be0293ccfa admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.658428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 815/1608] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:46.659597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedecf3f-9af1-46c9-8905-a4be0293ccfa admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.664767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 794/1609] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:46 2022] PUT /identity/v3/projects/c48ef1a481ef4cf3b16677fb79fc9281/users/328bcfc199a1469da9fe91bdb0f30ff7/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:46.674627 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedecf3f-9af1-46c9-8905-a4be0293ccfa admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.679811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f049f76-de0b-45f1-9d36-6b86e31b9445 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.742162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a067578-56f8-40e1-bf04-5254d4907fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.743925 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067578-56f8-40e1-bf04-5254d4907fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.745257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067578-56f8-40e1-bf04-5254d4907fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.745547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067578-56f8-40e1-bf04-5254d4907fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.746366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a067578-56f8-40e1-bf04-5254d4907fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.747155 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f049f76-de0b-45f1-9d36-6b86e31b9445 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.749007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a067578-56f8-40e1-bf04-5254d4907fe7 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.752347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72434-4bb6-4f6c-b711-1fd5f3c88d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.753289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72434-4bb6-4f6c-b711-1fd5f3c88d3f service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.753767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72434-4bb6-4f6c-b711-1fd5f3c88d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.754264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72434-4bb6-4f6c-b711-1fd5f3c88d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.762042 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 816/1610] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:46.763225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a067578-56f8-40e1-bf04-5254d4907fe7 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.767909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c72434-4bb6-4f6c-b711-1fd5f3c88d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.769795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c72434-4bb6-4f6c-b711-1fd5f3c88d3f service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.776805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a067578-56f8-40e1-bf04-5254d4907fe7 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.785157 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 795/1611] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:46.785361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371632e9-10e2-4cff-8a15-19d7cf73cb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.786801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72434-4bb6-4f6c-b711-1fd5f3c88d3f service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:46.787128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371632e9-10e2-4cff-8a15-19d7cf73cb32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.787669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371632e9-10e2-4cff-8a15-19d7cf73cb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.788145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371632e9-10e2-4cff-8a15-19d7cf73cb32 admin admin] PATH_INFO: `/v3/projects/9033d11b107a4c22b38f31a181a05ebe/users/8e128963426d4f129226a981689531a9/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.823831 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371632e9-10e2-4cff-8a15-19d7cf73cb32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9033d11b107a4c22b38f31a181a05ebe, user_id=8e128963426d4f129226a981689531a9, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.827380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371632e9-10e2-4cff-8a15-19d7cf73cb32 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.885370 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72434-4bb6-4f6c-b711-1fd5f3c88d3f service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:46.891372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972d5d7-12d7-4a9c-8117-b54a2834e6d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:46.892177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972d5d7-12d7-4a9c-8117-b54a2834e6d7 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.892626 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972d5d7-12d7-4a9c-8117-b54a2834e6d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.892819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972d5d7-12d7-4a9c-8117-b54a2834e6d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.935022 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 817/1612] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:46 2022] PUT /identity/v3/projects/9033d11b107a4c22b38f31a181a05ebe/users/8e128963426d4f129226a981689531a9/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:46.936324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a675fab-d9bf-4e4d-be24-18854c197dcb None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:46.936625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a675fab-d9bf-4e4d-be24-18854c197dcb None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:46.936907 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a675fab-d9bf-4e4d-be24-18854c197dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:46.969467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-8a675fab-d9bf-4e4d-be24-18854c197dcb None None] MFA Rules not processed for user `4956411c8fc945eea06f127a1b4f3c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:46.971105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8a675fab-d9bf-4e4d-be24-18854c197dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:46.975476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972d5d7-12d7-4a9c-8117-b54a2834e6d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:46.977687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972d5d7-12d7-4a9c-8117-b54a2834e6d7 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:46.988137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 796/1613] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:46.988815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972d5d7-12d7-4a9c-8117-b54a2834e6d7 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:47.000554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972d5d7-12d7-4a9c-8117-b54a2834e6d7 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:47.053339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 818/1614] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:47.054864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e9126-23a7-4962-9a33-ef22fe0e424c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.055259 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e9126-23a7-4962-9a33-ef22fe0e424c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.055756 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e9126-23a7-4962-9a33-ef22fe0e424c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.076640 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765915-5fa0-4acf-96c0-197958f47cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:47.077556 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765915-5fa0-4acf-96c0-197958f47cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.077837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765915-5fa0-4acf-96c0-197958f47cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.078116 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765915-5fa0-4acf-96c0-197958f47cb7 admin admin] PATH_INFO: `/v3/projects/8b27b8154a1f4257b7add9ba2ba83eae/users/987d85f00a4e47568c4085979ea8f8ee/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.089346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-716e9126-23a7-4962-9a33-ef22fe0e424c None None] MFA Rules not processed for user `328bcfc199a1469da9fe91bdb0f30ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:47.091084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-716e9126-23a7-4962-9a33-ef22fe0e424c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:47.096129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e765915-5fa0-4acf-96c0-197958f47cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b27b8154a1f4257b7add9ba2ba83eae, user_id=987d85f00a4e47568c4085979ea8f8ee, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:47.098929 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e765915-5fa0-4acf-96c0-197958f47cb7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:47.168708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 819/1615] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:47.168708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e9126-23a7-4962-9a33-ef22fe0e424c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:47.177446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e9126-23a7-4962-9a33-ef22fe0e424c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:47.194076 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 797/1616] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:46 2022] PUT /identity/v3/projects/8b27b8154a1f4257b7add9ba2ba83eae/users/987d85f00a4e47568c4085979ea8f8ee/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:47.196815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765915-5fa0-4acf-96c0-197958f47cb7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:47.241834 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd207a6e-fc9d-4bfc-812a-460435907858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:47.242601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd207a6e-fc9d-4bfc-812a-460435907858 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.242905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd207a6e-fc9d-4bfc-812a-460435907858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.243365 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd207a6e-fc9d-4bfc-812a-460435907858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.248014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd207a6e-fc9d-4bfc-812a-460435907858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:47.248014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd207a6e-fc9d-4bfc-812a-460435907858 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:47.256609 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 820/1617] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:47.257703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd276e8-b61a-4ace-8933-a0f97e762793 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.257999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd276e8-b61a-4ace-8933-a0f97e762793 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.258339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd276e8-b61a-4ace-8933-a0f97e762793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.272636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765915-5fa0-4acf-96c0-197958f47cb7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:47.277176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ccd276e8-b61a-4ace-8933-a0f97e762793 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:47.278085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:47.278417 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ccd276e8-b61a-4ace-8933-a0f97e762793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:47.279101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.279558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.279874 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] PATH_INFO: `/v3/users/d48921eb725f4d24ad667db4af315335` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.281145 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48921eb725f4d24ad667db4af315335)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:47.282166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: WARNING py.warnings [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:32:47.282166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: warnings.warn(msg) May 05 15:32:47.282166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: May 05 15:32:47.283450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:47.287909 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 821/1618] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:47.289070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37ca7e-3742-475d-a316-2a6af05724d7 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.289368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37ca7e-3742-475d-a316-2a6af05724d7 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.291102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37ca7e-3742-475d-a316-2a6af05724d7 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.292548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 822/1619] 10.222.0.44 () {54 vars in 912 bytes} [Thu May 5 15:32:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:47.293276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37ca7e-3742-475d-a316-2a6af05724d7 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:47.309421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37ca7e-3742-475d-a316-2a6af05724d7 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:47.316160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbabff-2d19-49ad-9074-2ff58de4b630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:47.317014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbabff-2d19-49ad-9074-2ff58de4b630 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.317353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbabff-2d19-49ad-9074-2ff58de4b630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.317852 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbabff-2d19-49ad-9074-2ff58de4b630 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.318971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbabff-2d19-49ad-9074-2ff58de4b630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:47.322867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbabff-2d19-49ad-9074-2ff58de4b630 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:47.456200 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 823/1620] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:32:47 2022] POST /identity/v3/projects => generated 393 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:47.457102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbabff-2d19-49ad-9074-2ff58de4b630 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:47.516867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbabff-2d19-49ad-9074-2ff58de4b630 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:47.521668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c1bf9-e83d-44a0-b1ac-5a49ff952a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:47.522360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c1bf9-e83d-44a0-b1ac-5a49ff952a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.522647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c1bf9-e83d-44a0-b1ac-5a49ff952a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.522924 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c1bf9-e83d-44a0-b1ac-5a49ff952a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.523613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c1bf9-e83d-44a0-b1ac-5a49ff952a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:47.526230 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c1bf9-e83d-44a0-b1ac-5a49ff952a89 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:47.550750 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48921eb725f4d24ad667db4af315335'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:47.561162 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48921eb725f4d24ad667db4af315335'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:47.561948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48921eb725f4d24ad667db4af315335'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:47.562653 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48921eb725f4d24ad667db4af315335'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:47.584707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48921eb725f4d24ad667db4af315335'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:47.632746 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 824/1621] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:32:47 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:47.634609 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12890ce4-be99-476f-9140-5914c9b6b7c9 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.634898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12890ce4-be99-476f-9140-5914c9b6b7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.635177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12890ce4-be99-476f-9140-5914c9b6b7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.654197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-12890ce4-be99-476f-9140-5914c9b6b7c9 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:47.655441 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-12890ce4-be99-476f-9140-5914c9b6b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:47.668726 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 798/1622] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:32:47 2022] DELETE /identity/v3/users/d48921eb725f4d24ad667db4af315335 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:47.672320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:47.672320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:47.717285 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 825/1623] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:47.718769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0ae91-44d3-411a-abdf-07f4c86a8d4a None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.719071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0ae91-44d3-411a-abdf-07f4c86a8d4a None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.719340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0ae91-44d3-411a-abdf-07f4c86a8d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.737263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6be0ae91-44d3-411a-abdf-07f4c86a8d4a None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:47.738513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6be0ae91-44d3-411a-abdf-07f4c86a8d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:47.739953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbefda4-d1f9-498b-a6dd-5f34701ed552 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:47.745052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e691030-3481-458f-8b4f-918c67b47d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:47.746017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e691030-3481-458f-8b4f-918c67b47d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.746330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e691030-3481-458f-8b4f-918c67b47d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.746614 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e691030-3481-458f-8b4f-918c67b47d12 admin admin] PATH_INFO: `/v3/projects/948dab04438f461ebb771a6b7bde8c7c/users/5bd2dba7864b465f84bc58f483dd631f/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.761771 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e691030-3481-458f-8b4f-918c67b47d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948dab04438f461ebb771a6b7bde8c7c, user_id=5bd2dba7864b465f84bc58f483dd631f, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:47.764777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e691030-3481-458f-8b4f-918c67b47d12 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:47.806759 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 826/1624] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:47.807766 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0ae91-44d3-411a-abdf-07f4c86a8d4a None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:47.809138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6be0ae91-44d3-411a-abdf-07f4c86a8d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:47.855502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 799/1625] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:47 2022] PUT /identity/v3/projects/948dab04438f461ebb771a6b7bde8c7c/users/5bd2dba7864b465f84bc58f483dd631f/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:47.855502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e691030-3481-458f-8b4f-918c67b47d12 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:47.855502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2e691030-3481-458f-8b4f-918c67b47d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:47.883246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0ae91-44d3-411a-abdf-07f4c86a8d4a None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:47.917801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e691030-3481-458f-8b4f-918c67b47d12 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:47.922561 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d189b-b3bb-4070-8362-1352dd5357a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:47.923224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d189b-b3bb-4070-8362-1352dd5357a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.923504 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d189b-b3bb-4070-8362-1352dd5357a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.923786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d189b-b3bb-4070-8362-1352dd5357a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.924482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d189b-b3bb-4070-8362-1352dd5357a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:47.926715 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d189b-b3bb-4070-8362-1352dd5357a9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:47.931799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e00278-537b-452c-871b-309c9a08334e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:47.932449 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e00278-537b-452c-871b-309c9a08334e service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.932728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e00278-537b-452c-871b-309c9a08334e service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.933001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e00278-537b-452c-871b-309c9a08334e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.934780 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e9e00278-537b-452c-871b-309c9a08334e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:47.947246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e00278-537b-452c-871b-309c9a08334e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:47.948721 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e00278-537b-452c-871b-309c9a08334e service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:47.958315 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 827/1626] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:47.959064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e00278-537b-452c-871b-309c9a08334e service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:47.960346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e9e00278-537b-452c-871b-309c9a08334e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:47.972534 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e00278-537b-452c-871b-309c9a08334e service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:47.978001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dd7d0-4994-49d8-bee4-dae89c7bf75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:47.978738 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd7d0-4994-49d8-bee4-dae89c7bf75e admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:47.979022 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd7d0-4994-49d8-bee4-dae89c7bf75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:47.979302 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd7d0-4994-49d8-bee4-dae89c7bf75e admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:47.979996 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd7d0-4994-49d8-bee4-dae89c7bf75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:47.981914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd7d0-4994-49d8-bee4-dae89c7bf75e admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.019763 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 800/1627] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:32:47 2022] POST /identity/v3/users => generated 303 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:48.025204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d4e5a-1d1a-4739-8fd6-6ccd4fa463e7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.025204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d4e5a-1d1a-4739-8fd6-6ccd4fa463e7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.025204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d4e5a-1d1a-4739-8fd6-6ccd4fa463e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.040109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3a3d4e5a-1d1a-4739-8fd6-6ccd4fa463e7 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:48.041400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3a3d4e5a-1d1a-4739-8fd6-6ccd4fa463e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:48.048974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 801/1628] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:48.053560 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d4e5a-1d1a-4739-8fd6-6ccd4fa463e7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.060917 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d4e5a-1d1a-4739-8fd6-6ccd4fa463e7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.064711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781d87c-41ea-4dad-8023-9fcc325ab9a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.065325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781d87c-41ea-4dad-8023-9fcc325ab9a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.065606 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781d87c-41ea-4dad-8023-9fcc325ab9a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.065881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781d87c-41ea-4dad-8023-9fcc325ab9a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.076518 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781d87c-41ea-4dad-8023-9fcc325ab9a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.078781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781d87c-41ea-4dad-8023-9fcc325ab9a7 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.091911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 802/1629] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:48.093094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781d87c-41ea-4dad-8023-9fcc325ab9a7 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.094601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a781d87c-41ea-4dad-8023-9fcc325ab9a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:48.109110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 828/1630] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:32:47 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:48.111596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e29337-2e3d-48b2-b05d-7b7cf8ac7314 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.111596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e29337-2e3d-48b2-b05d-7b7cf8ac7314 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.111596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e29337-2e3d-48b2-b05d-7b7cf8ac7314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.153970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-02e29337-2e3d-48b2-b05d-7b7cf8ac7314 None None] MFA Rules not processed for user `5bd2dba7864b465f84bc58f483dd631f`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:48.155553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-02e29337-2e3d-48b2-b05d-7b7cf8ac7314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:48.188611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781d87c-41ea-4dad-8023-9fcc325ab9a7 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.193325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ad6d2-46fb-467b-9d72-de79b3d9ac91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.194335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ad6d2-46fb-467b-9d72-de79b3d9ac91 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.194765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ad6d2-46fb-467b-9d72-de79b3d9ac91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.195178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ad6d2-46fb-467b-9d72-de79b3d9ac91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.222996 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 829/1631] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:48.223857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e29337-2e3d-48b2-b05d-7b7cf8ac7314 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.235348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e29337-2e3d-48b2-b05d-7b7cf8ac7314 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.240427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586a7d2-fc28-4ff8-8d3e-7d88dbd2c59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.241099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a7d2-fc28-4ff8-8d3e-7d88dbd2c59f admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.241386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a7d2-fc28-4ff8-8d3e-7d88dbd2c59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.241666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a7d2-fc28-4ff8-8d3e-7d88dbd2c59f admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.242843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586a7d2-fc28-4ff8-8d3e-7d88dbd2c59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.244130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586a7d2-fc28-4ff8-8d3e-7d88dbd2c59f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.257876 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 830/1632] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:48.259411 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586a7d2-fc28-4ff8-8d3e-7d88dbd2c59f admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.271409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586a7d2-fc28-4ff8-8d3e-7d88dbd2c59f admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.276156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182917f5-38c0-48fa-bcb3-b2dfc0cfe090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.276831 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182917f5-38c0-48fa-bcb3-b2dfc0cfe090 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.277126 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182917f5-38c0-48fa-bcb3-b2dfc0cfe090 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.277408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182917f5-38c0-48fa-bcb3-b2dfc0cfe090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.288863 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182917f5-38c0-48fa-bcb3-b2dfc0cfe090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.290093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182917f5-38c0-48fa-bcb3-b2dfc0cfe090 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.302108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 831/1633] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:48.303161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182917f5-38c0-48fa-bcb3-b2dfc0cfe090 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.313806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182917f5-38c0-48fa-bcb3-b2dfc0cfe090 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.319697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9fb30-8936-44f4-ad02-bb06df9fffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.320481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9fb30-8936-44f4-ad02-bb06df9fffc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.321837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9fb30-8936-44f4-ad02-bb06df9fffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.321961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9fb30-8936-44f4-ad02-bb06df9fffc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.322796 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9fb30-8936-44f4-ad02-bb06df9fffc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.324485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9fb30-8936-44f4-ad02-bb06df9fffc3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.335755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 832/1634] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:48.337607 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9fb30-8936-44f4-ad02-bb06df9fffc3 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.339453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ad6d2-46fb-467b-9d72-de79b3d9ac91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.340772 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-edf9fb30-8936-44f4-ad02-bb06df9fffc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:48.340911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ad6d2-46fb-467b-9d72-de79b3d9ac91 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.358854 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9fb30-8936-44f4-ad02-bb06df9fffc3 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.365603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac96e0-5d68-453f-bd7b-7321f62a4255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.366930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac96e0-5d68-453f-bd7b-7321f62a4255 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.367239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac96e0-5d68-453f-bd7b-7321f62a4255 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.367717 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac96e0-5d68-453f-bd7b-7321f62a4255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.369359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 803/1635] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:48.370308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ad6d2-46fb-467b-9d72-de79b3d9ac91 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.381871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac96e0-5d68-453f-bd7b-7321f62a4255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.381871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac96e0-5d68-453f-bd7b-7321f62a4255 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.388603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ad6d2-46fb-467b-9d72-de79b3d9ac91 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.390115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 833/1636] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:48.391034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac96e0-5d68-453f-bd7b-7321f62a4255 service nova] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.405438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac96e0-5d68-453f-bd7b-7321f62a4255 service nova] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.409841 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80df89-e0d1-450b-849d-2215f46b59f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.410791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80df89-e0d1-450b-849d-2215f46b59f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.411747 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80df89-e0d1-450b-849d-2215f46b59f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.411747 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80df89-e0d1-450b-849d-2215f46b59f7 admin admin] PATH_INFO: `/v3/projects/d38422afedc248f1a75cc9b3de6e161a/users/8194c96361924f76aba20197aab78854/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.413436 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d186991-ae29-4829-b735-057b6a2e4d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.415533 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d186991-ae29-4829-b735-057b6a2e4d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.415836 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d186991-ae29-4829-b735-057b6a2e4d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.417519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d186991-ae29-4829-b735-057b6a2e4d88 admin admin] PATH_INFO: `/v3/projects/ffd1b457562a434db5aa3777df892a49/users/bee7370bf3f14afb8aa5c4818fe2b278/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.430688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80df89-e0d1-450b-849d-2215f46b59f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38422afedc248f1a75cc9b3de6e161a, user_id=8194c96361924f76aba20197aab78854, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.433752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80df89-e0d1-450b-849d-2215f46b59f7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.454201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d186991-ae29-4829-b735-057b6a2e4d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd1b457562a434db5aa3777df892a49, user_id=bee7370bf3f14afb8aa5c4818fe2b278, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.456874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d186991-ae29-4829-b735-057b6a2e4d88 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.572853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 804/1637] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:48 2022] PUT /identity/v3/projects/d38422afedc248f1a75cc9b3de6e161a/users/8194c96361924f76aba20197aab78854/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:48.577367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80df89-e0d1-450b-849d-2215f46b59f7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.604956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 834/1638] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:48 2022] PUT /identity/v3/projects/ffd1b457562a434db5aa3777df892a49/users/bee7370bf3f14afb8aa5c4818fe2b278/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:48.608967 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d186991-ae29-4829-b735-057b6a2e4d88 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.716315 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80df89-e0d1-450b-849d-2215f46b59f7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.783499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d186991-ae29-4829-b735-057b6a2e4d88 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.806099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2164f-de97-4c13-87c0-5965d8ca0c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.809093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2164f-de97-4c13-87c0-5965d8ca0c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.809398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2164f-de97-4c13-87c0-5965d8ca0c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.809684 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2164f-de97-4c13-87c0-5965d8ca0c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.813685 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2164f-de97-4c13-87c0-5965d8ca0c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.819695 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2164f-de97-4c13-87c0-5965d8ca0c79 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.828091 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f4265-ee84-4991-a4eb-db9a66a0896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.829072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f4265-ee84-4991-a4eb-db9a66a0896d admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.833141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f4265-ee84-4991-a4eb-db9a66a0896d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.833141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f4265-ee84-4991-a4eb-db9a66a0896d admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.833141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f4265-ee84-4991-a4eb-db9a66a0896d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.833554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f4265-ee84-4991-a4eb-db9a66a0896d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.847343 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 805/1639] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:32:48.853599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f4265-ee84-4991-a4eb-db9a66a0896d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.857584 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 835/1640] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:48.858994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2164f-de97-4c13-87c0-5965d8ca0c79 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:48.873700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f4265-ee84-4991-a4eb-db9a66a0896d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.874694 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2164f-de97-4c13-87c0-5965d8ca0c79 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:48.881714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822660a3-7d7b-479d-864c-04e8d42416c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.882879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822660a3-7d7b-479d-864c-04e8d42416c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.884149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822660a3-7d7b-479d-864c-04e8d42416c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.884443 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822660a3-7d7b-479d-864c-04e8d42416c7 admin admin] PATH_INFO: `/v3/projects/ffd1b457562a434db5aa3777df892a49/users/bee7370bf3f14afb8aa5c4818fe2b278/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.887021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdfd9f-03df-4a26-897a-caae1cc72d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:48.887945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdfd9f-03df-4a26-897a-caae1cc72d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.888233 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdfd9f-03df-4a26-897a-caae1cc72d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.888637 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdfd9f-03df-4a26-897a-caae1cc72d1b admin admin] PATH_INFO: `/v3/projects/d38422afedc248f1a75cc9b3de6e161a/users/8194c96361924f76aba20197aab78854/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.892471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdfd9f-03df-4a26-897a-caae1cc72d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38422afedc248f1a75cc9b3de6e161a, user_id=8194c96361924f76aba20197aab78854, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.893493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdfd9f-03df-4a26-897a-caae1cc72d1b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.893604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822660a3-7d7b-479d-864c-04e8d42416c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd1b457562a434db5aa3777df892a49, user_id=bee7370bf3f14afb8aa5c4818fe2b278, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:48.905354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822660a3-7d7b-479d-864c-04e8d42416c7 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:48.920894 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 806/1641] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:48 2022] PUT /identity/v3/projects/d38422afedc248f1a75cc9b3de6e161a/users/8194c96361924f76aba20197aab78854/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:32:48.932070 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a083d8d-bdf2-43ef-a890-31fe31c7f097 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.932374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a083d8d-bdf2-43ef-a890-31fe31c7f097 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.932646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a083d8d-bdf2-43ef-a890-31fe31c7f097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.941046 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 836/1642] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:48 2022] PUT /identity/v3/projects/ffd1b457562a434db5aa3777df892a49/users/bee7370bf3f14afb8aa5c4818fe2b278/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:48.944900 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b94c8-9b23-4642-be9a-8e18246fae4c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:48.945147 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b94c8-9b23-4642-be9a-8e18246fae4c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:48.946115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b94c8-9b23-4642-be9a-8e18246fae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:48.981935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3a083d8d-bdf2-43ef-a890-31fe31c7f097 None None] MFA Rules not processed for user `8194c96361924f76aba20197aab78854`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:48.985952 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3a083d8d-bdf2-43ef-a890-31fe31c7f097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:49.009936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-004b94c8-9b23-4642-be9a-8e18246fae4c None None] MFA Rules not processed for user `bee7370bf3f14afb8aa5c4818fe2b278`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:49.009936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-004b94c8-9b23-4642-be9a-8e18246fae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:49.121065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 837/1643] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:49.139947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 807/1644] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:49.760861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b94c8-9b23-4642-be9a-8e18246fae4c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:49.763187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-004b94c8-9b23-4642-be9a-8e18246fae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:49.864387 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b94c8-9b23-4642-be9a-8e18246fae4c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:49.872408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3026e-9d4a-4f01-bb93-a01061ea7b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:49.872408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3026e-9d4a-4f01-bb93-a01061ea7b82 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:49.883941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3026e-9d4a-4f01-bb93-a01061ea7b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:49.885463 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3026e-9d4a-4f01-bb93-a01061ea7b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:49.904381 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3026e-9d4a-4f01-bb93-a01061ea7b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:49.907719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a083d8d-bdf2-43ef-a890-31fe31c7f097 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:49.909382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3a083d8d-bdf2-43ef-a890-31fe31c7f097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:49.911935 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3026e-9d4a-4f01-bb93-a01061ea7b82 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:49.964980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 838/1645] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:50.092687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a083d8d-bdf2-43ef-a890-31fe31c7f097 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:50.107237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:50.108132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:50.108422 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:50.108700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] PATH_INFO: `/v3/projects/a9c3dfa3088a4ce38b4253a372e380ee` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:50.110028 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9c3dfa3088a4ce38b4253a372e380ee)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:50.112757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:50.113419 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3026e-9d4a-4f01-bb93-a01061ea7b82 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:50.128626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3026e-9d4a-4f01-bb93-a01061ea7b82 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:50.138051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4458d1-b8ae-4d81-8703-f0376768d74e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:50.138761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4458d1-b8ae-4d81-8703-f0376768d74e service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:50.139046 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4458d1-b8ae-4d81-8703-f0376768d74e service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:50.139313 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4458d1-b8ae-4d81-8703-f0376768d74e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:50.168220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4458d1-b8ae-4d81-8703-f0376768d74e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:50.172575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4458d1-b8ae-4d81-8703-f0376768d74e service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:50.203665 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 839/1646] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:50.354115 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9c3dfa3088a4ce38b4253a372e380ee', 'request_id': 'req-aba0ce30-82c9-453f-a673-86c81c88946a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:50.374189 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9c3dfa3088a4ce38b4253a372e380ee', 'request_id': 'req-aba0ce30-82c9-453f-a673-86c81c88946a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:50.454041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9c3dfa3088a4ce38b4253a372e380ee', 'request_id': 'req-aba0ce30-82c9-453f-a673-86c81c88946a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:50.471349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] The token cache is being invalidate because project a9c3dfa3088a4ce38b4253a372e380ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:50.472356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:50.472785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:50.480405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 808/1647] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:32:49 2022] DELETE /identity/v3/projects/a9c3dfa3088a4ce38b4253a372e380ee => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:32:50.482297 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193ca1d-4839-476f-acd4-177417b292e5 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:50.482594 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193ca1d-4839-476f-acd4-177417b292e5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:50.482874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193ca1d-4839-476f-acd4-177417b292e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:50.509861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6193ca1d-4839-476f-acd4-177417b292e5 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:50.511443 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6193ca1d-4839-476f-acd4-177417b292e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:50.563820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:50.565825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:50.605367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 840/1648] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:50.613843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452e66d-f597-446e-a4c6-c8cc0dc46d03 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:50.617555 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452e66d-f597-446e-a4c6-c8cc0dc46d03 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:50.618438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452e66d-f597-446e-a4c6-c8cc0dc46d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:50.669426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-1452e66d-f597-446e-a4c6-c8cc0dc46d03 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:50.670841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1452e66d-f597-446e-a4c6-c8cc0dc46d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:50.691335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 841/1649] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:50.692710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452e66d-f597-446e-a4c6-c8cc0dc46d03 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:50.703645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452e66d-f597-446e-a4c6-c8cc0dc46d03 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:50.716245 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194c87c-00f9-4032-b861-f530471fafec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:50.717064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194c87c-00f9-4032-b861-f530471fafec admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:50.717545 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194c87c-00f9-4032-b861-f530471fafec admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:50.717895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194c87c-00f9-4032-b861-f530471fafec admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:50.718802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194c87c-00f9-4032-b861-f530471fafec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:50.719767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194c87c-00f9-4032-b861-f530471fafec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:50.725217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194c87c-00f9-4032-b861-f530471fafec admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:50.738209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0ce30-82c9-453f-a673-86c81c88946a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:50.740474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 842/1650] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:50.745034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194c87c-00f9-4032-b861-f530471fafec admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:50.746982 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55469b-21da-453f-8632-0293a0e667f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:50.747658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55469b-21da-453f-8632-0293a0e667f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:50.747947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55469b-21da-453f-8632-0293a0e667f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:50.748225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55469b-21da-453f-8632-0293a0e667f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:50.760020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194c87c-00f9-4032-b861-f530471fafec admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:50.770631 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fa55469b-21da-453f-8632-0293a0e667f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:50.778146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f78e52-a05d-458a-b867-49b73f5bf17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:50.781832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78e52-a05d-458a-b867-49b73f5bf17e admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:50.782399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78e52-a05d-458a-b867-49b73f5bf17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:50.782897 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78e52-a05d-458a-b867-49b73f5bf17e admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:50.783837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f78e52-a05d-458a-b867-49b73f5bf17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:50.786529 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f78e52-a05d-458a-b867-49b73f5bf17e admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:50.852165 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55469b-21da-453f-8632-0293a0e667f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:50.854696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55469b-21da-453f-8632-0293a0e667f7 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:50.885990 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 809/1651] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:50.887385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84f3d-f742-43d8-88fb-248c82738faa None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:50.887680 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84f3d-f742-43d8-88fb-248c82738faa None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:50.893003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84f3d-f742-43d8-88fb-248c82738faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:50.926774 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 843/1652] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:32:50 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:32:50.928007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f78e52-a05d-458a-b867-49b73f5bf17e admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:50.933417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b7b84f3d-f742-43d8-88fb-248c82738faa None None] MFA Rules not processed for user `987d85f00a4e47568c4085979ea8f8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:50.935005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b7b84f3d-f742-43d8-88fb-248c82738faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:51.061867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f78e52-a05d-458a-b867-49b73f5bf17e admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:51.064245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 810/1653] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:51.076670 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84f3d-f742-43d8-88fb-248c82738faa None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:51.081172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b7b84f3d-f742-43d8-88fb-248c82738faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:51.091346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77b1a8-5f8c-4ad7-be98-ce1028e0d94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:51.091346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77b1a8-5f8c-4ad7-be98-ce1028e0d94a admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:51.091346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77b1a8-5f8c-4ad7-be98-ce1028e0d94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:51.091346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77b1a8-5f8c-4ad7-be98-ce1028e0d94a admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:51.091923 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77b1a8-5f8c-4ad7-be98-ce1028e0d94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:51.099188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77b1a8-5f8c-4ad7-be98-ce1028e0d94a admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:51.186556 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84f3d-f742-43d8-88fb-248c82738faa None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:51.191685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f19ce5-dad7-49da-892f-b4e643791729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:51.192639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f19ce5-dad7-49da-892f-b4e643791729 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:51.193120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f19ce5-dad7-49da-892f-b4e643791729 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:51.193548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f19ce5-dad7-49da-892f-b4e643791729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:51.196275 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b0f19ce5-dad7-49da-892f-b4e643791729 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:51.208217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 844/1654] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:32:50 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:51.211500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5962e4-1fe5-49c9-b6b0-4a5d863d85c6 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:51.212056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5962e4-1fe5-49c9-b6b0-4a5d863d85c6 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:51.212546 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5962e4-1fe5-49c9-b6b0-4a5d863d85c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:51.238244 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6c5962e4-1fe5-49c9-b6b0-4a5d863d85c6 None None] MFA Rules not processed for user `987d85f00a4e47568c4085979ea8f8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:51.240149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6c5962e4-1fe5-49c9-b6b0-4a5d863d85c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:51.274734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 845/1655] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:51.274734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5962e4-1fe5-49c9-b6b0-4a5d863d85c6 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:51.297004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5962e4-1fe5-49c9-b6b0-4a5d863d85c6 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:51.313048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeffbc-9a8d-4847-af39-95a73756c0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:51.314162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeffbc-9a8d-4847-af39-95a73756c0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:51.315087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeffbc-9a8d-4847-af39-95a73756c0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:51.331697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeffbc-9a8d-4847-af39-95a73756c0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:51.333997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeffbc-9a8d-4847-af39-95a73756c0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:51.337838 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeffbc-9a8d-4847-af39-95a73756c0e6 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:51.344112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f19ce5-dad7-49da-892f-b4e643791729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:51.347027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f19ce5-dad7-49da-892f-b4e643791729 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:51.360279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 846/1656] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:51.364615 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 811/1657] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:51.365587 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeffbc-9a8d-4847-af39-95a73756c0e6 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:51.376831 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeffbc-9a8d-4847-af39-95a73756c0e6 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:51.382015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd82c1-9294-4b3c-8c05-d830a028fc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:51.382774 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd82c1-9294-4b3c-8c05-d830a028fc65 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:51.383859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd82c1-9294-4b3c-8c05-d830a028fc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:51.383859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd82c1-9294-4b3c-8c05-d830a028fc65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:51.384589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd82c1-9294-4b3c-8c05-d830a028fc65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:51.386271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd82c1-9294-4b3c-8c05-d830a028fc65 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:51.409799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 847/1658] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:51.411713 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f19ce5-dad7-49da-892f-b4e643791729 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:51.428805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f19ce5-dad7-49da-892f-b4e643791729 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:51.436966 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4361e4-7234-4ca5-8f4f-88b2058a3d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:51.438178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4361e4-7234-4ca5-8f4f-88b2058a3d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:51.438676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4361e4-7234-4ca5-8f4f-88b2058a3d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:51.439121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4361e4-7234-4ca5-8f4f-88b2058a3d41 admin admin] PATH_INFO: `/v3/projects/3df45cf0e8c947d29a5f70b70c2306ef/users/8b457930e2684f89b0d1be43316b36f9/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:51.460242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4361e4-7234-4ca5-8f4f-88b2058a3d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df45cf0e8c947d29a5f70b70c2306ef, user_id=8b457930e2684f89b0d1be43316b36f9, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:51.464681 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4361e4-7234-4ca5-8f4f-88b2058a3d41 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:51.556402 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 812/1659] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:51 2022] PUT /identity/v3/projects/3df45cf0e8c947d29a5f70b70c2306ef/users/8b457930e2684f89b0d1be43316b36f9/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:51.567920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0caaf-c0c6-43c3-8366-557ff1af8120 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:51.568275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0caaf-c0c6-43c3-8366-557ff1af8120 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:51.568570 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0caaf-c0c6-43c3-8366-557ff1af8120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:51.605531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-58b0caaf-c0c6-43c3-8366-557ff1af8120 None None] MFA Rules not processed for user `8b457930e2684f89b0d1be43316b36f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:51.607938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-58b0caaf-c0c6-43c3-8366-557ff1af8120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:51.716398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 848/1660] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:51.722224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4361e4-7234-4ca5-8f4f-88b2058a3d41 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:51.780431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0caaf-c0c6-43c3-8366-557ff1af8120 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:51.781969 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-58b0caaf-c0c6-43c3-8366-557ff1af8120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:51.923592 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4361e4-7234-4ca5-8f4f-88b2058a3d41 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:51.925944 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0caaf-c0c6-43c3-8366-557ff1af8120 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:51.935853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ffedb-8f82-4818-8260-c5be5319f293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:51.936590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ffedb-8f82-4818-8260-c5be5319f293 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:51.936841 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ffedb-8f82-4818-8260-c5be5319f293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:51.937073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ffedb-8f82-4818-8260-c5be5319f293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:51.938050 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ffedb-8f82-4818-8260-c5be5319f293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:51.940040 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ffedb-8f82-4818-8260-c5be5319f293 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:51.965455 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aeca1-ad2b-4f57-bbb2-f13a0de92985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:51.967296 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aeca1-ad2b-4f57-bbb2-f13a0de92985 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:51.970061 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aeca1-ad2b-4f57-bbb2-f13a0de92985 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:51.971356 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aeca1-ad2b-4f57-bbb2-f13a0de92985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:52.288640 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 813/1661] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:32:51 2022] POST /identity/v3/projects => generated 379 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:52.288640 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ffedb-8f82-4818-8260-c5be5319f293 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:52.293468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aeca1-ad2b-4f57-bbb2-f13a0de92985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:52.293468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aeca1-ad2b-4f57-bbb2-f13a0de92985 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:52.297182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ffedb-8f82-4818-8260-c5be5319f293 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:52.297182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a551b3-7b48-4f50-bc34-9500b7c54786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:52.297182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a551b3-7b48-4f50-bc34-9500b7c54786 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:52.297182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a551b3-7b48-4f50-bc34-9500b7c54786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:52.302656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a551b3-7b48-4f50-bc34-9500b7c54786 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:52.302656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a551b3-7b48-4f50-bc34-9500b7c54786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:52.302656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a551b3-7b48-4f50-bc34-9500b7c54786 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:52.303714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 849/1662] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:32:52.454955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 814/1663] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:32:52 2022] POST /identity/v3/users => generated 296 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:52.456851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aeca1-ad2b-4f57-bbb2-f13a0de92985 service nova] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:52.476560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aeca1-ad2b-4f57-bbb2-f13a0de92985 service nova] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:52.496293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d2363-d9ed-4298-adcb-ba6f01538736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:52.497257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d2363-d9ed-4298-adcb-ba6f01538736 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:52.497673 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d2363-d9ed-4298-adcb-ba6f01538736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:52.498072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d2363-d9ed-4298-adcb-ba6f01538736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:52.499411 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d2363-d9ed-4298-adcb-ba6f01538736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:52.503440 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d2363-d9ed-4298-adcb-ba6f01538736 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:52.550896 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 850/1664] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:52.551650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a551b3-7b48-4f50-bc34-9500b7c54786 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:52.566513 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a551b3-7b48-4f50-bc34-9500b7c54786 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:52.579987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd929a65-4c56-48cb-a00d-b05e7ad4e477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:52.580897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd929a65-4c56-48cb-a00d-b05e7ad4e477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:52.581180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd929a65-4c56-48cb-a00d-b05e7ad4e477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:52.581457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd929a65-4c56-48cb-a00d-b05e7ad4e477 admin admin] PATH_INFO: `/v3/projects/bb789d89f9ec40eeaeddcf879567cc0d/users/0001d16ffc9e48edbc1f1c6306c1cdfd/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:52.612492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd929a65-4c56-48cb-a00d-b05e7ad4e477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb789d89f9ec40eeaeddcf879567cc0d, user_id=0001d16ffc9e48edbc1f1c6306c1cdfd, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:52.615515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd929a65-4c56-48cb-a00d-b05e7ad4e477 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:52.714663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 815/1665] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:52 2022] PUT /identity/v3/projects/bb789d89f9ec40eeaeddcf879567cc0d/users/0001d16ffc9e48edbc1f1c6306c1cdfd/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:32:52.719258 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d2363-d9ed-4298-adcb-ba6f01538736 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:52.737601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d2363-d9ed-4298-adcb-ba6f01538736 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:52.872183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685cac6-9098-4792-a3d5-00250700351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:52.872872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685cac6-9098-4792-a3d5-00250700351d admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:52.873331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685cac6-9098-4792-a3d5-00250700351d admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:52.873610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685cac6-9098-4792-a3d5-00250700351d admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:52.874370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685cac6-9098-4792-a3d5-00250700351d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:52.875971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685cac6-9098-4792-a3d5-00250700351d admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:52.896692 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 851/1666] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:52.901076 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd929a65-4c56-48cb-a00d-b05e7ad4e477 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:52.915897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd929a65-4c56-48cb-a00d-b05e7ad4e477 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:52.929818 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62958f68-38cc-4a51-95f0-ccb174d6aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:52.931455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62958f68-38cc-4a51-95f0-ccb174d6aa98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:52.931900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62958f68-38cc-4a51-95f0-ccb174d6aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:52.932323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62958f68-38cc-4a51-95f0-ccb174d6aa98 admin admin] PATH_INFO: `/v3/projects/bb789d89f9ec40eeaeddcf879567cc0d/users/0001d16ffc9e48edbc1f1c6306c1cdfd/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:52.937723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62958f68-38cc-4a51-95f0-ccb174d6aa98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb789d89f9ec40eeaeddcf879567cc0d, user_id=0001d16ffc9e48edbc1f1c6306c1cdfd, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:52.944760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62958f68-38cc-4a51-95f0-ccb174d6aa98 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:52.975134 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 816/1667] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:32:52 2022] PUT /identity/v3/projects/bb789d89f9ec40eeaeddcf879567cc0d/users/0001d16ffc9e48edbc1f1c6306c1cdfd/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:52.985349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b434d5-9bdb-40fd-9ac2-a24c7b4b2b91 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:52.985639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b434d5-9bdb-40fd-9ac2-a24c7b4b2b91 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:52.985921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b434d5-9bdb-40fd-9ac2-a24c7b4b2b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:53.062693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-73b434d5-9bdb-40fd-9ac2-a24c7b4b2b91 None None] MFA Rules not processed for user `0001d16ffc9e48edbc1f1c6306c1cdfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:53.064407 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-73b434d5-9bdb-40fd-9ac2-a24c7b4b2b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:53.152540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97710741-e0cc-4b5e-8e10-c450a481c06d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:53.153050 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97710741-e0cc-4b5e-8e10-c450a481c06d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:53.153473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97710741-e0cc-4b5e-8e10-c450a481c06d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:53.155387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 817/1668] 10.222.0.44 () {54 vars in 912 bytes} [Thu May 5 15:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:32:53.161280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ceef9-35ef-47ad-a962-4df0e911a3b8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:53.161761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ceef9-35ef-47ad-a962-4df0e911a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:53.162184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ceef9-35ef-47ad-a962-4df0e911a3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:53.222555 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 852/1669] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:53.237539 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-981ceef9-35ef-47ad-a962-4df0e911a3b8 None None] MFA Rules not processed for user `c5efb606fb1b422182ab91576088c85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:53.239229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-981ceef9-35ef-47ad-a962-4df0e911a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:53.317502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 818/1670] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:32:53.341823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b434d5-9bdb-40fd-9ac2-a24c7b4b2b91 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:53.343580 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-73b434d5-9bdb-40fd-9ac2-a24c7b4b2b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:53.362539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b434d5-9bdb-40fd-9ac2-a24c7b4b2b91 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:53.372337 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ceef9-35ef-47ad-a962-4df0e911a3b8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:53.377767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa2011-9400-46a4-a198-3b62b6d9b229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:53.382681 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2011-9400-46a4-a198-3b62b6d9b229 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:53.385584 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2011-9400-46a4-a198-3b62b6d9b229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:53.385872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2011-9400-46a4-a198-3b62b6d9b229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:53.399010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa2011-9400-46a4-a198-3b62b6d9b229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:53.400829 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa2011-9400-46a4-a198-3b62b6d9b229 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:53.410974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 853/1671] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:53.451452 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ceef9-35ef-47ad-a962-4df0e911a3b8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:53.455723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cd28e-b5cc-4f84-bef5-de66545f4148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:53.456477 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cd28e-b5cc-4f84-bef5-de66545f4148 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:53.456827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cd28e-b5cc-4f84-bef5-de66545f4148 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:53.457170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cd28e-b5cc-4f84-bef5-de66545f4148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:53.469447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cd28e-b5cc-4f84-bef5-de66545f4148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:53.471466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cd28e-b5cc-4f84-bef5-de66545f4148 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:53.487158 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 819/1672] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:54.776934 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7614450-e79a-437e-9d43-eceb51e411b4 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:54.777515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7614450-e79a-437e-9d43-eceb51e411b4 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:54.777687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7614450-e79a-437e-9d43-eceb51e411b4 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:54.779537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 854/1673] 10.222.0.44 () {54 vars in 960 bytes} [Thu May 5 15:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:54.788917 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68367f3b-e380-4902-bc39-d78aca91addc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:54.789830 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68367f3b-e380-4902-bc39-d78aca91addc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:54.790504 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68367f3b-e380-4902-bc39-d78aca91addc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:54.847351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-68367f3b-e380-4902-bc39-d78aca91addc None None] MFA Rules not processed for user `db978c3b147c4b259b623e8c64e7c13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:54.853327 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-68367f3b-e380-4902-bc39-d78aca91addc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:55.003051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 820/1674] 10.222.0.44 () {58 vars in 1057 bytes} [Thu May 5 15:32:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:55.011182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7614450-e79a-437e-9d43-eceb51e411b4 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:55.041708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7614450-e79a-437e-9d43-eceb51e411b4 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:55.061374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a3629-c5cc-4f40-a54e-627de3fe968b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db978c3b147c4b259b623e8c64e7c13a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:55.062064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a3629-c5cc-4f40-a54e-627de3fe968b service placement] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:55.062378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a3629-c5cc-4f40-a54e-627de3fe968b service placement] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:55.062655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a3629-c5cc-4f40-a54e-627de3fe968b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:55.070145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2b4a3629-c5cc-4f40-a54e-627de3fe968b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:55.104894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a3629-c5cc-4f40-a54e-627de3fe968b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:55.109367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a3629-c5cc-4f40-a54e-627de3fe968b service placement] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:55.140353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 855/1675] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:55.501197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68367f3b-e380-4902-bc39-d78aca91addc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:55.518992 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68367f3b-e380-4902-bc39-d78aca91addc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:55.540627 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc3219-d6a9-4ba2-b514-01cb9eff5c58 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0001d16ffc9e48edbc1f1c6306c1cdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb789d89f9ec40eeaeddcf879567cc0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:55.541618 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3219-d6a9-4ba2-b514-01cb9eff5c58 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:55.542213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3219-d6a9-4ba2-b514-01cb9eff5c58 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:55.542707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3219-d6a9-4ba2-b514-01cb9eff5c58 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:55.543998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc3219-d6a9-4ba2-b514-01cb9eff5c58 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:55.544458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc3219-d6a9-4ba2-b514-01cb9eff5c58 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:55.547184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc3219-d6a9-4ba2-b514-01cb9eff5c58 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:55.574344 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 821/1676] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:55.580827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a3629-c5cc-4f40-a54e-627de3fe968b service placement] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:55.611669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a3629-c5cc-4f40-a54e-627de3fe968b service placement] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:55.624337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f14ef-53d8-4a33-8dac-103e43f54c1c tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0001d16ffc9e48edbc1f1c6306c1cdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb789d89f9ec40eeaeddcf879567cc0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:55.625104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f14ef-53d8-4a33-8dac-103e43f54c1c tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:55.630334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f14ef-53d8-4a33-8dac-103e43f54c1c tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:55.630334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f14ef-53d8-4a33-8dac-103e43f54c1c tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:55.630334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f14ef-53d8-4a33-8dac-103e43f54c1c tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:55.630334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f14ef-53d8-4a33-8dac-103e43f54c1c tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:55.784898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 856/1677] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:32:55 2022] POST /identity/v3/projects => generated 353 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:32:55.788704 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc3219-d6a9-4ba2-b514-01cb9eff5c58 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:55.809083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc3219-d6a9-4ba2-b514-01cb9eff5c58 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:56.051250 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf56b5-5746-42ef-bbf9-9403a6eab8c4 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0001d16ffc9e48edbc1f1c6306c1cdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb789d89f9ec40eeaeddcf879567cc0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:56.051929 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf56b5-5746-42ef-bbf9-9403a6eab8c4 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:56.052378 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf56b5-5746-42ef-bbf9-9403a6eab8c4 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:56.054522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf56b5-5746-42ef-bbf9-9403a6eab8c4 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:56.058203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf56b5-5746-42ef-bbf9-9403a6eab8c4 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:56.059090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf56b5-5746-42ef-bbf9-9403a6eab8c4 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:56.068774 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf56b5-5746-42ef-bbf9-9403a6eab8c4 tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:56.100637 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 822/1678] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:32:56.321192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f14ef-53d8-4a33-8dac-103e43f54c1c tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:56.335411 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f14ef-53d8-4a33-8dac-103e43f54c1c tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:56.345051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0001d16ffc9e48edbc1f1c6306c1cdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb789d89f9ec40eeaeddcf879567cc0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:56.347053 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:56.347523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:56.347977 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] PATH_INFO: `/v3/projects/3b93dd9f743d4c269f9913324b789f5f` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:56.349382 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3b93dd9f743d4c269f9913324b789f5f)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:56.352668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: WARNING py.warnings [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:32:56.352668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: warnings.warn(msg) May 05 15:32:56.352668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: May 05 15:32:56.358331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:56.495641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c226a81-e9d9-44af-86c8-914e58434c2e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:56.496135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c226a81-e9d9-44af-86c8-914e58434c2e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:56.496617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c226a81-e9d9-44af-86c8-914e58434c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:56.557064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b93dd9f743d4c269f9913324b789f5f', 'request_id': 'req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:56.573056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b93dd9f743d4c269f9913324b789f5f', 'request_id': 'req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:56.631444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b93dd9f743d4c269f9913324b789f5f', 'request_id': 'req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:56.658180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] The token cache is being invalidate because project 3b93dd9f743d4c269f9913324b789f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:32:56.658520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:56.662385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:56.664905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 857/1679] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:32:56 2022] DELETE /identity/v3/projects/3b93dd9f743d4c269f9913324b789f5f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:56.769623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3c226a81-e9d9-44af-86c8-914e58434c2e None None] MFA Rules not processed for user `82f193153bf04ff8b39a9ecf3da423ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:56.770906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3c226a81-e9d9-44af-86c8-914e58434c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:56.861658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 823/1680] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:56.876535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:56.878120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:57.001168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c5c71-e44a-40b1-811d-3a293dd59c4f tempest-VolumeQuotaClassesTest-443024063 tempest-VolumeQuotaClassesTest-443024063-project-admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:57.007400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7fe22-27a6-4a5b-bcc9-a6d7fc9177d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:57.009724 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7fe22-27a6-4a5b-bcc9-a6d7fc9177d7 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:57.009724 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7fe22-27a6-4a5b-bcc9-a6d7fc9177d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:57.009724 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7fe22-27a6-4a5b-bcc9-a6d7fc9177d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:57.019254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7fe22-27a6-4a5b-bcc9-a6d7fc9177d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:57.021065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7fe22-27a6-4a5b-bcc9-a6d7fc9177d7 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:57.043218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 858/1681] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:57.284025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f33bd-11eb-49aa-98d1-80cbe80128c0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:57.284323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f33bd-11eb-49aa-98d1-80cbe80128c0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:57.284609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f33bd-11eb-49aa-98d1-80cbe80128c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:57.371996 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-818f33bd-11eb-49aa-98d1-80cbe80128c0 None None] MFA Rules not processed for user `8e128963426d4f129226a981689531a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:57.373447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-818f33bd-11eb-49aa-98d1-80cbe80128c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:57.518683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 824/1682] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:57.581363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7fe22-27a6-4a5b-bcc9-a6d7fc9177d7 service nova] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:57.604952 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7fe22-27a6-4a5b-bcc9-a6d7fc9177d7 service nova] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:57.637955 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f13e0-a949-40ad-b58e-bc19bd413001 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:57.638654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f13e0-a949-40ad-b58e-bc19bd413001 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:57.638940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f13e0-a949-40ad-b58e-bc19bd413001 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:57.639218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f13e0-a949-40ad-b58e-bc19bd413001 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:57.656067 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f13e0-a949-40ad-b58e-bc19bd413001 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:57.660927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f13e0-a949-40ad-b58e-bc19bd413001 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:57.681839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 859/1683] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:32:57.873696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f33bd-11eb-49aa-98d1-80cbe80128c0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:57.876359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-818f33bd-11eb-49aa-98d1-80cbe80128c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:57.928264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f13e0-a949-40ad-b58e-bc19bd413001 service nova] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:57.931817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-809f13e0-a949-40ad-b58e-bc19bd413001 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:58.066921 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f33bd-11eb-49aa-98d1-80cbe80128c0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:58.073659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6006053-5393-4f32-805a-9135126b3976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:58.075030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6006053-5393-4f32-805a-9135126b3976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:58.075461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6006053-5393-4f32-805a-9135126b3976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:58.076530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6006053-5393-4f32-805a-9135126b3976 admin admin] PATH_INFO: `/v3/users/8b457930e2684f89b0d1be43316b36f9` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:58.082601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6006053-5393-4f32-805a-9135126b3976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b457930e2684f89b0d1be43316b36f9)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:58.086131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6006053-5393-4f32-805a-9135126b3976 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:58.145807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f13e0-a949-40ad-b58e-bc19bd413001 service nova] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:58.171791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:58.173873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:58.174168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:58.179291 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] PATH_INFO: `/v3/users/609c5fce0bae46b696fca1971f9dcdea` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:58.181453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609c5fce0bae46b696fca1971f9dcdea)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:58.183452 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:58.401728 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f6006053-5393-4f32-805a-9135126b3976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b457930e2684f89b0d1be43316b36f9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:58.420849 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f6006053-5393-4f32-805a-9135126b3976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b457930e2684f89b0d1be43316b36f9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:58.423917 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f6006053-5393-4f32-805a-9135126b3976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b457930e2684f89b0d1be43316b36f9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:58.424587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f6006053-5393-4f32-805a-9135126b3976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b457930e2684f89b0d1be43316b36f9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:58.445194 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f6006053-5393-4f32-805a-9135126b3976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b457930e2684f89b0d1be43316b36f9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:58.447351 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609c5fce0bae46b696fca1971f9dcdea'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:58.472170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609c5fce0bae46b696fca1971f9dcdea'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:58.592163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 825/1684] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:32:57 2022] DELETE /identity/v3/users/8b457930e2684f89b0d1be43316b36f9 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:58.596819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f9e15-df96-496f-9515-b4e2a0840b52 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:58.597563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f9e15-df96-496f-9515-b4e2a0840b52 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:58.598059 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f9e15-df96-496f-9515-b4e2a0840b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:58.650746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-6b5f9e15-df96-496f-9515-b4e2a0840b52 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:58.652521 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6b5f9e15-df96-496f-9515-b4e2a0840b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:58.666726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609c5fce0bae46b696fca1971f9dcdea'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:58.667449 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609c5fce0bae46b696fca1971f9dcdea'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:58.706058 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609c5fce0bae46b696fca1971f9dcdea'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:58.722786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 860/1685] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:32:57 2022] DELETE /identity/v3/users/609c5fce0bae46b696fca1971f9dcdea => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:58.723907 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:58.731274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:58.742243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 826/1686] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:58.744590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f154-54a6-4a01-87ca-a195ac1e27fa None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:58.752726 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f154-54a6-4a01-87ca-a195ac1e27fa None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:58.753444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f154-54a6-4a01-87ca-a195ac1e27fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:58.775782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7392f154-54a6-4a01-87ca-a195ac1e27fa None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:58.777231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7392f154-54a6-4a01-87ca-a195ac1e27fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:58.892645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 827/1687] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:32:58.893651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392f154-54a6-4a01-87ca-a195ac1e27fa None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:58.910193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7392f154-54a6-4a01-87ca-a195ac1e27fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:58.922990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fc43e-6b98-462c-a31a-772d1ded1cb2 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:58.929134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:58.931436 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:58.931866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:58.932334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] PATH_INFO: `/v3/users/4956411c8fc945eea06f127a1b4f3c70` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:58.933816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4956411c8fc945eea06f127a1b4f3c70)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:58.936102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:59.002441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392f154-54a6-4a01-87ca-a195ac1e27fa None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:59.006424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6152b3-2b22-4323-8681-a1027c64d066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:59.007348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6152b3-2b22-4323-8681-a1027c64d066 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:59.007630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6152b3-2b22-4323-8681-a1027c64d066 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:59.007936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6152b3-2b22-4323-8681-a1027c64d066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:59.027956 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6152b3-2b22-4323-8681-a1027c64d066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:59.029724 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6152b3-2b22-4323-8681-a1027c64d066 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:59.068901 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 828/1688] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:59.071841 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6152b3-2b22-4323-8681-a1027c64d066 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:59.115888 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6152b3-2b22-4323-8681-a1027c64d066 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:59.122420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae1fab-a715-4f8e-83bd-b60fa022b357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:59.123334 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae1fab-a715-4f8e-83bd-b60fa022b357 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:59.123743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae1fab-a715-4f8e-83bd-b60fa022b357 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:59.124157 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae1fab-a715-4f8e-83bd-b60fa022b357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:59.146579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae1fab-a715-4f8e-83bd-b60fa022b357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:59.148043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae1fab-a715-4f8e-83bd-b60fa022b357 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:59.171864 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 829/1689] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:32:59.172659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4956411c8fc945eea06f127a1b4f3c70'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:59.189636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4956411c8fc945eea06f127a1b4f3c70'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:59.259693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4956411c8fc945eea06f127a1b4f3c70'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:59.260314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4956411c8fc945eea06f127a1b4f3c70'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:59.317782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4956411c8fc945eea06f127a1b4f3c70'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:32:59.335290 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 861/1690] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:32:58 2022] DELETE /identity/v3/users/4956411c8fc945eea06f127a1b4f3c70 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:59.341183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17e5bd-51e7-4dcf-9858-ae068336e896 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:59.341556 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17e5bd-51e7-4dcf-9858-ae068336e896 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:59.342059 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17e5bd-51e7-4dcf-9858-ae068336e896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:59.395783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2c17e5bd-51e7-4dcf-9858-ae068336e896 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:59.397079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2c17e5bd-51e7-4dcf-9858-ae068336e896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:59.522632 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 830/1691] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:32:59.555328 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:59.557029 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:59.680999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1afde-9188-45f9-ad2c-d58b93ffb685 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:59.686257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b743f34-853a-4ba3-9125-fa25ce9b4291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:59.688381 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b743f34-853a-4ba3-9125-fa25ce9b4291 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:59.688842 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b743f34-853a-4ba3-9125-fa25ce9b4291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:59.689261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b743f34-853a-4ba3-9125-fa25ce9b4291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:59.710011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b743f34-853a-4ba3-9125-fa25ce9b4291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:59.712917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b743f34-853a-4ba3-9125-fa25ce9b4291 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:59.725057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 862/1692] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:00.268041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17e5bd-51e7-4dcf-9858-ae068336e896 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:00.269671 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2c17e5bd-51e7-4dcf-9858-ae068336e896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:00.293135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17e5bd-51e7-4dcf-9858-ae068336e896 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:00.306431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:00.307330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:00.307605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:00.307881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] PATH_INFO: `/v3/projects/3df45cf0e8c947d29a5f70b70c2306ef` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:00.309756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df45cf0e8c947d29a5f70b70c2306ef)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:00.311945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:00.457800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df45cf0e8c947d29a5f70b70c2306ef', 'request_id': 'req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:00.469810 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df45cf0e8c947d29a5f70b70c2306ef', 'request_id': 'req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:00.551173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df45cf0e8c947d29a5f70b70c2306ef', 'request_id': 'req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:00.566772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] The token cache is being invalidate because project 3df45cf0e8c947d29a5f70b70c2306ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:00.567287 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:00.567947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:00.574273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 831/1693] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:00 2022] DELETE /identity/v3/projects/3df45cf0e8c947d29a5f70b70c2306ef => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:00.575476 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b743f34-853a-4ba3-9125-fa25ce9b4291 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:00.586108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b743f34-853a-4ba3-9125-fa25ce9b4291 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:00.615108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:00.619167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:00.696149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:00.699882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:00.700168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:00.702275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] PATH_INFO: `/v3/users/0001d16ffc9e48edbc1f1c6306c1cdfd` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:00.707921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0001d16ffc9e48edbc1f1c6306c1cdfd)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:00.712237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:00.733085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdd6c0-923e-437e-b2cb-1748f542b9d4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:00.744425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:00.745540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:00.746005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:00.746345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] PATH_INFO: `/v3/projects/2ecd98a479c547e69296da5873ea6052` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:00.748426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ecd98a479c547e69296da5873ea6052)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:00.751282 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:00.943016 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ecd98a479c547e69296da5873ea6052', 'request_id': 'req-f4760880-5fa0-4067-9902-7e5823e7b685'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:00.946889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0001d16ffc9e48edbc1f1c6306c1cdfd'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:00.950319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ecd98a479c547e69296da5873ea6052', 'request_id': 'req-f4760880-5fa0-4067-9902-7e5823e7b685'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:00.955706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0001d16ffc9e48edbc1f1c6306c1cdfd'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.008953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ecd98a479c547e69296da5873ea6052', 'request_id': 'req-f4760880-5fa0-4067-9902-7e5823e7b685'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.022213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] The token cache is being invalidate because project 2ecd98a479c547e69296da5873ea6052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:01.022569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.023324 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.027623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 832/1694] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:00 2022] DELETE /identity/v3/projects/2ecd98a479c547e69296da5873ea6052 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:01.028473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:01.029937 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:01.065557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0001d16ffc9e48edbc1f1c6306c1cdfd'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.066544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0001d16ffc9e48edbc1f1c6306c1cdfd'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.083835 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0001d16ffc9e48edbc1f1c6306c1cdfd'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.095649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 863/1695] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:00 2022] DELETE /identity/v3/users/0001d16ffc9e48edbc1f1c6306c1cdfd => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:01.096909 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:01.098556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:01.193287 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4760880-5fa0-4067-9902-7e5823e7b685 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:01.196927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bac77a-6ff7-4ced-b045-e72160fad95e admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:01.200846 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04869e10-b01e-431a-a943-06843bc15cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:01.206443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04869e10-b01e-431a-a943-06843bc15cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:01.206443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04869e10-b01e-431a-a943-06843bc15cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:01.206443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04869e10-b01e-431a-a943-06843bc15cd7 admin admin] PATH_INFO: `/v3/projects/7bf48eb17c8e4f3fb2df34bc51db4b70` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:01.206750 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c172bab-a3d5-44b2-bab5-d74fb4cab420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:01.206846 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04869e10-b01e-431a-a943-06843bc15cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf48eb17c8e4f3fb2df34bc51db4b70)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:01.206913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c172bab-a3d5-44b2-bab5-d74fb4cab420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:01.206913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c172bab-a3d5-44b2-bab5-d74fb4cab420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:01.206913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c172bab-a3d5-44b2-bab5-d74fb4cab420 admin admin] PATH_INFO: `/v3/users/8194c96361924f76aba20197aab78854` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:01.206913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c172bab-a3d5-44b2-bab5-d74fb4cab420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8194c96361924f76aba20197aab78854)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:01.208313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04869e10-b01e-431a-a943-06843bc15cd7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:01.209311 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c172bab-a3d5-44b2-bab5-d74fb4cab420 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:01.434745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04869e10-b01e-431a-a943-06843bc15cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf48eb17c8e4f3fb2df34bc51db4b70', 'request_id': 'req-04869e10-b01e-431a-a943-06843bc15cd7'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.459377 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04869e10-b01e-431a-a943-06843bc15cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf48eb17c8e4f3fb2df34bc51db4b70', 'request_id': 'req-04869e10-b01e-431a-a943-06843bc15cd7'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.533305 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2c172bab-a3d5-44b2-bab5-d74fb4cab420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8194c96361924f76aba20197aab78854'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.545431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2c172bab-a3d5-44b2-bab5-d74fb4cab420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8194c96361924f76aba20197aab78854'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.565139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04869e10-b01e-431a-a943-06843bc15cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf48eb17c8e4f3fb2df34bc51db4b70', 'request_id': 'req-04869e10-b01e-431a-a943-06843bc15cd7'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.583716 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04869e10-b01e-431a-a943-06843bc15cd7 admin admin] The token cache is being invalidate because project 7bf48eb17c8e4f3fb2df34bc51db4b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:01.584288 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04869e10-b01e-431a-a943-06843bc15cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.585141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-04869e10-b01e-431a-a943-06843bc15cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.591815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 833/1696] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:01 2022] DELETE /identity/v3/projects/7bf48eb17c8e4f3fb2df34bc51db4b70 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:01.594000 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0f29-735a-4a09-b3f4-091c6c1a894d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:01.594493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0f29-735a-4a09-b3f4-091c6c1a894d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:01.594942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0f29-735a-4a09-b3f4-091c6c1a894d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:01.650700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0a2b0f29-735a-4a09-b3f4-091c6c1a894d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:01.652081 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0a2b0f29-735a-4a09-b3f4-091c6c1a894d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:01.683360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2c172bab-a3d5-44b2-bab5-d74fb4cab420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8194c96361924f76aba20197aab78854'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.685531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2c172bab-a3d5-44b2-bab5-d74fb4cab420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8194c96361924f76aba20197aab78854'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.703719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2c172bab-a3d5-44b2-bab5-d74fb4cab420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8194c96361924f76aba20197aab78854'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:01.714605 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 864/1697] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:01 2022] DELETE /identity/v3/users/8194c96361924f76aba20197aab78854 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:01.760143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 834/1698] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:01.771101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285d8d4-3fa6-4644-9c27-992f6cb4aa64 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:01.772250 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285d8d4-3fa6-4644-9c27-992f6cb4aa64 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:01.772816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285d8d4-3fa6-4644-9c27-992f6cb4aa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:01.797317 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6285d8d4-3fa6-4644-9c27-992f6cb4aa64 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:01.798942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6285d8d4-3fa6-4644-9c27-992f6cb4aa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:01.843864 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7e63-abce-4ba3-9ff1-6d9172c7eccc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:01.847783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7e63-abce-4ba3-9ff1-6d9172c7eccc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:01.856154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7e63-abce-4ba3-9ff1-6d9172c7eccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:01.878571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 865/1699] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:01.882252 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285d8d4-3fa6-4644-9c27-992f6cb4aa64 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:01.895828 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285d8d4-3fa6-4644-9c27-992f6cb4aa64 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:01.901964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca05338-3548-4036-a4ce-04c935250537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:01.902881 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05338-3548-4036-a4ce-04c935250537 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:01.904203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05338-3548-4036-a4ce-04c935250537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:01.904657 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05338-3548-4036-a4ce-04c935250537 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:01.905547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca05338-3548-4036-a4ce-04c935250537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:01.906048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca05338-3548-4036-a4ce-04c935250537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:01.908540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca05338-3548-4036-a4ce-04c935250537 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:01.926979 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 866/1700] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:33:01.932640 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca05338-3548-4036-a4ce-04c935250537 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:01.970940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8c8b7e63-abce-4ba3-9ff1-6d9172c7eccc None None] MFA Rules not processed for user `82f193153bf04ff8b39a9ecf3da423ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:01.979470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8c8b7e63-abce-4ba3-9ff1-6d9172c7eccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:01.979562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca05338-3548-4036-a4ce-04c935250537 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:01.989171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5c07a-8387-4eff-b7e3-338584cbd525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:01.989864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5c07a-8387-4eff-b7e3-338584cbd525 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:01.990157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5c07a-8387-4eff-b7e3-338584cbd525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:01.990513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5c07a-8387-4eff-b7e3-338584cbd525 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:01.991294 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5c07a-8387-4eff-b7e3-338584cbd525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:01.994372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5c07a-8387-4eff-b7e3-338584cbd525 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:02.160602 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 867/1701] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:01 2022] POST /identity/v3/projects => generated 365 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:02.166262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 835/1702] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:02.167252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7e63-abce-4ba3-9ff1-6d9172c7eccc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:02.179245 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5c07a-8387-4eff-b7e3-338584cbd525 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:02.182252 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4de5c07a-8387-4eff-b7e3-338584cbd525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:02.208378 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7e63-abce-4ba3-9ff1-6d9172c7eccc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:02.376895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5c07a-8387-4eff-b7e3-338584cbd525 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:02.379593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb9639-b0ab-4041-9a2f-48568f60ef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:02.380308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb9639-b0ab-4041-9a2f-48568f60ef8c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:02.380596 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb9639-b0ab-4041-9a2f-48568f60ef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:02.380875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb9639-b0ab-4041-9a2f-48568f60ef8c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:02.381625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb9639-b0ab-4041-9a2f-48568f60ef8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:02.393704 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb9639-b0ab-4041-9a2f-48568f60ef8c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:02.395200 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093bde7-d44a-429f-81ce-e9efb72d34de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:02.395994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093bde7-d44a-429f-81ce-e9efb72d34de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:02.396278 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093bde7-d44a-429f-81ce-e9efb72d34de admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:02.396554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093bde7-d44a-429f-81ce-e9efb72d34de admin admin] PATH_INFO: `/v3/projects/bb789d89f9ec40eeaeddcf879567cc0d` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:02.399277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093bde7-d44a-429f-81ce-e9efb72d34de admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb789d89f9ec40eeaeddcf879567cc0d)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:02.402075 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093bde7-d44a-429f-81ce-e9efb72d34de admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:02.517910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 836/1703] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:02 2022] POST /identity/v3/users => generated 283 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:02.519906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb3b2-bad7-49db-af0c-94f5d0f2c2af None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:02.521624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb3b2-bad7-49db-af0c-94f5d0f2c2af None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:02.522073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb3b2-bad7-49db-af0c-94f5d0f2c2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:02.578332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2093bde7-d44a-429f-81ce-e9efb72d34de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb789d89f9ec40eeaeddcf879567cc0d', 'request_id': 'req-2093bde7-d44a-429f-81ce-e9efb72d34de'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:02.588829 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2093bde7-d44a-429f-81ce-e9efb72d34de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb789d89f9ec40eeaeddcf879567cc0d', 'request_id': 'req-2093bde7-d44a-429f-81ce-e9efb72d34de'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:02.590093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-05ffb3b2-bad7-49db-af0c-94f5d0f2c2af None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:02.591386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-05ffb3b2-bad7-49db-af0c-94f5d0f2c2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:02.713527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2093bde7-d44a-429f-81ce-e9efb72d34de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb789d89f9ec40eeaeddcf879567cc0d', 'request_id': 'req-2093bde7-d44a-429f-81ce-e9efb72d34de'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:02.731597 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 837/1704] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:33:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:02.732596 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffb3b2-bad7-49db-af0c-94f5d0f2c2af None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:02.759751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2093bde7-d44a-429f-81ce-e9efb72d34de admin admin] The token cache is being invalidate because project bb789d89f9ec40eeaeddcf879567cc0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:02.760242 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2093bde7-d44a-429f-81ce-e9efb72d34de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:02.764151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2093bde7-d44a-429f-81ce-e9efb72d34de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:02.771238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 868/1705] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:02 2022] DELETE /identity/v3/projects/bb789d89f9ec40eeaeddcf879567cc0d => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:02.781703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb445f4-bb5c-4bed-b137-b465b0c5a31b None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:02.782440 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb445f4-bb5c-4bed-b137-b465b0c5a31b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:02.783080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb445f4-bb5c-4bed-b137-b465b0c5a31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:02.833269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-eeb445f4-bb5c-4bed-b137-b465b0c5a31b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:02.833269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-eeb445f4-bb5c-4bed-b137-b465b0c5a31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:02.896886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffb3b2-bad7-49db-af0c-94f5d0f2c2af None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:02.918317 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15f737-5b06-4c28-a86a-c7035e56f062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:02.919388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f737-5b06-4c28-a86a-c7035e56f062 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:02.919723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f737-5b06-4c28-a86a-c7035e56f062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:02.920010 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f737-5b06-4c28-a86a-c7035e56f062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:02.920753 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15f737-5b06-4c28-a86a-c7035e56f062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:02.932246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15f737-5b06-4c28-a86a-c7035e56f062 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:02.974208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 838/1706] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:02.975296 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15f737-5b06-4c28-a86a-c7035e56f062 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:02.977173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7b15f737-5b06-4c28-a86a-c7035e56f062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:03.008227 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15f737-5b06-4c28-a86a-c7035e56f062 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:03.022457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 869/1707] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:03.024020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb445f4-bb5c-4bed-b137-b465b0c5a31b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:03.027167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:03.028060 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:03.030799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-eeb445f4-bb5c-4bed-b137-b465b0c5a31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:03.034114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:03.034444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] PATH_INFO: `/v3/users/5bd2dba7864b465f84bc58f483dd631f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:03.036071 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd2dba7864b465f84bc58f483dd631f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:03.039451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:03.054978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb445f4-bb5c-4bed-b137-b465b0c5a31b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:03.071733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27215b13-659b-4cb2-91b6-0d1d9c395eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:03.072444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27215b13-659b-4cb2-91b6-0d1d9c395eec admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:03.072946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27215b13-659b-4cb2-91b6-0d1d9c395eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:03.076610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27215b13-659b-4cb2-91b6-0d1d9c395eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:03.077562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27215b13-659b-4cb2-91b6-0d1d9c395eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:03.081728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27215b13-659b-4cb2-91b6-0d1d9c395eec admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:03.098021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 870/1708] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:03.100155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752ac47-fdec-4db2-aa06-232702d0d1e8 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:03.100603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752ac47-fdec-4db2-aa06-232702d0d1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:03.101085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752ac47-fdec-4db2-aa06-232702d0d1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:03.122124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-2752ac47-fdec-4db2-aa06-232702d0d1e8 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:03.123588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2752ac47-fdec-4db2-aa06-232702d0d1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:03.132984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 871/1709] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:03.135450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752ac47-fdec-4db2-aa06-232702d0d1e8 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:03.147383 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752ac47-fdec-4db2-aa06-232702d0d1e8 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:03.152874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752dd5-4646-4cc4-9249-8f5d0f2dba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:03.154026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752dd5-4646-4cc4-9249-8f5d0f2dba46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:03.154661 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752dd5-4646-4cc4-9249-8f5d0f2dba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:03.155261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752dd5-4646-4cc4-9249-8f5d0f2dba46 admin admin] PATH_INFO: `/v3/projects/37ab7db9ef8d42fd8d45b206da3f5c50/users/b03d061e5f194bf9b0d1eb59ff8ef23c/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:03.172640 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a752dd5-4646-4cc4-9249-8f5d0f2dba46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ab7db9ef8d42fd8d45b206da3f5c50, user_id=b03d061e5f194bf9b0d1eb59ff8ef23c, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:03.177674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a752dd5-4646-4cc4-9249-8f5d0f2dba46 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:03.295894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 872/1710] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:03 2022] PUT /identity/v3/projects/37ab7db9ef8d42fd8d45b206da3f5c50/users/b03d061e5f194bf9b0d1eb59ff8ef23c/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:03.297422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752dd5-4646-4cc4-9249-8f5d0f2dba46 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:03.360296 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd2dba7864b465f84bc58f483dd631f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:03.387925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd2dba7864b465f84bc58f483dd631f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:03.388991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd2dba7864b465f84bc58f483dd631f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:03.394766 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd2dba7864b465f84bc58f483dd631f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:03.426246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd2dba7864b465f84bc58f483dd631f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:03.444326 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752dd5-4646-4cc4-9249-8f5d0f2dba46 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:03.451598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404c4ef-efdc-4753-acbd-03cc81fdef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:03.452551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404c4ef-efdc-4753-acbd-03cc81fdef88 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:03.453406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404c4ef-efdc-4753-acbd-03cc81fdef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:03.453406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404c4ef-efdc-4753-acbd-03cc81fdef88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:03.454914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404c4ef-efdc-4753-acbd-03cc81fdef88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:03.454914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404c4ef-efdc-4753-acbd-03cc81fdef88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:03.456966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404c4ef-efdc-4753-acbd-03cc81fdef88 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:03.469171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 873/1711] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:03.470021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404c4ef-efdc-4753-acbd-03cc81fdef88 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:03.471969 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-f404c4ef-efdc-4753-acbd-03cc81fdef88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:03.484940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404c4ef-efdc-4753-acbd-03cc81fdef88 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:03.491019 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:03.493341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:03.493341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:03.493341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d admin admin] PATH_INFO: `/v3/projects/d38422afedc248f1a75cc9b3de6e161a` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:03.494898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38422afedc248f1a75cc9b3de6e161a)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:03.496804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:03.506129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 839/1712] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:02 2022] DELETE /identity/v3/users/5bd2dba7864b465f84bc58f483dd631f => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:03.507348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:03.510066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:03.598254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9fc87-2189-4b09-b7e2-7af0a53ea3cf admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:03.604245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bad9b1-d6e7-486b-beaf-7e85981e0ea8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:03.604695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bad9b1-d6e7-486b-beaf-7e85981e0ea8 service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:03.605083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bad9b1-d6e7-486b-beaf-7e85981e0ea8 service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:03.605388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bad9b1-d6e7-486b-beaf-7e85981e0ea8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:03.610415 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f4bad9b1-d6e7-486b-beaf-7e85981e0ea8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:03.626844 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38422afedc248f1a75cc9b3de6e161a', 'request_id': 'req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:03.635975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38422afedc248f1a75cc9b3de6e161a', 'request_id': 'req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:03.674633 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bad9b1-d6e7-486b-beaf-7e85981e0ea8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:03.676595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bad9b1-d6e7-486b-beaf-7e85981e0ea8 service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:03.695212 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 840/1713] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:33:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:33:03.696890 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fc4bd-5f5e-451e-b4ec-2b47699bfab4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:03.697128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fc4bd-5f5e-451e-b4ec-2b47699bfab4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:03.697412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fc4bd-5f5e-451e-b4ec-2b47699bfab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:03.717962 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38422afedc248f1a75cc9b3de6e161a', 'request_id': 'req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:03.741136 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d admin admin] The token cache is being invalidate because project d38422afedc248f1a75cc9b3de6e161a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:03.741834 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:03.744143 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-ca6d4b14-767e-4c3c-91c9-d0f21bf6ec4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:03.754814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 874/1714] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:03 2022] DELETE /identity/v3/projects/d38422afedc248f1a75cc9b3de6e161a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:03.760420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c19d-02c9-4c58-8d6a-3f33bda26b8e None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:03.760420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c19d-02c9-4c58-8d6a-3f33bda26b8e None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:03.760993 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c19d-02c9-4c58-8d6a-3f33bda26b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:03.770047 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-571fc4bd-5f5e-451e-b4ec-2b47699bfab4 None None] MFA Rules not processed for user `b03d061e5f194bf9b0d1eb59ff8ef23c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:03.771315 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-571fc4bd-5f5e-451e-b4ec-2b47699bfab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:03.833584 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-29b2c19d-02c9-4c58-8d6a-3f33bda26b8e None None] MFA Rules not processed for user `8e128963426d4f129226a981689531a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:03.835758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-29b2c19d-02c9-4c58-8d6a-3f33bda26b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:04.068307 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 841/1715] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:04.071892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fc4bd-5f5e-451e-b4ec-2b47699bfab4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:04.081919 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-571fc4bd-5f5e-451e-b4ec-2b47699bfab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:04.097359 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 875/1716] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:04.099414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ea055-2b64-49aa-b9fa-d654a02128bd None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:04.099864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ea055-2b64-49aa-b9fa-d654a02128bd None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:04.100485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ea055-2b64-49aa-b9fa-d654a02128bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:04.155277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-660ea055-2b64-49aa-b9fa-d654a02128bd None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:04.157237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-660ea055-2b64-49aa-b9fa-d654a02128bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:04.214463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fc4bd-5f5e-451e-b4ec-2b47699bfab4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:04.257895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91d6b1-c904-41ad-8e1f-acbf397e0464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:04.258808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d6b1-c904-41ad-8e1f-acbf397e0464 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:04.259267 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d6b1-c904-41ad-8e1f-acbf397e0464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:04.259696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d6b1-c904-41ad-8e1f-acbf397e0464 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:04.260694 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91d6b1-c904-41ad-8e1f-acbf397e0464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:04.262892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91d6b1-c904-41ad-8e1f-acbf397e0464 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:04.294884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 876/1717] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:04.296709 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3846508-e5d7-4f40-8d3d-c76deb023ab3 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:04.297149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3846508-e5d7-4f40-8d3d-c76deb023ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:04.306433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3846508-e5d7-4f40-8d3d-c76deb023ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:04.333355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b3846508-e5d7-4f40-8d3d-c76deb023ab3 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:04.337180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b3846508-e5d7-4f40-8d3d-c76deb023ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:04.363177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 877/1718] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:04.364433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3846508-e5d7-4f40-8d3d-c76deb023ab3 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:04.370904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b3846508-e5d7-4f40-8d3d-c76deb023ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:04.430465 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 842/1719] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:04 2022] POST /identity/v3/projects => generated 387 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:04.444329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43d718-a559-4ae1-abac-a6e7f2abba67 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:04.444788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43d718-a559-4ae1-abac-a6e7f2abba67 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:04.446983 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43d718-a559-4ae1-abac-a6e7f2abba67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:04.512578 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1c43d718-a559-4ae1-abac-a6e7f2abba67 None None] MFA Rules not processed for user `c5efb606fb1b422182ab91576088c85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:04.517637 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1c43d718-a559-4ae1-abac-a6e7f2abba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:04.525107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3846508-e5d7-4f40-8d3d-c76deb023ab3 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:04.633724 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 843/1720] 10.222.0.49 () {58 vars in 1015 bytes} [Thu May 5 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:04.637972 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43d718-a559-4ae1-abac-a6e7f2abba67 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:04.644078 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1c43d718-a559-4ae1-abac-a6e7f2abba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:04.666846 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43d718-a559-4ae1-abac-a6e7f2abba67 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:04.681728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd04120-40a5-4962-87b7-f4e8baea4313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:04.682764 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd04120-40a5-4962-87b7-f4e8baea4313 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:04.682764 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd04120-40a5-4962-87b7-f4e8baea4313 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:04.683051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd04120-40a5-4962-87b7-f4e8baea4313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:04.693165 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9cfd1-e41c-4643-9c36-b6eb009b8666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:04.694922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9cfd1-e41c-4643-9c36-b6eb009b8666 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:04.696120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9cfd1-e41c-4643-9c36-b6eb009b8666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:04.696714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9cfd1-e41c-4643-9c36-b6eb009b8666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:04.809166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9cfd1-e41c-4643-9c36-b6eb009b8666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:04.810769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9cfd1-e41c-4643-9c36-b6eb009b8666 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:04.836518 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 844/1721] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:04.838690 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0116f-7d0d-4bf9-a9fa-403589126002 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:04.839916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0116f-7d0d-4bf9-a9fa-403589126002 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:04.840304 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0116f-7d0d-4bf9-a9fa-403589126002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:04.897708 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f2c0116f-7d0d-4bf9-a9fa-403589126002 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:04.902349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f2c0116f-7d0d-4bf9-a9fa-403589126002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:04.926751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 845/1722] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:04.928321 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0116f-7d0d-4bf9-a9fa-403589126002 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:04.935416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd04120-40a5-4962-87b7-f4e8baea4313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:04.937643 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd04120-40a5-4962-87b7-f4e8baea4313 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:04.957228 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0116f-7d0d-4bf9-a9fa-403589126002 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:04.965304 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 878/1723] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:04.968276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd04120-40a5-4962-87b7-f4e8baea4313 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:04.971184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49611a-1800-46a9-a3a5-348b664f3a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:04.972245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49611a-1800-46a9-a3a5-348b664f3a7f admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:04.973671 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49611a-1800-46a9-a3a5-348b664f3a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:04.974832 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49611a-1800-46a9-a3a5-348b664f3a7f admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:04.978125 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49611a-1800-46a9-a3a5-348b664f3a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:04.987624 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd04120-40a5-4962-87b7-f4e8baea4313 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:04.993160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d458e9-b00f-4e2f-91d1-4e3e83e90917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:04.994060 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d458e9-b00f-4e2f-91d1-4e3e83e90917 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:04.994530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d458e9-b00f-4e2f-91d1-4e3e83e90917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:04.994994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d458e9-b00f-4e2f-91d1-4e3e83e90917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:04.998183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49611a-1800-46a9-a3a5-348b664f3a7f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:05.007489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d458e9-b00f-4e2f-91d1-4e3e83e90917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:05.024425 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d458e9-b00f-4e2f-91d1-4e3e83e90917 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:05.039880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 879/1724] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:05.043670 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d458e9-b00f-4e2f-91d1-4e3e83e90917 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:05.105711 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d458e9-b00f-4e2f-91d1-4e3e83e90917 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:05.114723 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49785b2e-c622-406a-844c-cc959a53d061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:05.118157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49785b2e-c622-406a-844c-cc959a53d061 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:05.118817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49785b2e-c622-406a-844c-cc959a53d061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:05.119384 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49785b2e-c622-406a-844c-cc959a53d061 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:05.120447 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49785b2e-c622-406a-844c-cc959a53d061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:05.120958 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49785b2e-c622-406a-844c-cc959a53d061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:05.125178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49785b2e-c622-406a-844c-cc959a53d061 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:05.156137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 880/1725] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:05.162094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49785b2e-c622-406a-844c-cc959a53d061 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:05.183974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49785b2e-c622-406a-844c-cc959a53d061 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:05.203482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd98304-08fd-4358-b56d-be8bbdb3ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:05.204387 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd98304-08fd-4358-b56d-be8bbdb3ce22 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:05.204820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd98304-08fd-4358-b56d-be8bbdb3ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:05.205241 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd98304-08fd-4358-b56d-be8bbdb3ce22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:05.207913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd98304-08fd-4358-b56d-be8bbdb3ce22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:05.210133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd98304-08fd-4358-b56d-be8bbdb3ce22 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:05.259548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 846/1726] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:04 2022] POST /identity/v3/users => generated 294 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:05.262376 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49611a-1800-46a9-a3a5-348b664f3a7f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:05.314080 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49611a-1800-46a9-a3a5-348b664f3a7f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:05.332445 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5fedf-979e-4996-9929-f6182c0ee0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:05.336397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5fedf-979e-4996-9929-f6182c0ee0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:05.336946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5fedf-979e-4996-9929-f6182c0ee0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:05.340048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5fedf-979e-4996-9929-f6182c0ee0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:05.342769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5fedf-979e-4996-9929-f6182c0ee0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:05.344141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5fedf-979e-4996-9929-f6182c0ee0f8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:05.372185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 847/1727] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:05.382245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5fedf-979e-4996-9929-f6182c0ee0f8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:05.421773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5fedf-979e-4996-9929-f6182c0ee0f8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:05.429656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b9b80-2cc2-4008-ba60-9c97330083f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:05.431455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b9b80-2cc2-4008-ba60-9c97330083f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:05.431948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b9b80-2cc2-4008-ba60-9c97330083f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:05.432430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b9b80-2cc2-4008-ba60-9c97330083f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:05.433420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b9b80-2cc2-4008-ba60-9c97330083f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:05.435523 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b9b80-2cc2-4008-ba60-9c97330083f3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:05.451165 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 848/1728] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:05.455159 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b9b80-2cc2-4008-ba60-9c97330083f3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:05.470220 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b9b80-2cc2-4008-ba60-9c97330083f3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:05.476630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493d62e-44fa-4405-9d9f-92b9b43a2052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:05.478195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493d62e-44fa-4405-9d9f-92b9b43a2052 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:05.478694 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493d62e-44fa-4405-9d9f-92b9b43a2052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:05.479509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493d62e-44fa-4405-9d9f-92b9b43a2052 admin admin] PATH_INFO: `/v3/projects/fc8a8f86ab264fbea55e1348458e47c0/users/816ec9c7283f4213a6a013b3187e606e/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:05.512531 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493d62e-44fa-4405-9d9f-92b9b43a2052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8a8f86ab264fbea55e1348458e47c0, user_id=816ec9c7283f4213a6a013b3187e606e, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:05.516411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493d62e-44fa-4405-9d9f-92b9b43a2052 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:05.722638 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 849/1729] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:05 2022] PUT /identity/v3/projects/fc8a8f86ab264fbea55e1348458e47c0/users/816ec9c7283f4213a6a013b3187e606e/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:05.733618 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b97e75-af98-40ae-90a4-059f889afae0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:05.733926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b97e75-af98-40ae-90a4-059f889afae0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:05.734313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b97e75-af98-40ae-90a4-059f889afae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:05.739513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 881/1730] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:05 2022] POST /identity/v3/projects => generated 401 bytes in 575 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:05.740959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd98304-08fd-4358-b56d-be8bbdb3ce22 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:05.828039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f2b97e75-af98-40ae-90a4-059f889afae0 None None] MFA Rules not processed for user `816ec9c7283f4213a6a013b3187e606e`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:05.829269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f2b97e75-af98-40ae-90a4-059f889afae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:06.013903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd98304-08fd-4358-b56d-be8bbdb3ce22 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:06.047782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69312af-270f-4d1a-b9cd-fcdc36114d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:06.049204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69312af-270f-4d1a-b9cd-fcdc36114d34 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:06.058240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69312af-270f-4d1a-b9cd-fcdc36114d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:06.063882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69312af-270f-4d1a-b9cd-fcdc36114d34 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:06.063882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69312af-270f-4d1a-b9cd-fcdc36114d34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:06.063882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69312af-270f-4d1a-b9cd-fcdc36114d34 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:06.064322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 850/1731] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:06.067827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b97e75-af98-40ae-90a4-059f889afae0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:06.112155 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b97e75-af98-40ae-90a4-059f889afae0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:06.125471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f9a7a-b501-4f4b-b7cc-5f6749d22685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:06.127396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f9a7a-b501-4f4b-b7cc-5f6749d22685 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:06.127786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f9a7a-b501-4f4b-b7cc-5f6749d22685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:06.128144 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f9a7a-b501-4f4b-b7cc-5f6749d22685 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:06.130088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f9a7a-b501-4f4b-b7cc-5f6749d22685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:06.137845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f9a7a-b501-4f4b-b7cc-5f6749d22685 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:06.236769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 882/1732] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:05 2022] POST /identity/v3/users => generated 301 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:06.241133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69312af-270f-4d1a-b9cd-fcdc36114d34 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:06.264529 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 851/1733] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:06 2022] POST /identity/v3/projects => generated 389 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:06.265701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f9a7a-b501-4f4b-b7cc-5f6749d22685 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:06.278995 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69312af-270f-4d1a-b9cd-fcdc36114d34 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:06.524251 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e052873-391e-4ab1-bec2-25944ac33fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:06.524974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052873-391e-4ab1-bec2-25944ac33fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:06.525263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052873-391e-4ab1-bec2-25944ac33fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:06.525530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052873-391e-4ab1-bec2-25944ac33fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:06.526271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e052873-391e-4ab1-bec2-25944ac33fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:06.551218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e052873-391e-4ab1-bec2-25944ac33fc8 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:06.608334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 883/1734] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:33:06.609536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e052873-391e-4ab1-bec2-25944ac33fc8 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:06.657962 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e052873-391e-4ab1-bec2-25944ac33fc8 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:06.669149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f9a7a-b501-4f4b-b7cc-5f6749d22685 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:06.677784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164f4a7-2158-4c3e-874f-aeafd36403f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:06.680794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164f4a7-2158-4c3e-874f-aeafd36403f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:06.680794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164f4a7-2158-4c3e-874f-aeafd36403f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:06.680794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164f4a7-2158-4c3e-874f-aeafd36403f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:06.680794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164f4a7-2158-4c3e-874f-aeafd36403f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:06.691381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4cad2-e601-413e-bdc5-1e5d3179818b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:06.692093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4cad2-e601-413e-bdc5-1e5d3179818b admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:06.692386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4cad2-e601-413e-bdc5-1e5d3179818b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:06.692670 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4cad2-e601-413e-bdc5-1e5d3179818b admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:06.705101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164f4a7-2158-4c3e-874f-aeafd36403f3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:06.712450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4cad2-e601-413e-bdc5-1e5d3179818b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:06.718784 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4cad2-e601-413e-bdc5-1e5d3179818b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:06.762118 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 884/1735] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:06.764404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164f4a7-2158-4c3e-874f-aeafd36403f3 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:06.781066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b164f4a7-2158-4c3e-874f-aeafd36403f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:06.823536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164f4a7-2158-4c3e-874f-aeafd36403f3 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:06.841611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:06.845069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:06.845349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:06.845632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] PATH_INFO: `/v3/projects/948dab04438f461ebb771a6b7bde8c7c` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:06.850526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=948dab04438f461ebb771a6b7bde8c7c)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:06.861583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 852/1736] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:06 2022] POST /identity/v3/users => generated 301 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:06.861583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4cad2-e601-413e-bdc5-1e5d3179818b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:06.866093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:06.893808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4cad2-e601-413e-bdc5-1e5d3179818b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:06.909716 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852e463-ae77-4ba4-9984-9260c6227f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:06.910826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852e463-ae77-4ba4-9984-9260c6227f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:06.911227 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852e463-ae77-4ba4-9984-9260c6227f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:06.925482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852e463-ae77-4ba4-9984-9260c6227f3b admin admin] PATH_INFO: `/v3/projects/5390503d750b420a9e43748b3a1b3268/users/dd5251458eb9407a8f752b284629561b/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:06.960506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852e463-ae77-4ba4-9984-9260c6227f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5390503d750b420a9e43748b3a1b3268, user_id=dd5251458eb9407a8f752b284629561b, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:06.970148 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852e463-ae77-4ba4-9984-9260c6227f3b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:07.057079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 853/1737] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:06 2022] PUT /identity/v3/projects/5390503d750b420a9e43748b3a1b3268/users/dd5251458eb9407a8f752b284629561b/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:07.058552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852e463-ae77-4ba4-9984-9260c6227f3b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:07.079659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948dab04438f461ebb771a6b7bde8c7c', 'request_id': 'req-0c541787-96e8-4ce2-9bb0-6f178838e609'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:07.090431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948dab04438f461ebb771a6b7bde8c7c', 'request_id': 'req-0c541787-96e8-4ce2-9bb0-6f178838e609'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:07.191303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852e463-ae77-4ba4-9984-9260c6227f3b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:07.210632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948dab04438f461ebb771a6b7bde8c7c', 'request_id': 'req-0c541787-96e8-4ce2-9bb0-6f178838e609'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:07.234887 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] The token cache is being invalidate because project 948dab04438f461ebb771a6b7bde8c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:07.235600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:07.241903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:07.245147 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 885/1738] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:06 2022] DELETE /identity/v3/projects/948dab04438f461ebb771a6b7bde8c7c => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:07.248512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:07.248512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:07.277454 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5227025-a01b-480f-a737-aa5ccd163915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:07.279443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5227025-a01b-480f-a737-aa5ccd163915 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:07.280173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5227025-a01b-480f-a737-aa5ccd163915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:07.280173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5227025-a01b-480f-a737-aa5ccd163915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:07.282033 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5227025-a01b-480f-a737-aa5ccd163915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:07.284148 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5227025-a01b-480f-a737-aa5ccd163915 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:07.299542 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 854/1739] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:07.305650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2aaf6-21f2-47fd-a0e3-350073ae905b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:07.311716 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2aaf6-21f2-47fd-a0e3-350073ae905b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:07.311716 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2aaf6-21f2-47fd-a0e3-350073ae905b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:07.363154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8dc2aaf6-21f2-47fd-a0e3-350073ae905b None None] MFA Rules not processed for user `dd5251458eb9407a8f752b284629561b`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:07.364366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8dc2aaf6-21f2-47fd-a0e3-350073ae905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:07.384672 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c541787-96e8-4ce2-9bb0-6f178838e609 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:07.394164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d70b29-5456-4bbf-b23c-cd24a2c6cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:07.395204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d70b29-5456-4bbf-b23c-cd24a2c6cec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:07.395491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d70b29-5456-4bbf-b23c-cd24a2c6cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:07.395972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d70b29-5456-4bbf-b23c-cd24a2c6cec1 admin admin] PATH_INFO: `/v3/users/328bcfc199a1469da9fe91bdb0f30ff7` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:07.397429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d70b29-5456-4bbf-b23c-cd24a2c6cec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=328bcfc199a1469da9fe91bdb0f30ff7)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:07.400198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d70b29-5456-4bbf-b23c-cd24a2c6cec1 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:07.454116 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 855/1740] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:07.455620 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a267f8-8b75-4efd-87ad-7d3f55cd8ee9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:07.460329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a267f8-8b75-4efd-87ad-7d3f55cd8ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:07.460329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a267f8-8b75-4efd-87ad-7d3f55cd8ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:07.500004 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d4a267f8-8b75-4efd-87ad-7d3f55cd8ee9 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:07.512862 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d4a267f8-8b75-4efd-87ad-7d3f55cd8ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:07.528420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 856/1741] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:07.528420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a267f8-8b75-4efd-87ad-7d3f55cd8ee9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:07.528420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d4a267f8-8b75-4efd-87ad-7d3f55cd8ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:07.557606 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a267f8-8b75-4efd-87ad-7d3f55cd8ee9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:07.576216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdfb68-ba13-46ad-a039-31523d43ea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:07.578820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdfb68-ba13-46ad-a039-31523d43ea35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:07.582094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdfb68-ba13-46ad-a039-31523d43ea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:07.582094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdfb68-ba13-46ad-a039-31523d43ea35 admin admin] PATH_INFO: `/v3/projects/2b69311c318e4f02808cbe6ae207c938/users/c30d57c528ef4f7c94bf77b88e1cf2ed/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:07.625309 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdfb68-ba13-46ad-a039-31523d43ea35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b69311c318e4f02808cbe6ae207c938, user_id=c30d57c528ef4f7c94bf77b88e1cf2ed, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:07.636066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a2d70b29-5456-4bbf-b23c-cd24a2c6cec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '328bcfc199a1469da9fe91bdb0f30ff7'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:07.636876 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdfb68-ba13-46ad-a039-31523d43ea35 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:07.656110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a2d70b29-5456-4bbf-b23c-cd24a2c6cec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '328bcfc199a1469da9fe91bdb0f30ff7'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:07.776603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a2d70b29-5456-4bbf-b23c-cd24a2c6cec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '328bcfc199a1469da9fe91bdb0f30ff7'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:07.778900 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a2d70b29-5456-4bbf-b23c-cd24a2c6cec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '328bcfc199a1469da9fe91bdb0f30ff7'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:07.793131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 857/1742] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:07 2022] PUT /identity/v3/projects/2b69311c318e4f02808cbe6ae207c938/users/c30d57c528ef4f7c94bf77b88e1cf2ed/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:07.793852 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdfb68-ba13-46ad-a039-31523d43ea35 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:07.799965 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d2fdfb68-ba13-46ad-a039-31523d43ea35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:07.826120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a2d70b29-5456-4bbf-b23c-cd24a2c6cec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '328bcfc199a1469da9fe91bdb0f30ff7'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:07.856191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 886/1743] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:07 2022] DELETE /identity/v3/users/328bcfc199a1469da9fe91bdb0f30ff7 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:07.863351 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e68ba-70a8-4479-b194-63146db2802d None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:07.863893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e68ba-70a8-4479-b194-63146db2802d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:07.864408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e68ba-70a8-4479-b194-63146db2802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:07.911142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-510e68ba-70a8-4479-b194-63146db2802d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:07.918358 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-510e68ba-70a8-4479-b194-63146db2802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:08.037288 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdfb68-ba13-46ad-a039-31523d43ea35 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:08.176957 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 887/1744] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:08.178500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ba803-2b0f-4f2c-8d62-9b506b97da5c None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:08.178806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ba803-2b0f-4f2c-8d62-9b506b97da5c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:08.179090 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ba803-2b0f-4f2c-8d62-9b506b97da5c None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:08.181814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 888/1745] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 5 15:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:33:08.182544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ba803-2b0f-4f2c-8d62-9b506b97da5c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:08.184400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-453ba803-2b0f-4f2c-8d62-9b506b97da5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:08.184968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a9ae2-b249-4734-9c7e-ab40aaa5d67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:08.185655 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a9ae2-b249-4734-9c7e-ab40aaa5d67b admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:08.186219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a9ae2-b249-4734-9c7e-ab40aaa5d67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:08.186475 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a9ae2-b249-4734-9c7e-ab40aaa5d67b admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:08.187291 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a9ae2-b249-4734-9c7e-ab40aaa5d67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:08.191118 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a9ae2-b249-4734-9c7e-ab40aaa5d67b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:08.260301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ba803-2b0f-4f2c-8d62-9b506b97da5c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:08.265361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96daea83-2dcf-453a-8f81-dc3491e005fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:08.266141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daea83-2dcf-453a-8f81-dc3491e005fd admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:08.266529 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daea83-2dcf-453a-8f81-dc3491e005fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:08.266876 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daea83-2dcf-453a-8f81-dc3491e005fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:08.267699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96daea83-2dcf-453a-8f81-dc3491e005fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:08.270194 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96daea83-2dcf-453a-8f81-dc3491e005fd admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:08.323083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 858/1747] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:07 2022] POST /identity/v3/projects => generated 401 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:08.329771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 889/1747] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:08.329771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96daea83-2dcf-453a-8f81-dc3491e005fd admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:08.330019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1fe35-6a60-49e2-a079-eb9743595840 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:08.330019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1fe35-6a60-49e2-a079-eb9743595840 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:08.330019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1fe35-6a60-49e2-a079-eb9743595840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:08.349980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96daea83-2dcf-453a-8f81-dc3491e005fd admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:08.371825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b0f1fe35-6a60-49e2-a079-eb9743595840 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:08.373797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b0f1fe35-6a60-49e2-a079-eb9743595840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:08.505877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5976e1-6f61-4a19-b441-fae2ffecef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:08.506358 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 859/1748] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:08.517829 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5976e1-6f61-4a19-b441-fae2ffecef27 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:08.518116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5976e1-6f61-4a19-b441-fae2ffecef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:08.518465 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5976e1-6f61-4a19-b441-fae2ffecef27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:08.519047 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b8075-f340-4c8a-ac30-5e1ea0a888ae None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:08.519339 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b8075-f340-4c8a-ac30-5e1ea0a888ae None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:08.519614 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b8075-f340-4c8a-ac30-5e1ea0a888ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:08.524729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5976e1-6f61-4a19-b441-fae2ffecef27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:08.528884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5976e1-6f61-4a19-b441-fae2ffecef27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:08.529833 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5976e1-6f61-4a19-b441-fae2ffecef27 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:08.550231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 890/1749] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:08.553858 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5976e1-6f61-4a19-b441-fae2ffecef27 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:08.565747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5976e1-6f61-4a19-b441-fae2ffecef27 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:08.571798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d38241-417f-403e-b91b-03eaed13a08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:08.572745 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d38241-417f-403e-b91b-03eaed13a08d admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:08.573031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d38241-417f-403e-b91b-03eaed13a08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:08.573522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d38241-417f-403e-b91b-03eaed13a08d admin admin] PATH_INFO: `/v3/projects/2b69311c318e4f02808cbe6ae207c938/users/c30d57c528ef4f7c94bf77b88e1cf2ed/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:08.573945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b41b8075-f340-4c8a-ac30-5e1ea0a888ae None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:08.575193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b41b8075-f340-4c8a-ac30-5e1ea0a888ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:08.575540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d38241-417f-403e-b91b-03eaed13a08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b69311c318e4f02808cbe6ae207c938, user_id=c30d57c528ef4f7c94bf77b88e1cf2ed, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:08.579390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d38241-417f-403e-b91b-03eaed13a08d admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:08.593047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 891/1750] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:08 2022] PUT /identity/v3/projects/2b69311c318e4f02808cbe6ae207c938/users/c30d57c528ef4f7c94bf77b88e1cf2ed/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:08.594200 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d38241-417f-403e-b91b-03eaed13a08d admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:08.667217 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 860/1751] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 5 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:08.668408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b8075-f340-4c8a-ac30-5e1ea0a888ae None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:08.669820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b41b8075-f340-4c8a-ac30-5e1ea0a888ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:08.680874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d38241-417f-403e-b91b-03eaed13a08d admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:08.693491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fec9b5-b46a-4b04-b160-20637d6297f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:08.693491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fec9b5-b46a-4b04-b160-20637d6297f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:08.694001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fec9b5-b46a-4b04-b160-20637d6297f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:08.694563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fec9b5-b46a-4b04-b160-20637d6297f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:08.695361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fec9b5-b46a-4b04-b160-20637d6297f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:08.697435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fec9b5-b46a-4b04-b160-20637d6297f2 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:08.761726 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b8075-f340-4c8a-ac30-5e1ea0a888ae None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:08.771846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 892/1752] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:08 2022] POST /identity/v3/users => generated 307 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:08.772704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fec9b5-b46a-4b04-b160-20637d6297f2 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:08.782954 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fec9b5-b46a-4b04-b160-20637d6297f2 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:08.787935 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a205c-4f62-474d-8156-26734b865faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:08.788694 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a205c-4f62-474d-8156-26734b865faf admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:08.789030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a205c-4f62-474d-8156-26734b865faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:08.789482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a205c-4f62-474d-8156-26734b865faf admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:08.790900 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a205c-4f62-474d-8156-26734b865faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:08.792941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a205c-4f62-474d-8156-26734b865faf admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:08.852987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b82976-d6f8-4803-8470-f3c2295cf817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:08.853796 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82976-d6f8-4803-8470-f3c2295cf817 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:08.854229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82976-d6f8-4803-8470-f3c2295cf817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:08.854691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82976-d6f8-4803-8470-f3c2295cf817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:08.871550 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b82976-d6f8-4803-8470-f3c2295cf817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:08.874086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b82976-d6f8-4803-8470-f3c2295cf817 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:08.887836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 861/1753] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:08.889961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe570454-0ea2-422e-90f9-4458f9adb099 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:08.890396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe570454-0ea2-422e-90f9-4458f9adb099 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:08.890688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe570454-0ea2-422e-90f9-4458f9adb099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:08.916584 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 893/1754] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:08 2022] POST /identity/v3/projects => generated 405 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:08.916939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a205c-4f62-474d-8156-26734b865faf admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:08.925354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-bc2a205c-4f62-474d-8156-26734b865faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:08.933784 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fe570454-0ea2-422e-90f9-4458f9adb099 None None] MFA Rules not processed for user `c30d57c528ef4f7c94bf77b88e1cf2ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:08.936361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fe570454-0ea2-422e-90f9-4458f9adb099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:09.039396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 862/1755] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:09.042693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe570454-0ea2-422e-90f9-4458f9adb099 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:09.102634 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a205c-4f62-474d-8156-26734b865faf admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:09.119870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528c60c-5d54-4f7c-ba0e-fc98e4d7a435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:09.121134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528c60c-5d54-4f7c-ba0e-fc98e4d7a435 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:09.121134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528c60c-5d54-4f7c-ba0e-fc98e4d7a435 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:09.121317 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528c60c-5d54-4f7c-ba0e-fc98e4d7a435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:09.145387 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528c60c-5d54-4f7c-ba0e-fc98e4d7a435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:09.147209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528c60c-5d54-4f7c-ba0e-fc98e4d7a435 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:09.171240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 894/1756] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:09.173529 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528c60c-5d54-4f7c-ba0e-fc98e4d7a435 service nova] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:09.219049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe570454-0ea2-422e-90f9-4458f9adb099 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:09.229679 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e289096-35b0-4c02-9e43-91cb86129540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:09.230400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e289096-35b0-4c02-9e43-91cb86129540 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:09.230686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e289096-35b0-4c02-9e43-91cb86129540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:09.231123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e289096-35b0-4c02-9e43-91cb86129540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:09.231917 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e289096-35b0-4c02-9e43-91cb86129540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:09.233485 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e289096-35b0-4c02-9e43-91cb86129540 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:09.256061 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 863/1757] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:09.257356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e289096-35b0-4c02-9e43-91cb86129540 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:09.263069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6e289096-35b0-4c02-9e43-91cb86129540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:09.313365 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528c60c-5d54-4f7c-ba0e-fc98e4d7a435 service nova] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:09.329000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff16ef-a0ff-4cd5-889c-f4195dfd6d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:09.329831 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff16ef-a0ff-4cd5-889c-f4195dfd6d68 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:09.330233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff16ef-a0ff-4cd5-889c-f4195dfd6d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:09.330622 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff16ef-a0ff-4cd5-889c-f4195dfd6d68 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:09.331514 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff16ef-a0ff-4cd5-889c-f4195dfd6d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:09.335602 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff16ef-a0ff-4cd5-889c-f4195dfd6d68 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:09.377539 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e289096-35b0-4c02-9e43-91cb86129540 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:09.384025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7022ad2-561b-4494-ae9d-56cbcfc570de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:09.385035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7022ad2-561b-4494-ae9d-56cbcfc570de service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:09.385325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7022ad2-561b-4494-ae9d-56cbcfc570de service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:09.385608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7022ad2-561b-4494-ae9d-56cbcfc570de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:09.404453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7022ad2-561b-4494-ae9d-56cbcfc570de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:09.405832 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7022ad2-561b-4494-ae9d-56cbcfc570de service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:09.421783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 864/1758] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:09.422836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7022ad2-561b-4494-ae9d-56cbcfc570de service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:09.443729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7022ad2-561b-4494-ae9d-56cbcfc570de service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:09.443729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c32c59-a87b-4439-969b-b8d74d6a8f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:09.444891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c32c59-a87b-4439-969b-b8d74d6a8f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:09.446192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c32c59-a87b-4439-969b-b8d74d6a8f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:09.447049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c32c59-a87b-4439-969b-b8d74d6a8f22 admin admin] PATH_INFO: `/v3/projects/ae2e5adce9ea4372b0f099e148b50769/users/4905647f1e3f4a0094ae689aaaefa76d/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:09.449657 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 895/1759] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:09 2022] POST /identity/v3/users => generated 303 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:09.454880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff16ef-a0ff-4cd5-889c-f4195dfd6d68 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:09.473073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff16ef-a0ff-4cd5-889c-f4195dfd6d68 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:09.478735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c32c59-a87b-4439-969b-b8d74d6a8f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2e5adce9ea4372b0f099e148b50769, user_id=4905647f1e3f4a0094ae689aaaefa76d, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:09.482424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c32c59-a87b-4439-969b-b8d74d6a8f22 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:09.493544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b22e4-e954-4c32-bc14-9302830c5ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:09.493906 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b22e4-e954-4c32-bc14-9302830c5ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:09.494265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b22e4-e954-4c32-bc14-9302830c5ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:09.494655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b22e4-e954-4c32-bc14-9302830c5ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:09.495495 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b22e4-e954-4c32-bc14-9302830c5ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:09.500089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b22e4-e954-4c32-bc14-9302830c5ea3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:09.514023 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 896/1760] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:33:09.515928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b22e4-e954-4c32-bc14-9302830c5ea3 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:09.537802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b22e4-e954-4c32-bc14-9302830c5ea3 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:09.544626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc4462-e1f7-4438-a7d4-c389b829458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:09.545478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc4462-e1f7-4438-a7d4-c389b829458d admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:09.545769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc4462-e1f7-4438-a7d4-c389b829458d admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:09.546128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc4462-e1f7-4438-a7d4-c389b829458d admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:09.546903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc4462-e1f7-4438-a7d4-c389b829458d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:09.548821 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc4462-e1f7-4438-a7d4-c389b829458d admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:09.569881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 865/1761] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:09 2022] PUT /identity/v3/projects/ae2e5adce9ea4372b0f099e148b50769/users/4905647f1e3f4a0094ae689aaaefa76d/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:09.570133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 897/1762] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:33:09.570242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c32c59-a87b-4439-969b-b8d74d6a8f22 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:09.570344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc4462-e1f7-4438-a7d4-c389b829458d admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:09.570415 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c6c32c59-a87b-4439-969b-b8d74d6a8f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:09.589130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc4462-e1f7-4438-a7d4-c389b829458d admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:09.719873 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c32c59-a87b-4439-969b-b8d74d6a8f22 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:09.722608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15029a37-f419-4e49-95e6-fd18e3d58729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:09.723544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15029a37-f419-4e49-95e6-fd18e3d58729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:09.723804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15029a37-f419-4e49-95e6-fd18e3d58729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:09.724084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15029a37-f419-4e49-95e6-fd18e3d58729 admin admin] PATH_INFO: `/v3/projects/4184d329900c4733b885b5c352d9313a/users/b231e5a716d84a7fab442a37e387fb8a/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:09.726071 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:09.727815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:09.728271 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:09.728941 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] PATH_INFO: `/v3/projects/c48ef1a481ef4cf3b16677fb79fc9281` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:09.730716 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48ef1a481ef4cf3b16677fb79fc9281)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:09.734399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:09.745442 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15029a37-f419-4e49-95e6-fd18e3d58729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4184d329900c4733b885b5c352d9313a, user_id=b231e5a716d84a7fab442a37e387fb8a, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:09.748472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15029a37-f419-4e49-95e6-fd18e3d58729 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:09.841275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 898/1763] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:09 2022] PUT /identity/v3/projects/4184d329900c4733b885b5c352d9313a/users/b231e5a716d84a7fab442a37e387fb8a/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:09.845911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15029a37-f419-4e49-95e6-fd18e3d58729 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:09.959451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48ef1a481ef4cf3b16677fb79fc9281', 'request_id': 'req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:09.968863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48ef1a481ef4cf3b16677fb79fc9281', 'request_id': 'req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:09.995341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15029a37-f419-4e49-95e6-fd18e3d58729 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:10.068110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48ef1a481ef4cf3b16677fb79fc9281', 'request_id': 'req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:10.084545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] The token cache is being invalidate because project c48ef1a481ef4cf3b16677fb79fc9281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:10.085565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:10.086756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:10.089427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 866/1764] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:09 2022] DELETE /identity/v3/projects/c48ef1a481ef4cf3b16677fb79fc9281 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:10.090698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:10.092821 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:10.112767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172ab00-8df0-4e6d-b778-8b154048c2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:10.120999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172ab00-8df0-4e6d-b778-8b154048c2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:10.120999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172ab00-8df0-4e6d-b778-8b154048c2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:10.120999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172ab00-8df0-4e6d-b778-8b154048c2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:10.120999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172ab00-8df0-4e6d-b778-8b154048c2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:10.120999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172ab00-8df0-4e6d-b778-8b154048c2f0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:10.131255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 899/1765] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:10.133666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36af59-1fd9-4647-9dd2-33cb47e7f878 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:10.134780 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36af59-1fd9-4647-9dd2-33cb47e7f878 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:10.143235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36af59-1fd9-4647-9dd2-33cb47e7f878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:10.180335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-8b36af59-1fd9-4647-9dd2-33cb47e7f878 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:10.181595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8b36af59-1fd9-4647-9dd2-33cb47e7f878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:10.192143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b331eb-ce6b-4fe3-a6ae-8a3274f78ba9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:10.194342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 900/1766] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:10.194984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36af59-1fd9-4647-9dd2-33cb47e7f878 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:10.199509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8b36af59-1fd9-4647-9dd2-33cb47e7f878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:10.206615 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:10.207465 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:10.207781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:10.208166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] PATH_INFO: `/v3/users/816ec9c7283f4213a6a013b3187e606e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:10.211510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=816ec9c7283f4213a6a013b3187e606e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:10.213617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:10.224654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36af59-1fd9-4647-9dd2-33cb47e7f878 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:10.231328 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00276156-8c48-4e3a-8bb5-974228989ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:10.232191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00276156-8c48-4e3a-8bb5-974228989ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:10.232477 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00276156-8c48-4e3a-8bb5-974228989ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:10.233245 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00276156-8c48-4e3a-8bb5-974228989ae0 admin admin] PATH_INFO: `/v3/users/bee7370bf3f14afb8aa5c4818fe2b278` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:10.235472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00276156-8c48-4e3a-8bb5-974228989ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee7370bf3f14afb8aa5c4818fe2b278)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:10.238109 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00276156-8c48-4e3a-8bb5-974228989ae0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:10.420273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816ec9c7283f4213a6a013b3187e606e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:10.427570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816ec9c7283f4213a6a013b3187e606e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:10.428314 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816ec9c7283f4213a6a013b3187e606e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:10.428922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816ec9c7283f4213a6a013b3187e606e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:10.456735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816ec9c7283f4213a6a013b3187e606e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:10.471133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-00276156-8c48-4e3a-8bb5-974228989ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee7370bf3f14afb8aa5c4818fe2b278'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:10.483430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-00276156-8c48-4e3a-8bb5-974228989ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee7370bf3f14afb8aa5c4818fe2b278'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:10.594565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 867/1767] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:10 2022] DELETE /identity/v3/users/816ec9c7283f4213a6a013b3187e606e => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:10.595624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:10.597123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:10.670410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb11b9a-34f6-43a5-b0c0-5505b3f42ec4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:10.676312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef630f-ecc9-4550-9be7-b22475aeff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:10.678305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef630f-ecc9-4550-9be7-b22475aeff08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:10.678305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef630f-ecc9-4550-9be7-b22475aeff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:10.678305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef630f-ecc9-4550-9be7-b22475aeff08 admin admin] PATH_INFO: `/v3/projects/ae2e5adce9ea4372b0f099e148b50769/users/4905647f1e3f4a0094ae689aaaefa76d/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:10.680461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef630f-ecc9-4550-9be7-b22475aeff08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2e5adce9ea4372b0f099e148b50769, user_id=4905647f1e3f4a0094ae689aaaefa76d, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:10.683228 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef630f-ecc9-4550-9be7-b22475aeff08 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:10.695979 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-00276156-8c48-4e3a-8bb5-974228989ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee7370bf3f14afb8aa5c4818fe2b278'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:10.696679 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-00276156-8c48-4e3a-8bb5-974228989ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee7370bf3f14afb8aa5c4818fe2b278'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:10.698721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 868/1768] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:10 2022] PUT /identity/v3/projects/ae2e5adce9ea4372b0f099e148b50769/users/4905647f1e3f4a0094ae689aaaefa76d/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:10.699673 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef630f-ecc9-4550-9be7-b22475aeff08 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:10.704405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e2ef630f-ecc9-4550-9be7-b22475aeff08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:10.717280 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-00276156-8c48-4e3a-8bb5-974228989ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee7370bf3f14afb8aa5c4818fe2b278'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:10.724273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 901/1769] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:10 2022] DELETE /identity/v3/users/bee7370bf3f14afb8aa5c4818fe2b278 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:10.734379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4f12-0375-451a-89fb-9ffecadf9ed9 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:10.734379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4f12-0375-451a-89fb-9ffecadf9ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:10.734379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4f12-0375-451a-89fb-9ffecadf9ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:10.767651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-3a5b4f12-0375-451a-89fb-9ffecadf9ed9 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:10.769011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-3a5b4f12-0375-451a-89fb-9ffecadf9ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:10.817129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef630f-ecc9-4550-9be7-b22475aeff08 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:10.845047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 902/1770] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:10.846546 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43109c5e-0686-4f4b-ab9e-9e72be883bd5 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:10.846846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43109c5e-0686-4f4b-ab9e-9e72be883bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:10.847130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43109c5e-0686-4f4b-ab9e-9e72be883bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:10.879052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee823f-b879-4733-a6aa-e247a524a811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:10.879870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee823f-b879-4733-a6aa-e247a524a811 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:10.880260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee823f-b879-4733-a6aa-e247a524a811 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:10.880644 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee823f-b879-4733-a6aa-e247a524a811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:10.882195 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-43109c5e-0686-4f4b-ab9e-9e72be883bd5 None None] MFA Rules not processed for user `4905647f1e3f4a0094ae689aaaefa76d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:10.883942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-43109c5e-0686-4f4b-ab9e-9e72be883bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:10.885228 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f9ee823f-b879-4733-a6aa-e247a524a811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:10.901004 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee823f-b879-4733-a6aa-e247a524a811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:10.902816 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee823f-b879-4733-a6aa-e247a524a811 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:10.917984 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 869/1771] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:10.919286 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee823f-b879-4733-a6aa-e247a524a811 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:10.923957 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f9ee823f-b879-4733-a6aa-e247a524a811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:10.932677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee823f-b879-4733-a6aa-e247a524a811 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:10.938408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a035b0-a61a-4372-a060-8f71f8e1aa39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:10.939364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a035b0-a61a-4372-a060-8f71f8e1aa39 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:10.939848 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a035b0-a61a-4372-a060-8f71f8e1aa39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:10.940300 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a035b0-a61a-4372-a060-8f71f8e1aa39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:10.953587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a035b0-a61a-4372-a060-8f71f8e1aa39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:10.955662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a035b0-a61a-4372-a060-8f71f8e1aa39 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:10.969614 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 870/1772] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:10.977261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 903/1773] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:10 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:10.989091 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a035b0-a61a-4372-a060-8f71f8e1aa39 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:10.990899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-44a035b0-a61a-4372-a060-8f71f8e1aa39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:11.061242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a035b0-a61a-4372-a060-8f71f8e1aa39 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:11.066785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b373a02-d56d-400e-8a8d-c10515a4d449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:11.067582 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b373a02-d56d-400e-8a8d-c10515a4d449 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:11.067970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b373a02-d56d-400e-8a8d-c10515a4d449 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:11.068347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b373a02-d56d-400e-8a8d-c10515a4d449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:11.081573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b373a02-d56d-400e-8a8d-c10515a4d449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:11.083252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b373a02-d56d-400e-8a8d-c10515a4d449 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:11.110691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 871/1774] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:11.439706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43109c5e-0686-4f4b-ab9e-9e72be883bd5 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:11.441273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-43109c5e-0686-4f4b-ab9e-9e72be883bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:11.468136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b373a02-d56d-400e-8a8d-c10515a4d449 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:11.482058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b373a02-d56d-400e-8a8d-c10515a4d449 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:11.497950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e9278-378b-419f-a999-c3499ba94ee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:11.499144 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e9278-378b-419f-a999-c3499ba94ee4 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:11.499493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e9278-378b-419f-a999-c3499ba94ee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:11.499801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e9278-378b-419f-a999-c3499ba94ee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:11.502032 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43109c5e-0686-4f4b-ab9e-9e72be883bd5 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:11.503993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6c0e9278-378b-419f-a999-c3499ba94ee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:11.510567 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:11.512279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:11.512733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:11.514055 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45 admin admin] PATH_INFO: `/v3/projects/ffd1b457562a434db5aa3777df892a49` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:11.515616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd1b457562a434db5aa3777df892a49)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:11.519385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:11.659224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd1b457562a434db5aa3777df892a49', 'request_id': 'req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:11.667146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd1b457562a434db5aa3777df892a49', 'request_id': 'req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:11.671510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e9278-378b-419f-a999-c3499ba94ee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:11.675001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e9278-378b-419f-a999-c3499ba94ee4 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:11.713600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 872/1775] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:11.767284 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd1b457562a434db5aa3777df892a49', 'request_id': 'req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:11.789801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45 admin admin] The token cache is being invalidate because project ffd1b457562a434db5aa3777df892a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:11.790002 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:11.792686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2ae6444a-ae4a-44ce-9eb2-707b4a43ed45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:11.798998 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 904/1776] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:11 2022] DELETE /identity/v3/projects/ffd1b457562a434db5aa3777df892a49 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:11.801297 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa943f02-078e-46b2-8787-7acafb89c68e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:11.802114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa943f02-078e-46b2-8787-7acafb89c68e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:11.802650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa943f02-078e-46b2-8787-7acafb89c68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:11.841513 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fa943f02-078e-46b2-8787-7acafb89c68e None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:11.859254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fa943f02-078e-46b2-8787-7acafb89c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:12.083548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 873/1777] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:12.092150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094842e-af55-44c0-b11b-056a583482eb None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:12.096389 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094842e-af55-44c0-b11b-056a583482eb None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:12.096389 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094842e-af55-44c0-b11b-056a583482eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:12.125617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa943f02-078e-46b2-8787-7acafb89c68e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:12.126115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-3094842e-af55-44c0-b11b-056a583482eb None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:12.127162 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fa943f02-078e-46b2-8787-7acafb89c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:12.127433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-3094842e-af55-44c0-b11b-056a583482eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:12.156303 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 905/1778] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:12.157460 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094842e-af55-44c0-b11b-056a583482eb None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:12.169405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094842e-af55-44c0-b11b-056a583482eb None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:12.181993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa943f02-078e-46b2-8787-7acafb89c68e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:12.186792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93af4eb-d4b0-4560-818a-9781365fccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:12.186792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93af4eb-d4b0-4560-818a-9781365fccd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:12.186792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93af4eb-d4b0-4560-818a-9781365fccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:12.186792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93af4eb-d4b0-4560-818a-9781365fccd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:12.187056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93af4eb-d4b0-4560-818a-9781365fccd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:12.187056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93af4eb-d4b0-4560-818a-9781365fccd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:12.210055 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93af4eb-d4b0-4560-818a-9781365fccd7 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:12.216268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:12.216268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:12.216268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:12.216268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] PATH_INFO: `/v3/projects/fc8a8f86ab264fbea55e1348458e47c0` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:12.220273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc8a8f86ab264fbea55e1348458e47c0)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:12.222697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:12.253718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 906/1779] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:12.256676 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93af4eb-d4b0-4560-818a-9781365fccd7 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:12.275453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93af4eb-d4b0-4560-818a-9781365fccd7 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:12.286140 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241259d6-2ab3-436c-80e4-8bd3939eb955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:12.291718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241259d6-2ab3-436c-80e4-8bd3939eb955 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:12.292052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241259d6-2ab3-436c-80e4-8bd3939eb955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:12.292609 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241259d6-2ab3-436c-80e4-8bd3939eb955 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:12.293084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241259d6-2ab3-436c-80e4-8bd3939eb955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:12.295326 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241259d6-2ab3-436c-80e4-8bd3939eb955 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:12.462013 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 907/1780] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:12 2022] POST /identity/v3/projects => generated 387 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:12.462703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241259d6-2ab3-436c-80e4-8bd3939eb955 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:12.490099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc8a8f86ab264fbea55e1348458e47c0', 'request_id': 'req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:12.511545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc8a8f86ab264fbea55e1348458e47c0', 'request_id': 'req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:12.588592 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc8a8f86ab264fbea55e1348458e47c0', 'request_id': 'req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:12.627992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241259d6-2ab3-436c-80e4-8bd3939eb955 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:12.635868 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d71ec-d620-46cc-ab88-c8c77c06e0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:12.636907 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d71ec-d620-46cc-ab88-c8c77c06e0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:12.637423 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d71ec-d620-46cc-ab88-c8c77c06e0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:12.637847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d71ec-d620-46cc-ab88-c8c77c06e0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:12.639556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d71ec-d620-46cc-ab88-c8c77c06e0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:12.642259 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d71ec-d620-46cc-ab88-c8c77c06e0e7 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:12.658378 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] The token cache is being invalidate because project fc8a8f86ab264fbea55e1348458e47c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:12.658694 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:12.665343 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:12.667890 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 874/1781] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:12 2022] DELETE /identity/v3/projects/fc8a8f86ab264fbea55e1348458e47c0 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:12.681660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:12.688616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:12.757938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 908/1782] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:12 2022] POST /identity/v3/users => generated 294 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:12.763296 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d71ec-d620-46cc-ab88-c8c77c06e0e7 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:12.775048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-810d71ec-d620-46cc-ab88-c8c77c06e0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:12.790873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d71ec-d620-46cc-ab88-c8c77c06e0e7 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:12.804231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e4223-3947-4b7c-bde6-fcd6694adb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:12.813204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e4223-3947-4b7c-bde6-fcd6694adb5f admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:12.813495 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e4223-3947-4b7c-bde6-fcd6694adb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:12.813784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e4223-3947-4b7c-bde6-fcd6694adb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:12.814578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e4223-3947-4b7c-bde6-fcd6694adb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:12.824645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e4223-3947-4b7c-bde6-fcd6694adb5f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:12.861532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 909/1783] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:12.863726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e4223-3947-4b7c-bde6-fcd6694adb5f admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:12.885877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e4223-3947-4b7c-bde6-fcd6694adb5f admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:12.892545 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b97fdc-d01e-462a-9d16-37f289639936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:12.893259 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b97fdc-d01e-462a-9d16-37f289639936 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:12.893802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b97fdc-d01e-462a-9d16-37f289639936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:12.894166 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b97fdc-d01e-462a-9d16-37f289639936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:12.896300 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b97fdc-d01e-462a-9d16-37f289639936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:12.898106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b97fdc-d01e-462a-9d16-37f289639936 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:12.924451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 910/1784] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:12.935391 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b97fdc-d01e-462a-9d16-37f289639936 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:12.949712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238d249-1e78-4fe2-92ee-3cf13ea20fcd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:12.953327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b97fdc-d01e-462a-9d16-37f289639936 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:12.994105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614410c-c7cc-4089-abab-3c262efa8163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:12.996699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7f6aa-5a9f-4e32-9f52-18e38e3b5f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:13.000056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614410c-c7cc-4089-abab-3c262efa8163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:13.001966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614410c-c7cc-4089-abab-3c262efa8163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:13.003441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7f6aa-5a9f-4e32-9f52-18e38e3b5f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:13.003862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614410c-c7cc-4089-abab-3c262efa8163 admin admin] PATH_INFO: `/v3/projects/0b5d52b74bd045b8bd4351b730b0fd27/users/7d2c4a6ab27d402c810c8628f819e7a9/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:13.006327 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7f6aa-5a9f-4e32-9f52-18e38e3b5f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:13.008841 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7f6aa-5a9f-4e32-9f52-18e38e3b5f22 admin admin] PATH_INFO: `/v3/users/c30d57c528ef4f7c94bf77b88e1cf2ed` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:13.013041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7f6aa-5a9f-4e32-9f52-18e38e3b5f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30d57c528ef4f7c94bf77b88e1cf2ed)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:13.016829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7f6aa-5a9f-4e32-9f52-18e38e3b5f22 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:13.064008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614410c-c7cc-4089-abab-3c262efa8163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5d52b74bd045b8bd4351b730b0fd27, user_id=7d2c4a6ab27d402c810c8628f819e7a9, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:13.068380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614410c-c7cc-4089-abab-3c262efa8163 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:13.194843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 911/1785] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:12 2022] PUT /identity/v3/projects/0b5d52b74bd045b8bd4351b730b0fd27/users/7d2c4a6ab27d402c810c8628f819e7a9/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:13.196874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849676-a212-44d0-b1a9-370e34a456c2 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:13.197335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849676-a212-44d0-b1a9-370e34a456c2 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:13.201976 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849676-a212-44d0-b1a9-370e34a456c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:13.243899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a3849676-a212-44d0-b1a9-370e34a456c2 None None] MFA Rules not processed for user `7d2c4a6ab27d402c810c8628f819e7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:13.246225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a3849676-a212-44d0-b1a9-370e34a456c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:13.295554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c3b7f6aa-5a9f-4e32-9f52-18e38e3b5f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30d57c528ef4f7c94bf77b88e1cf2ed'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:13.318184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c3b7f6aa-5a9f-4e32-9f52-18e38e3b5f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30d57c528ef4f7c94bf77b88e1cf2ed'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:13.319307 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c3b7f6aa-5a9f-4e32-9f52-18e38e3b5f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30d57c528ef4f7c94bf77b88e1cf2ed'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:13.320340 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c3b7f6aa-5a9f-4e32-9f52-18e38e3b5f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30d57c528ef4f7c94bf77b88e1cf2ed'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:13.353590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c3b7f6aa-5a9f-4e32-9f52-18e38e3b5f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30d57c528ef4f7c94bf77b88e1cf2ed'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:13.390185 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 912/1786] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:13.395656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3849676-a212-44d0-b1a9-370e34a456c2 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:13.399967 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a3849676-a212-44d0-b1a9-370e34a456c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:13.471793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 875/1787] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:12 2022] DELETE /identity/v3/users/c30d57c528ef4f7c94bf77b88e1cf2ed => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:13.582003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3849676-a212-44d0-b1a9-370e34a456c2 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:13.660963 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586220d-bafc-4050-b888-1aa3bc296a58 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:13.661265 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586220d-bafc-4050-b888-1aa3bc296a58 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:13.661552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586220d-bafc-4050-b888-1aa3bc296a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:13.742639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3135ffb-ec55-4797-8db9-c731a3997824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:13.744278 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3135ffb-ec55-4797-8db9-c731a3997824 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:13.744589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3135ffb-ec55-4797-8db9-c731a3997824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:13.744853 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3135ffb-ec55-4797-8db9-c731a3997824 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:13.754662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3135ffb-ec55-4797-8db9-c731a3997824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:13.762415 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3135ffb-ec55-4797-8db9-c731a3997824 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:13.776727 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f586220d-bafc-4050-b888-1aa3bc296a58 None None] MFA Rules not processed for user `b231e5a716d84a7fab442a37e387fb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:13.780771 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f586220d-bafc-4050-b888-1aa3bc296a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:13.887540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 913/1788] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:13 2022] POST /identity/v3/projects => generated 385 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:13.892784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3135ffb-ec55-4797-8db9-c731a3997824 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:13.983975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 876/1789] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:13.994198 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586220d-bafc-4050-b888-1aa3bc296a58 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:14.007058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f586220d-bafc-4050-b888-1aa3bc296a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:14.056700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586220d-bafc-4050-b888-1aa3bc296a58 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:14.094168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3135ffb-ec55-4797-8db9-c731a3997824 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:14.103737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06596111-82e9-4280-baad-379574a21556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:14.104601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06596111-82e9-4280-baad-379574a21556 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:14.104748 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06596111-82e9-4280-baad-379574a21556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:14.105044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06596111-82e9-4280-baad-379574a21556 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:14.107956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06596111-82e9-4280-baad-379574a21556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:14.110012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06596111-82e9-4280-baad-379574a21556 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:14.231426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc23f8-b612-4dd1-b072-56343f361e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:14.232182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc23f8-b612-4dd1-b072-56343f361e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:14.233328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc23f8-b612-4dd1-b072-56343f361e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:14.233785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc23f8-b612-4dd1-b072-56343f361e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:14.235173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc23f8-b612-4dd1-b072-56343f361e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:14.236868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc23f8-b612-4dd1-b072-56343f361e16 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:14.257263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 914/1790] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:13 2022] POST /identity/v3/users => generated 299 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:14.262776 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06596111-82e9-4280-baad-379574a21556 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:14.275986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06596111-82e9-4280-baad-379574a21556 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:14.281785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88589ed7-823d-4790-aecd-425ca7252cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:14.283035 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589ed7-823d-4790-aecd-425ca7252cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:14.283495 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589ed7-823d-4790-aecd-425ca7252cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:14.287811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589ed7-823d-4790-aecd-425ca7252cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:14.287811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88589ed7-823d-4790-aecd-425ca7252cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:14.287811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88589ed7-823d-4790-aecd-425ca7252cd0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:14.316332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 915/1791] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:14.317672 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88589ed7-823d-4790-aecd-425ca7252cd0 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:14.341018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88589ed7-823d-4790-aecd-425ca7252cd0 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:14.350176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34c09f-3b02-4579-aa7f-687649a05e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:14.354026 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 877/1792] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:13 2022] POST /identity/v3/projects => generated 405 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:14.355058 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c09f-3b02-4579-aa7f-687649a05e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:14.355354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c09f-3b02-4579-aa7f-687649a05e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:14.355639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c09f-3b02-4579-aa7f-687649a05e0b admin admin] PATH_INFO: `/v3/projects/c02dcaf0ac2f4ada8d15516f16e3845f/users/1b8929adf59243789e33cd02bafa9c8e/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:14.357130 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc23f8-b612-4dd1-b072-56343f361e16 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:14.391748 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34c09f-3b02-4579-aa7f-687649a05e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c02dcaf0ac2f4ada8d15516f16e3845f, user_id=1b8929adf59243789e33cd02bafa9c8e, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:14.406968 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34c09f-3b02-4579-aa7f-687649a05e0b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:14.499809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc23f8-b612-4dd1-b072-56343f361e16 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:14.517674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b197fa0-682b-40ab-895f-250ff1afe446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:14.518950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b197fa0-682b-40ab-895f-250ff1afe446 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:14.520393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b197fa0-682b-40ab-895f-250ff1afe446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:14.520907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b197fa0-682b-40ab-895f-250ff1afe446 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:14.521916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b197fa0-682b-40ab-895f-250ff1afe446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:14.526084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b197fa0-682b-40ab-895f-250ff1afe446 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:14.528832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 916/1793] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:14 2022] PUT /identity/v3/projects/c02dcaf0ac2f4ada8d15516f16e3845f/users/1b8929adf59243789e33cd02bafa9c8e/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:14.532957 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34c09f-3b02-4579-aa7f-687649a05e0b admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:14.663071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34c09f-3b02-4579-aa7f-687649a05e0b admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:14.678600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede6c01-bbd3-4f7e-9750-85a16bde3c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:14.679957 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede6c01-bbd3-4f7e-9750-85a16bde3c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:14.682401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede6c01-bbd3-4f7e-9750-85a16bde3c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:14.682871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede6c01-bbd3-4f7e-9750-85a16bde3c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:14.683795 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede6c01-bbd3-4f7e-9750-85a16bde3c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:14.684032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 878/1794] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:14 2022] POST /identity/v3/users => generated 309 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:14.685301 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b197fa0-682b-40ab-895f-250ff1afe446 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:14.688157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede6c01-bbd3-4f7e-9750-85a16bde3c51 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:14.710959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 917/1795] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:14.714971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede6c01-bbd3-4f7e-9750-85a16bde3c51 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:14.729867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede6c01-bbd3-4f7e-9750-85a16bde3c51 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:14.742397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b197fa0-682b-40ab-895f-250ff1afe446 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:14.743344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfcf9c-f0ec-4878-9118-062c98095ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:14.744513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfcf9c-f0ec-4878-9118-062c98095ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:14.744917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfcf9c-f0ec-4878-9118-062c98095ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:14.745322 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfcf9c-f0ec-4878-9118-062c98095ba1 admin admin] PATH_INFO: `/v3/projects/c02dcaf0ac2f4ada8d15516f16e3845f/users/1b8929adf59243789e33cd02bafa9c8e/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:14.747722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfcf9c-f0ec-4878-9118-062c98095ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c02dcaf0ac2f4ada8d15516f16e3845f, user_id=1b8929adf59243789e33cd02bafa9c8e, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:14.750004 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088e062-39a2-4c0e-987f-1a5ce911c6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:14.750004 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e062-39a2-4c0e-987f-1a5ce911c6ec admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:14.754787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfcf9c-f0ec-4878-9118-062c98095ba1 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:14.766544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e062-39a2-4c0e-987f-1a5ce911c6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:14.766708 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e062-39a2-4c0e-987f-1a5ce911c6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:14.769150 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088e062-39a2-4c0e-987f-1a5ce911c6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:14.771191 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088e062-39a2-4c0e-987f-1a5ce911c6ec admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:14.788172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 879/1796] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:14.792031 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088e062-39a2-4c0e-987f-1a5ce911c6ec admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:14.812857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 918/1797] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:14 2022] PUT /identity/v3/projects/c02dcaf0ac2f4ada8d15516f16e3845f/users/1b8929adf59243789e33cd02bafa9c8e/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:14.817972 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088e062-39a2-4c0e-987f-1a5ce911c6ec admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:14.848517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a4f6-4120-4c04-a6e8-1d0651bc5f9f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:14.848517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a4f6-4120-4c04-a6e8-1d0651bc5f9f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:14.848517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a4f6-4120-4c04-a6e8-1d0651bc5f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:14.933751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-9b21a4f6-4120-4c04-a6e8-1d0651bc5f9f None None] MFA Rules not processed for user `1b8929adf59243789e33cd02bafa9c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:14.940601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9b21a4f6-4120-4c04-a6e8-1d0651bc5f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:15.060493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e38a4-251b-445b-bae9-5ec1c6a9891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:15.061643 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e38a4-251b-445b-bae9-5ec1c6a9891b admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:15.062077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e38a4-251b-445b-bae9-5ec1c6a9891b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:15.068019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e38a4-251b-445b-bae9-5ec1c6a9891b admin admin] PATH_INFO: `/v3/projects/4465e04005484222a616e7fee986ff55/users/4b44107634964ee0b6287dd0abaca1a7/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:15.091352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e38a4-251b-445b-bae9-5ec1c6a9891b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4465e04005484222a616e7fee986ff55, user_id=4b44107634964ee0b6287dd0abaca1a7, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:15.099941 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e38a4-251b-445b-bae9-5ec1c6a9891b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:15.119089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 919/1798] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:15.135450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21a4f6-4120-4c04-a6e8-1d0651bc5f9f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:15.139013 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9b21a4f6-4120-4c04-a6e8-1d0651bc5f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:15.196366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 880/1799] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:14 2022] PUT /identity/v3/projects/4465e04005484222a616e7fee986ff55/users/4b44107634964ee0b6287dd0abaca1a7/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:15.197609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e38a4-251b-445b-bae9-5ec1c6a9891b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:15.294028 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e38a4-251b-445b-bae9-5ec1c6a9891b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:15.302633 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd123c-63ef-4d93-8821-032e8c576184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:15.303747 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd123c-63ef-4d93-8821-032e8c576184 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:15.304078 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd123c-63ef-4d93-8821-032e8c576184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:15.304980 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd123c-63ef-4d93-8821-032e8c576184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:15.305710 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd123c-63ef-4d93-8821-032e8c576184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:15.307650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd123c-63ef-4d93-8821-032e8c576184 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:15.320368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21a4f6-4120-4c04-a6e8-1d0651bc5f9f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:15.334619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 881/1800] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:15.336987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd123c-63ef-4d93-8821-032e8c576184 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:15.356858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd123c-63ef-4d93-8821-032e8c576184 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:15.367516 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbdeff-de51-43ad-b203-26dc89010e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:15.368613 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbdeff-de51-43ad-b203-26dc89010e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:15.369095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbdeff-de51-43ad-b203-26dc89010e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:15.369591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbdeff-de51-43ad-b203-26dc89010e01 admin admin] PATH_INFO: `/v3/projects/4465e04005484222a616e7fee986ff55/users/4b44107634964ee0b6287dd0abaca1a7/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:15.373010 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbdeff-de51-43ad-b203-26dc89010e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4465e04005484222a616e7fee986ff55, user_id=4b44107634964ee0b6287dd0abaca1a7, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:15.376567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbdeff-de51-43ad-b203-26dc89010e01 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:15.406867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 882/1801] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:15 2022] PUT /identity/v3/projects/4465e04005484222a616e7fee986ff55/users/4b44107634964ee0b6287dd0abaca1a7/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:15.423493 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfa83b-4f94-4e0b-b389-80759544aef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:15.424346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfa83b-4f94-4e0b-b389-80759544aef9 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:15.424648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfa83b-4f94-4e0b-b389-80759544aef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:15.424918 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfa83b-4f94-4e0b-b389-80759544aef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:15.435806 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbdeff-de51-43ad-b203-26dc89010e01 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:15.437985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2cfbdeff-de51-43ad-b203-26dc89010e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:15.553430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbdeff-de51-43ad-b203-26dc89010e01 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:15.560046 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e9340-3f64-4543-a0aa-a5002790d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:15.561074 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e9340-3f64-4543-a0aa-a5002790d3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:15.561411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e9340-3f64-4543-a0aa-a5002790d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:15.561706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e9340-3f64-4543-a0aa-a5002790d3f1 admin admin] PATH_INFO: `/v3/projects/2b69311c318e4f02808cbe6ae207c938` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:15.563000 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e9340-3f64-4543-a0aa-a5002790d3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b69311c318e4f02808cbe6ae207c938)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:15.564948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e9340-3f64-4543-a0aa-a5002790d3f1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:15.599686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfa83b-4f94-4e0b-b389-80759544aef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:15.604633 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfa83b-4f94-4e0b-b389-80759544aef9 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:15.633779 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 920/1802] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:15.742974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-991e9340-3f64-4543-a0aa-a5002790d3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b69311c318e4f02808cbe6ae207c938', 'request_id': 'req-991e9340-3f64-4543-a0aa-a5002790d3f1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:15.759469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-991e9340-3f64-4543-a0aa-a5002790d3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b69311c318e4f02808cbe6ae207c938', 'request_id': 'req-991e9340-3f64-4543-a0aa-a5002790d3f1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:15.792423 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfa83b-4f94-4e0b-b389-80759544aef9 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:15.812596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfa83b-4f94-4e0b-b389-80759544aef9 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:15.922098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a563ab8-7795-462a-a27b-9ca315f24212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:15.922098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563ab8-7795-462a-a27b-9ca315f24212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:15.922098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563ab8-7795-462a-a27b-9ca315f24212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:15.922098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563ab8-7795-462a-a27b-9ca315f24212 admin admin] PATH_INFO: `/v3/users/7d2c4a6ab27d402c810c8628f819e7a9` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:15.922856 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a563ab8-7795-462a-a27b-9ca315f24212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d2c4a6ab27d402c810c8628f819e7a9)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:15.924238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a563ab8-7795-462a-a27b-9ca315f24212 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:15.962260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-991e9340-3f64-4543-a0aa-a5002790d3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b69311c318e4f02808cbe6ae207c938', 'request_id': 'req-991e9340-3f64-4543-a0aa-a5002790d3f1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:15.996741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-991e9340-3f64-4543-a0aa-a5002790d3f1 admin admin] The token cache is being invalidate because project 2b69311c318e4f02808cbe6ae207c938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:16.000565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-991e9340-3f64-4543-a0aa-a5002790d3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:16.002245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-991e9340-3f64-4543-a0aa-a5002790d3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:16.009464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 883/1803] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:15 2022] DELETE /identity/v3/projects/2b69311c318e4f02808cbe6ae207c938 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:16.014937 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995965a-a963-4029-a874-5846d4826c6c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:16.015226 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995965a-a963-4029-a874-5846d4826c6c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:16.015939 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995965a-a963-4029-a874-5846d4826c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:16.055097 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f995965a-a963-4029-a874-5846d4826c6c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:16.057673 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f995965a-a963-4029-a874-5846d4826c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:16.084504 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 884/1804] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:16.093727 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb46f17-1b01-4a26-9f99-d533a08c9a05 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:16.094182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb46f17-1b01-4a26-9f99-d533a08c9a05 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:16.094871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb46f17-1b01-4a26-9f99-d533a08c9a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:16.133320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9eb46f17-1b01-4a26-9f99-d533a08c9a05 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:16.133320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9eb46f17-1b01-4a26-9f99-d533a08c9a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:16.159076 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 885/1805] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:16.163155 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb46f17-1b01-4a26-9f99-d533a08c9a05 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:16.180818 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb46f17-1b01-4a26-9f99-d533a08c9a05 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:16.195909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebdccc-5376-459f-83fc-c7b609542f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:16.196769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebdccc-5376-459f-83fc-c7b609542f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:16.197213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebdccc-5376-459f-83fc-c7b609542f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:16.197686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebdccc-5376-459f-83fc-c7b609542f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:16.198758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebdccc-5376-459f-83fc-c7b609542f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:16.199304 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebdccc-5376-459f-83fc-c7b609542f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:16.201233 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebdccc-5376-459f-83fc-c7b609542f11 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:16.240629 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 886/1806] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:16.245699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebdccc-5376-459f-83fc-c7b609542f11 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:16.261937 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebdccc-5376-459f-83fc-c7b609542f11 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:16.274537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf53c69-b622-45e8-9680-ab0e3594e7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:16.275290 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf53c69-b622-45e8-9680-ab0e3594e7db admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:16.275526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf53c69-b622-45e8-9680-ab0e3594e7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:16.275899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf53c69-b622-45e8-9680-ab0e3594e7db admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:16.276597 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf53c69-b622-45e8-9680-ab0e3594e7db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:16.278770 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf53c69-b622-45e8-9680-ab0e3594e7db admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:16.313026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5a563ab8-7795-462a-a27b-9ca315f24212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d2c4a6ab27d402c810c8628f819e7a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:16.338807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5a563ab8-7795-462a-a27b-9ca315f24212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d2c4a6ab27d402c810c8628f819e7a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:16.458506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 887/1807] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:16 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:16.464458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf53c69-b622-45e8-9680-ab0e3594e7db admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:16.479257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5a563ab8-7795-462a-a27b-9ca315f24212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d2c4a6ab27d402c810c8628f819e7a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:16.480308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5a563ab8-7795-462a-a27b-9ca315f24212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d2c4a6ab27d402c810c8628f819e7a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:16.494912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5a563ab8-7795-462a-a27b-9ca315f24212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d2c4a6ab27d402c810c8628f819e7a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:16.502768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 921/1808] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:15 2022] DELETE /identity/v3/users/7d2c4a6ab27d402c810c8628f819e7a9 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:16.525044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c76a0-f8ea-429b-968d-54f61f1c3566 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:16.525044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c76a0-f8ea-429b-968d-54f61f1c3566 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:16.525044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c76a0-f8ea-429b-968d-54f61f1c3566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:16.537228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e90c76a0-f8ea-429b-968d-54f61f1c3566 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:16.540543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e90c76a0-f8ea-429b-968d-54f61f1c3566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:16.616837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf53c69-b622-45e8-9680-ab0e3594e7db admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:16.620568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 922/1809] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:16.625386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ac474-7c1a-4f84-8369-4b56f5c0e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:16.625807 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ac474-7c1a-4f84-8369-4b56f5c0e054 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:16.626318 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ac474-7c1a-4f84-8369-4b56f5c0e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:16.626715 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ac474-7c1a-4f84-8369-4b56f5c0e054 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:16.627555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ac474-7c1a-4f84-8369-4b56f5c0e054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:16.629754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ac474-7c1a-4f84-8369-4b56f5c0e054 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:16.630555 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c76a0-f8ea-429b-968d-54f61f1c3566 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:16.632053 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e90c76a0-f8ea-429b-968d-54f61f1c3566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:16.699859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c76a0-f8ea-429b-968d-54f61f1c3566 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:16.703874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434a448-5faa-4b67-89a1-3516f024237c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:16.704826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434a448-5faa-4b67-89a1-3516f024237c service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:16.705140 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434a448-5faa-4b67-89a1-3516f024237c service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:16.705421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434a448-5faa-4b67-89a1-3516f024237c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:16.717988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434a448-5faa-4b67-89a1-3516f024237c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:16.722137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434a448-5faa-4b67-89a1-3516f024237c service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:16.741009 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 923/1810] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:33:16.770527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 888/1811] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:16 2022] POST /identity/v3/users => generated 290 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:16.775201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434a448-5faa-4b67-89a1-3516f024237c service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:16.776701 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b434a448-5faa-4b67-89a1-3516f024237c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:16.800341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434a448-5faa-4b67-89a1-3516f024237c service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:16.813688 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd77837-5165-42b3-a061-8c975eb6e649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:16.814182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd77837-5165-42b3-a061-8c975eb6e649 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:16.814500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd77837-5165-42b3-a061-8c975eb6e649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:16.814775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd77837-5165-42b3-a061-8c975eb6e649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:16.815516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd77837-5165-42b3-a061-8c975eb6e649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:16.817346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd77837-5165-42b3-a061-8c975eb6e649 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:16.832120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 924/1812] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:16.835006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ac474-7c1a-4f84-8369-4b56f5c0e054 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:16.846108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ac474-7c1a-4f84-8369-4b56f5c0e054 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:16.858018 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c529ac-203b-4ccd-a70e-4fecbcc21d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:16.858978 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c529ac-203b-4ccd-a70e-4fecbcc21d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:16.859273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c529ac-203b-4ccd-a70e-4fecbcc21d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:16.859530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c529ac-203b-4ccd-a70e-4fecbcc21d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:16.860491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c529ac-203b-4ccd-a70e-4fecbcc21d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:16.862199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c529ac-203b-4ccd-a70e-4fecbcc21d98 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:16.898027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 889/1813] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:16.899680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd77837-5165-42b3-a061-8c975eb6e649 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:16.922446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd77837-5165-42b3-a061-8c975eb6e649 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:16.937954 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef0985-3ec2-4de2-aa5e-d82ef8b061a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:16.947217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef0985-3ec2-4de2-aa5e-d82ef8b061a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:16.947217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef0985-3ec2-4de2-aa5e-d82ef8b061a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:16.947217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef0985-3ec2-4de2-aa5e-d82ef8b061a9 admin admin] PATH_INFO: `/v3/projects/723dc54312d0498a811a3f78d1eb4e93/users/5ca62753d1e342f89135152222aaf379/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:16.968341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef0985-3ec2-4de2-aa5e-d82ef8b061a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=723dc54312d0498a811a3f78d1eb4e93, user_id=5ca62753d1e342f89135152222aaf379, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:16.971110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef0985-3ec2-4de2-aa5e-d82ef8b061a9 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:17.061901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 925/1814] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:16 2022] PUT /identity/v3/projects/723dc54312d0498a811a3f78d1eb4e93/users/5ca62753d1e342f89135152222aaf379/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:17.073649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c80a-a184-4e3d-9c92-cc84861028b7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:17.073954 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c80a-a184-4e3d-9c92-cc84861028b7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:17.074245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c80a-a184-4e3d-9c92-cc84861028b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:17.150073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-60f8c80a-a184-4e3d-9c92-cc84861028b7 None None] MFA Rules not processed for user `5ca62753d1e342f89135152222aaf379`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:17.152953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-60f8c80a-a184-4e3d-9c92-cc84861028b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:17.275883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 890/1815] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:17.280673 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef0985-3ec2-4de2-aa5e-d82ef8b061a9 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:17.386327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef0985-3ec2-4de2-aa5e-d82ef8b061a9 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:17.400492 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49728d-c8de-436d-8cfd-8b76c63172d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:17.401534 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49728d-c8de-436d-8cfd-8b76c63172d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:17.402014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49728d-c8de-436d-8cfd-8b76c63172d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:17.402482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49728d-c8de-436d-8cfd-8b76c63172d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:17.403445 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49728d-c8de-436d-8cfd-8b76c63172d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:17.405561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49728d-c8de-436d-8cfd-8b76c63172d4 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:17.483324 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c80a-a184-4e3d-9c92-cc84861028b7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:17.484850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-60f8c80a-a184-4e3d-9c92-cc84861028b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:17.508908 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c80a-a184-4e3d-9c92-cc84861028b7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:17.521070 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:17.522036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:17.522402 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:17.522763 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] PATH_INFO: `/v3/projects/0b5d52b74bd045b8bd4351b730b0fd27` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:17.525190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5d52b74bd045b8bd4351b730b0fd27)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:17.527260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:17.548191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 926/1816] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:17 2022] POST /identity/v3/projects => generated 379 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:17.553805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49728d-c8de-436d-8cfd-8b76c63172d4 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:17.632056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49728d-c8de-436d-8cfd-8b76c63172d4 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:17.637496 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2d33b-0abb-4c01-9105-6b322320a00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:17.638180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2d33b-0abb-4c01-9105-6b322320a00c admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:17.638507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2d33b-0abb-4c01-9105-6b322320a00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:17.638788 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2d33b-0abb-4c01-9105-6b322320a00c admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:17.639488 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2d33b-0abb-4c01-9105-6b322320a00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:17.641431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2d33b-0abb-4c01-9105-6b322320a00c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:17.663589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5d52b74bd045b8bd4351b730b0fd27', 'request_id': 'req-097e1e4c-a274-4411-9749-5f5861d00be8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:17.670371 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5d52b74bd045b8bd4351b730b0fd27', 'request_id': 'req-097e1e4c-a274-4411-9749-5f5861d00be8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:17.751335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 927/1817] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:17 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:17.753327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2d33b-0abb-4c01-9105-6b322320a00c admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:17.774696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5d52b74bd045b8bd4351b730b0fd27', 'request_id': 'req-097e1e4c-a274-4411-9749-5f5861d00be8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:17.779757 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2d33b-0abb-4c01-9105-6b322320a00c admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:17.792943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] The token cache is being invalidate because project 0b5d52b74bd045b8bd4351b730b0fd27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:17.793769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:17.794446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:17.796524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 891/1818] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:17 2022] DELETE /identity/v3/projects/0b5d52b74bd045b8bd4351b730b0fd27 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:17.800105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:17.803087 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:17.859884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51f04e-3893-4050-979e-110db187e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:17.864432 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51f04e-3893-4050-979e-110db187e14f admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:17.864432 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51f04e-3893-4050-979e-110db187e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:17.864432 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51f04e-3893-4050-979e-110db187e14f admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:17.864432 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51f04e-3893-4050-979e-110db187e14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:17.864432 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51f04e-3893-4050-979e-110db187e14f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:17.878498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 928/1819] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:33:17.890089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51f04e-3893-4050-979e-110db187e14f admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:17.892037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-fa51f04e-3893-4050-979e-110db187e14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:17.919169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e1e4c-a274-4411-9749-5f5861d00be8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:17.919412 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51f04e-3893-4050-979e-110db187e14f admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:17.919412 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0445af-311c-48cc-a55f-34b8514ba877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:17.919412 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0445af-311c-48cc-a55f-34b8514ba877 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:17.919412 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0445af-311c-48cc-a55f-34b8514ba877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:17.919764 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0445af-311c-48cc-a55f-34b8514ba877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:17.919764 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0445af-311c-48cc-a55f-34b8514ba877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:17.920497 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0445af-311c-48cc-a55f-34b8514ba877 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:17.923062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fa7c4-a0f6-4da2-9e0a-ac4cc9997520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:17.923961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fa7c4-a0f6-4da2-9e0a-ac4cc9997520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:17.924243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fa7c4-a0f6-4da2-9e0a-ac4cc9997520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:17.924515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fa7c4-a0f6-4da2-9e0a-ac4cc9997520 admin admin] PATH_INFO: `/v3/users/1b8929adf59243789e33cd02bafa9c8e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:17.926044 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fa7c4-a0f6-4da2-9e0a-ac4cc9997520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8929adf59243789e33cd02bafa9c8e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:17.928028 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fa7c4-a0f6-4da2-9e0a-ac4cc9997520 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:17.948629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 929/1820] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:33:17.955750 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0445af-311c-48cc-a55f-34b8514ba877 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:17.970971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0445af-311c-48cc-a55f-34b8514ba877 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:17.981303 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef186d30-2d36-46c9-a473-ff1a44af5f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:17.982049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186d30-2d36-46c9-a473-ff1a44af5f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:17.982479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186d30-2d36-46c9-a473-ff1a44af5f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:17.982755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186d30-2d36-46c9-a473-ff1a44af5f80 admin admin] PATH_INFO: `/v3/projects/2c2d28f9e6bd46229a698ad38de49e15/users/8b433cdcd5854b33a0ab8c714d05ce03/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.003400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef186d30-2d36-46c9-a473-ff1a44af5f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2d28f9e6bd46229a698ad38de49e15, user_id=8b433cdcd5854b33a0ab8c714d05ce03, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:18.006943 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef186d30-2d36-46c9-a473-ff1a44af5f80 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:18.162719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 930/1821] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:17 2022] PUT /identity/v3/projects/2c2d28f9e6bd46229a698ad38de49e15/users/8b433cdcd5854b33a0ab8c714d05ce03/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:18.166040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818411ca-3593-4acf-ab4d-a627a1334189 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.166040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818411ca-3593-4acf-ab4d-a627a1334189 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.166040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818411ca-3593-4acf-ab4d-a627a1334189 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.166040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 931/1822] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 5 15:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:33:18.167761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818411ca-3593-4acf-ab4d-a627a1334189 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:18.170237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-818411ca-3593-4acf-ab4d-a627a1334189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:18.181861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9d7fa7c4-a0f6-4da2-9e0a-ac4cc9997520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8929adf59243789e33cd02bafa9c8e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.191249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9d7fa7c4-a0f6-4da2-9e0a-ac4cc9997520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8929adf59243789e33cd02bafa9c8e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.195425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9d7fa7c4-a0f6-4da2-9e0a-ac4cc9997520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8929adf59243789e33cd02bafa9c8e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.195425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9d7fa7c4-a0f6-4da2-9e0a-ac4cc9997520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8929adf59243789e33cd02bafa9c8e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.216460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9d7fa7c4-a0f6-4da2-9e0a-ac4cc9997520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8929adf59243789e33cd02bafa9c8e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.268184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818411ca-3593-4acf-ab4d-a627a1334189 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:18.277219 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:18.278117 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.278442 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.278726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] PATH_INFO: `/v3/users/b03d061e5f194bf9b0d1eb59ff8ef23c` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.279941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03d061e5f194bf9b0d1eb59ff8ef23c)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:18.281872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:18.336903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 892/1823] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:17 2022] DELETE /identity/v3/users/1b8929adf59243789e33cd02bafa9c8e => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:18.344193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d227b-3760-4fe2-ba70-d74e6c659aae None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.344193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d227b-3760-4fe2-ba70-d74e6c659aae None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.344193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d227b-3760-4fe2-ba70-d74e6c659aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.381365 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-644d227b-3760-4fe2-ba70-d74e6c659aae None None] MFA Rules not processed for user `4b44107634964ee0b6287dd0abaca1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:18.381365 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-644d227b-3760-4fe2-ba70-d74e6c659aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:18.484234 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03d061e5f194bf9b0d1eb59ff8ef23c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.500244 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03d061e5f194bf9b0d1eb59ff8ef23c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.502732 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 893/1824] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:18.504559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd507369-5c32-45bd-977b-f460ada5ff5e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.505220 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd507369-5c32-45bd-977b-f460ada5ff5e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.505220 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd507369-5c32-45bd-977b-f460ada5ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.529453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fd507369-5c32-45bd-977b-f460ada5ff5e None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:18.531184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fd507369-5c32-45bd-977b-f460ada5ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:18.622064 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 894/1825] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 5 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:18.623379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243a22a-b850-4dd1-8945-974737476f8b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.624015 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243a22a-b850-4dd1-8945-974737476f8b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.624015 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243a22a-b850-4dd1-8945-974737476f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.636742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03d061e5f194bf9b0d1eb59ff8ef23c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.638010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03d061e5f194bf9b0d1eb59ff8ef23c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.663912 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7243a22a-b850-4dd1-8945-974737476f8b None None] MFA Rules not processed for user `8b433cdcd5854b33a0ab8c714d05ce03`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:18.673237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7243a22a-b850-4dd1-8945-974737476f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:18.683185 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03d061e5f194bf9b0d1eb59ff8ef23c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:18.695232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 932/1826] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:18 2022] DELETE /identity/v3/users/b03d061e5f194bf9b0d1eb59ff8ef23c => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:18.696452 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:18.700702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:18.760544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 895/1827] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:18.762145 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243a22a-b850-4dd1-8945-974737476f8b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:18.765758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7243a22a-b850-4dd1-8945-974737476f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:18.793124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243a22a-b850-4dd1-8945-974737476f8b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:18.818183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780ee75-77e7-4499-b37a-16eb85cddd80 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:18.825509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:18.826722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.827106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.827452 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] PATH_INFO: `/v3/users/dd5251458eb9407a8f752b284629561b` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.829806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd5251458eb9407a8f752b284629561b)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:18.832007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:18.889200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46554cad-76c4-4447-a6e1-274ae87da97f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:18.890301 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46554cad-76c4-4447-a6e1-274ae87da97f service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.890837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46554cad-76c4-4447-a6e1-274ae87da97f service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.891492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46554cad-76c4-4447-a6e1-274ae87da97f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.894089 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-46554cad-76c4-4447-a6e1-274ae87da97f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:18.914676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46554cad-76c4-4447-a6e1-274ae87da97f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:18.916462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46554cad-76c4-4447-a6e1-274ae87da97f service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:18.941134 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 896/1828] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:18.943828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e7bce-0b4a-40f9-ac22-a6bf6d89563d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:18.948237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e7bce-0b4a-40f9-ac22-a6bf6d89563d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:18.950385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e7bce-0b4a-40f9-ac22-a6bf6d89563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:18.988490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-233e7bce-0b4a-40f9-ac22-a6bf6d89563d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:18.989810 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-233e7bce-0b4a-40f9-ac22-a6bf6d89563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.009965 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 897/1829] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:19.010849 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e7bce-0b4a-40f9-ac22-a6bf6d89563d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.012288 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-233e7bce-0b4a-40f9-ac22-a6bf6d89563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.045206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e7bce-0b4a-40f9-ac22-a6bf6d89563d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.051438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc65b30-5e5a-40d4-bc24-4cb5802b5f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.052404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc65b30-5e5a-40d4-bc24-4cb5802b5f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.052888 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc65b30-5e5a-40d4-bc24-4cb5802b5f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.053363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc65b30-5e5a-40d4-bc24-4cb5802b5f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.057885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc65b30-5e5a-40d4-bc24-4cb5802b5f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.067251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc65b30-5e5a-40d4-bc24-4cb5802b5f70 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.083569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5251458eb9407a8f752b284629561b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:19.104193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5251458eb9407a8f752b284629561b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:19.256036 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5251458eb9407a8f752b284629561b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:19.259653 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5251458eb9407a8f752b284629561b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:19.280220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5251458eb9407a8f752b284629561b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:19.290658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 898/1830] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:19 2022] POST /identity/v3/projects => generated 377 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:19.290658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc65b30-5e5a-40d4-bc24-4cb5802b5f70 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.292663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5dc65b30-5e5a-40d4-bc24-4cb5802b5f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.298596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 933/1831] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:18 2022] DELETE /identity/v3/users/dd5251458eb9407a8f752b284629561b => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:19.299690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.301387 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.416285 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d17f5f-e64f-4a62-9be6-dc53831961fb admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.428569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc65b30-5e5a-40d4-bc24-4cb5802b5f70 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.428829 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.429000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.430379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.432308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3 admin admin] PATH_INFO: `/v3/projects/c02dcaf0ac2f4ada8d15516f16e3845f` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.437522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c02dcaf0ac2f4ada8d15516f16e3845f)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.441266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.513497 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6212da6-1b38-4b4d-a548-aa4cc56d54fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.514154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6212da6-1b38-4b4d-a548-aa4cc56d54fa service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.514716 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6212da6-1b38-4b4d-a548-aa4cc56d54fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.515063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6212da6-1b38-4b4d-a548-aa4cc56d54fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.517402 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a6212da6-1b38-4b4d-a548-aa4cc56d54fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.531230 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6212da6-1b38-4b4d-a548-aa4cc56d54fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.532849 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6212da6-1b38-4b4d-a548-aa4cc56d54fa service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.543744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 899/1832] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:19.544734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6212da6-1b38-4b4d-a548-aa4cc56d54fa service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.546167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a6212da6-1b38-4b4d-a548-aa4cc56d54fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.558582 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6212da6-1b38-4b4d-a548-aa4cc56d54fa service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.565473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc75fa-6901-42fa-983a-a89b03827aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.566172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc75fa-6901-42fa-983a-a89b03827aee admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.566485 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc75fa-6901-42fa-983a-a89b03827aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.566984 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc75fa-6901-42fa-983a-a89b03827aee admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.567774 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc75fa-6901-42fa-983a-a89b03827aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.571241 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc75fa-6901-42fa-983a-a89b03827aee admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.581468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c02dcaf0ac2f4ada8d15516f16e3845f', 'request_id': 'req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:19.588922 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c02dcaf0ac2f4ada8d15516f16e3845f', 'request_id': 'req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:19.670318 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c02dcaf0ac2f4ada8d15516f16e3845f', 'request_id': 'req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:19.683457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3 admin admin] The token cache is being invalidate because project c02dcaf0ac2f4ada8d15516f16e3845f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:19.683654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:19.684326 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6d4b44a7-846c-40fd-8b21-edb1144c8cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:19.689168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 934/1833] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:19 2022] DELETE /identity/v3/projects/c02dcaf0ac2f4ada8d15516f16e3845f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:19.689168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff476af8-797b-4b25-9e00-025727d619d7 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.689168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff476af8-797b-4b25-9e00-025727d619d7 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.689168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff476af8-797b-4b25-9e00-025727d619d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.691544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 900/1834] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:19 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:19.693276 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eb2ff-1142-4636-9561-fea58bb62828 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.693577 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eb2ff-1142-4636-9561-fea58bb62828 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.693961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eb2ff-1142-4636-9561-fea58bb62828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.718240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ff476af8-797b-4b25-9e00-025727d619d7 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:19.718656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ff476af8-797b-4b25-9e00-025727d619d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.721094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b94eb2ff-1142-4636-9561-fea58bb62828 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:19.722309 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b94eb2ff-1142-4636-9561-fea58bb62828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.791065 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 901/1835] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:19.798111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eb2ff-1142-4636-9561-fea58bb62828 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.800625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b94eb2ff-1142-4636-9561-fea58bb62828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.812961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eb2ff-1142-4636-9561-fea58bb62828 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.818511 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e9abd-304f-4b84-ba95-a4c692492b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.819249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e9abd-304f-4b84-ba95-a4c692492b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.819524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e9abd-304f-4b84-ba95-a4c692492b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.820328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e9abd-304f-4b84-ba95-a4c692492b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.821303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e9abd-304f-4b84-ba95-a4c692492b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.822954 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e9abd-304f-4b84-ba95-a4c692492b67 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.825632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 935/1836] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:19.827051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5838-f923-4914-8cb9-9902264dea09 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.827349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5838-f923-4914-8cb9-9902264dea09 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.827693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5838-f923-4914-8cb9-9902264dea09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.834883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 902/1837] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:19.836828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e9abd-304f-4b84-ba95-a4c692492b67 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.839846 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7a2e9abd-304f-4b84-ba95-a4c692492b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.849361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ebce5838-f923-4914-8cb9-9902264dea09 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:19.850673 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ebce5838-f923-4914-8cb9-9902264dea09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:19.861469 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 936/1838] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:19.862406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce5838-f923-4914-8cb9-9902264dea09 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.873927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce5838-f923-4914-8cb9-9902264dea09 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.883491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d81e7c-634a-4ce8-bf8b-062605b249b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.885006 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d81e7c-634a-4ce8-bf8b-062605b249b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.885507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d81e7c-634a-4ce8-bf8b-062605b249b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.886104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d81e7c-634a-4ce8-bf8b-062605b249b3 admin admin] PATH_INFO: `/v3/projects/c454b7b35d2b4234839e10e67346aabd/users/ef34bf3dcb534712b1960d07c22ca0b0/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.905037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d81e7c-634a-4ce8-bf8b-062605b249b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c454b7b35d2b4234839e10e67346aabd, user_id=ef34bf3dcb534712b1960d07c22ca0b0, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.915306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d81e7c-634a-4ce8-bf8b-062605b249b3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.918475 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e9abd-304f-4b84-ba95-a4c692492b67 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.923264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93993571-b22a-40b5-927e-df705ca8661a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.924056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93993571-b22a-40b5-927e-df705ca8661a service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.924436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93993571-b22a-40b5-927e-df705ca8661a service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.924813 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93993571-b22a-40b5-927e-df705ca8661a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.951715 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93993571-b22a-40b5-927e-df705ca8661a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.951715 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93993571-b22a-40b5-927e-df705ca8661a service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.956036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 903/1839] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:19.956809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93993571-b22a-40b5-927e-df705ca8661a service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:19.967671 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93993571-b22a-40b5-927e-df705ca8661a service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:19.974843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63be47-06ba-449a-b821-769642449fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:19.979808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63be47-06ba-449a-b821-769642449fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:19.979808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63be47-06ba-449a-b821-769642449fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:19.979808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63be47-06ba-449a-b821-769642449fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:19.979808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63be47-06ba-449a-b821-769642449fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:19.979808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63be47-06ba-449a-b821-769642449fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:19.979808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63be47-06ba-449a-b821-769642449fdf admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:19.995526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 904/1840] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:20.000329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63be47-06ba-449a-b821-769642449fdf admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:20.011787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 937/1841] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:19 2022] PUT /identity/v3/projects/c454b7b35d2b4234839e10e67346aabd/users/ef34bf3dcb534712b1960d07c22ca0b0/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:20.014583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63be47-06ba-449a-b821-769642449fdf admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:20.015325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d81e7c-634a-4ce8-bf8b-062605b249b3 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:20.130568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d81e7c-634a-4ce8-bf8b-062605b249b3 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:20.135752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac038448-f07b-4264-a94f-3a65f60ba2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:20.136651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038448-f07b-4264-a94f-3a65f60ba2dd admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:20.136989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038448-f07b-4264-a94f-3a65f60ba2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:20.137397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038448-f07b-4264-a94f-3a65f60ba2dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:20.138347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac038448-f07b-4264-a94f-3a65f60ba2dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:20.139714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a164c9-d8ff-4432-a4f3-c9718e4aba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:20.140650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a164c9-d8ff-4432-a4f3-c9718e4aba19 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:20.141046 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac038448-f07b-4264-a94f-3a65f60ba2dd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:20.142556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a164c9-d8ff-4432-a4f3-c9718e4aba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:20.143017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a164c9-d8ff-4432-a4f3-c9718e4aba19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:20.145992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a164c9-d8ff-4432-a4f3-c9718e4aba19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:20.147003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a164c9-d8ff-4432-a4f3-c9718e4aba19 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:20.163426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 938/1842] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:20.168082 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a164c9-d8ff-4432-a4f3-c9718e4aba19 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:20.182065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a164c9-d8ff-4432-a4f3-c9718e4aba19 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:20.189030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950bd80-eb17-4fce-b4e4-5956154c121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:20.190487 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950bd80-eb17-4fce-b4e4-5956154c121b admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:20.192344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950bd80-eb17-4fce-b4e4-5956154c121b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:20.192728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950bd80-eb17-4fce-b4e4-5956154c121b admin admin] PATH_INFO: `/v3/projects/c454b7b35d2b4234839e10e67346aabd/users/ef34bf3dcb534712b1960d07c22ca0b0/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:20.195098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950bd80-eb17-4fce-b4e4-5956154c121b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c454b7b35d2b4234839e10e67346aabd, user_id=ef34bf3dcb534712b1960d07c22ca0b0, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:20.198626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950bd80-eb17-4fce-b4e4-5956154c121b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:20.217088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 939/1843] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:20 2022] PUT /identity/v3/projects/c454b7b35d2b4234839e10e67346aabd/users/ef34bf3dcb534712b1960d07c22ca0b0/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:20.222357 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcd403-dc6c-41d3-aed6-665f9b3c2f62 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:20.222871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcd403-dc6c-41d3-aed6-665f9b3c2f62 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:20.223154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcd403-dc6c-41d3-aed6-665f9b3c2f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:20.253011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 905/1844] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:19 2022] POST /identity/v3/projects => generated 383 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:20.256450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-4afcd403-dc6c-41d3-aed6-665f9b3c2f62 None None] MFA Rules not processed for user `ef34bf3dcb534712b1960d07c22ca0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:20.256842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac038448-f07b-4264-a94f-3a65f60ba2dd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:20.257846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4afcd403-dc6c-41d3-aed6-665f9b3c2f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:20.366464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 940/1845] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:20.377353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac038448-f07b-4264-a94f-3a65f60ba2dd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:20.379428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcd403-dc6c-41d3-aed6-665f9b3c2f62 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:20.381523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4afcd403-dc6c-41d3-aed6-665f9b3c2f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:20.402001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa2c00-c39b-491f-bb21-16f76224353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:20.405564 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa2c00-c39b-491f-bb21-16f76224353a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:20.405886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa2c00-c39b-491f-bb21-16f76224353a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:20.406169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa2c00-c39b-491f-bb21-16f76224353a admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:20.409222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa2c00-c39b-491f-bb21-16f76224353a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:20.416143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa2c00-c39b-491f-bb21-16f76224353a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:20.478639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcd403-dc6c-41d3-aed6-665f9b3c2f62 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:20.484818 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf45078-241f-4805-bdb5-bd607af8395d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:20.485648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf45078-241f-4805-bdb5-bd607af8395d service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:20.488582 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf45078-241f-4805-bdb5-bd607af8395d service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:20.488582 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf45078-241f-4805-bdb5-bd607af8395d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:20.498453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf45078-241f-4805-bdb5-bd607af8395d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:20.500054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf45078-241f-4805-bdb5-bd607af8395d service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:20.511633 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 941/1846] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:20.551185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 906/1847] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:20 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:20.553985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf45078-241f-4805-bdb5-bd607af8395d service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:20.566514 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf45078-241f-4805-bdb5-bd607af8395d service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:20.573989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae92ea-1875-4105-b60f-c37954851d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:20.580285 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae92ea-1875-4105-b60f-c37954851d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:20.580285 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae92ea-1875-4105-b60f-c37954851d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:20.580285 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae92ea-1875-4105-b60f-c37954851d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:20.580285 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae92ea-1875-4105-b60f-c37954851d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:20.580285 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae92ea-1875-4105-b60f-c37954851d6c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:20.591788 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 942/1848] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:20.596912 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa2c00-c39b-491f-bb21-16f76224353a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:20.613586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa2c00-c39b-491f-bb21-16f76224353a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:20.628532 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df97e56-cf78-46aa-acad-41aa33bdcfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:20.629998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df97e56-cf78-46aa-acad-41aa33bdcfad admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:20.629998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df97e56-cf78-46aa-acad-41aa33bdcfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:20.629998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df97e56-cf78-46aa-acad-41aa33bdcfad admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:20.630900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df97e56-cf78-46aa-acad-41aa33bdcfad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:20.632811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df97e56-cf78-46aa-acad-41aa33bdcfad admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:20.636910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae92ea-1875-4105-b60f-c37954851d6c admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:20.640408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9aae92ea-1875-4105-b60f-c37954851d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:20.652177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 907/1849] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:20.653602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df97e56-cf78-46aa-acad-41aa33bdcfad admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:20.665480 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df97e56-cf78-46aa-acad-41aa33bdcfad admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:20.668407 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae92ea-1875-4105-b60f-c37954851d6c admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:20.670477 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c33444-fbca-4aea-a3bd-370efcaa6c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:20.671332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c33444-fbca-4aea-a3bd-370efcaa6c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:20.671616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c33444-fbca-4aea-a3bd-370efcaa6c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:20.671895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c33444-fbca-4aea-a3bd-370efcaa6c24 admin admin] PATH_INFO: `/v3/projects/c9740d1a295f4dd88210a22caa27b90a/users/6edff234f6c545e08cdc113fe742e692/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:20.689107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c33444-fbca-4aea-a3bd-370efcaa6c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9740d1a295f4dd88210a22caa27b90a, user_id=6edff234f6c545e08cdc113fe742e692, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:20.690502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d1fca-fa80-47ce-b0ef-ed9f69889092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:20.691922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c33444-fbca-4aea-a3bd-370efcaa6c24 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:20.694077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d1fca-fa80-47ce-b0ef-ed9f69889092 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:20.698734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d1fca-fa80-47ce-b0ef-ed9f69889092 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:20.699533 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d1fca-fa80-47ce-b0ef-ed9f69889092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:20.703878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ab0d1fca-fa80-47ce-b0ef-ed9f69889092 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:20.826079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 908/1850] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:20 2022] PUT /identity/v3/projects/c9740d1a295f4dd88210a22caa27b90a/users/6edff234f6c545e08cdc113fe742e692/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:20.833203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c33444-fbca-4aea-a3bd-370efcaa6c24 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:20.833203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a4c33444-fbca-4aea-a3bd-370efcaa6c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:20.843929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d1fca-fa80-47ce-b0ef-ed9f69889092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:20.845945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d1fca-fa80-47ce-b0ef-ed9f69889092 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:20.858104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 943/1851] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:33:20.859446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d1fca-fa80-47ce-b0ef-ed9f69889092 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:20.861128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ab0d1fca-fa80-47ce-b0ef-ed9f69889092 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:20.894840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d1fca-fa80-47ce-b0ef-ed9f69889092 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:20.914388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c33444-fbca-4aea-a3bd-370efcaa6c24 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:20.937280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:20.937280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:20.937280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:20.937280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa admin admin] PATH_INFO: `/v3/projects/37ab7db9ef8d42fd8d45b206da3f5c50` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:20.937865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ab7db9ef8d42fd8d45b206da3f5c50)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:20.937865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:20.982132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21773c1-f9a4-4d5d-9147-b81660f0aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:20.983090 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21773c1-f9a4-4d5d-9147-b81660f0aa16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:20.983372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21773c1-f9a4-4d5d-9147-b81660f0aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:20.983680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21773c1-f9a4-4d5d-9147-b81660f0aa16 admin admin] PATH_INFO: `/v3/users/b231e5a716d84a7fab442a37e387fb8a` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:20.984974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21773c1-f9a4-4d5d-9147-b81660f0aa16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b231e5a716d84a7fab442a37e387fb8a)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:20.986994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21773c1-f9a4-4d5d-9147-b81660f0aa16 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:21.111777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ab7db9ef8d42fd8d45b206da3f5c50', 'request_id': 'req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:21.121403 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ab7db9ef8d42fd8d45b206da3f5c50', 'request_id': 'req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:21.870715 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ab7db9ef8d42fd8d45b206da3f5c50', 'request_id': 'req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:21.884506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa admin admin] The token cache is being invalidate because project 37ab7db9ef8d42fd8d45b206da3f5c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:21.885181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:21.885477 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9758a5c7-b3ec-40ad-a9bf-7458e9fb4dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:21.890718 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 909/1852] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:20 2022] DELETE /identity/v3/projects/37ab7db9ef8d42fd8d45b206da3f5c50 => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:21.891959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3253275-1578-421e-a304-cb62079098bb None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:21.892255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3253275-1578-421e-a304-cb62079098bb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:21.892536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3253275-1578-421e-a304-cb62079098bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:21.919973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e3253275-1578-421e-a304-cb62079098bb None None] MFA Rules not processed for user `6edff234f6c545e08cdc113fe742e692`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:21.921197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e3253275-1578-421e-a304-cb62079098bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:21.991011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 910/1853] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:21.992158 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3253275-1578-421e-a304-cb62079098bb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:21.993646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e3253275-1578-421e-a304-cb62079098bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:22.064900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3253275-1578-421e-a304-cb62079098bb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:22.069507 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:22.071475 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:22.071757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:22.072034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] PATH_INFO: `/v3/projects/5390503d750b420a9e43748b3a1b3268` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:22.073231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5390503d750b420a9e43748b3a1b3268)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:22.075182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:22.136282 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c21773c1-f9a4-4d5d-9147-b81660f0aa16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b231e5a716d84a7fab442a37e387fb8a'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.144601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c21773c1-f9a4-4d5d-9147-b81660f0aa16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b231e5a716d84a7fab442a37e387fb8a'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.235601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5390503d750b420a9e43748b3a1b3268', 'request_id': 'req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.242448 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5390503d750b420a9e43748b3a1b3268', 'request_id': 'req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.253922 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c21773c1-f9a4-4d5d-9147-b81660f0aa16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b231e5a716d84a7fab442a37e387fb8a'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.258052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c21773c1-f9a4-4d5d-9147-b81660f0aa16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b231e5a716d84a7fab442a37e387fb8a'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.274844 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c21773c1-f9a4-4d5d-9147-b81660f0aa16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b231e5a716d84a7fab442a37e387fb8a'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.281152 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 944/1854] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:20 2022] DELETE /identity/v3/users/b231e5a716d84a7fab442a37e387fb8a => generated 0 bytes in 1422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:22.282541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2606b-490b-45c8-beec-df6b8034acc6 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:22.282835 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2606b-490b-45c8-beec-df6b8034acc6 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:22.283158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2606b-490b-45c8-beec-df6b8034acc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:22.309426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6aa2606b-490b-45c8-beec-df6b8034acc6 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:22.310685 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6aa2606b-490b-45c8-beec-df6b8034acc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:22.334444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5390503d750b420a9e43748b3a1b3268', 'request_id': 'req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.349879 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] The token cache is being invalidate because project 5390503d750b420a9e43748b3a1b3268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:22.350167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.351020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.355706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 911/1855] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:21 2022] DELETE /identity/v3/projects/5390503d750b420a9e43748b3a1b3268 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:22.356895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:22.358430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:22.413218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 945/1856] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:22.414633 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaa663-3ebb-446a-82a2-128d16412170 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:22.414926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaa663-3ebb-446a-82a2-128d16412170 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:22.415649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaa663-3ebb-446a-82a2-128d16412170 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:22.417696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 946/1857] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 5 15:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:33:22.418580 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eaa663-3ebb-446a-82a2-128d16412170 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:22.421000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-67eaa663-3ebb-446a-82a2-128d16412170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:22.441007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eaa663-3ebb-446a-82a2-128d16412170 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:22.447769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:22.448681 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:22.448962 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:22.449559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] PATH_INFO: `/v3/users/4905647f1e3f4a0094ae689aaaefa76d` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:22.450954 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4905647f1e3f4a0094ae689aaaefa76d)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:22.453601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:22.459044 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea0e2f-7cad-4ef0-88f9-9ab69346246c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:22.469225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2d0da-4d56-40a8-8574-53818cf861c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:22.476333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2d0da-4d56-40a8-8574-53818cf861c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:22.476333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2d0da-4d56-40a8-8574-53818cf861c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:22.476333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2d0da-4d56-40a8-8574-53818cf861c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:22.476333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2d0da-4d56-40a8-8574-53818cf861c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:22.477109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2d0da-4d56-40a8-8574-53818cf861c7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:22.633533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 912/1858] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:22 2022] POST /identity/v3/projects => generated 381 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:22.640084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9a81a-27d9-4388-a58c-8b230f3c7a82 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:22.640430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9a81a-27d9-4388-a58c-8b230f3c7a82 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:22.641284 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9a81a-27d9-4388-a58c-8b230f3c7a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:22.669570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-55c9a81a-27d9-4388-a58c-8b230f3c7a82 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:22.670834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-55c9a81a-27d9-4388-a58c-8b230f3c7a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:22.677261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4905647f1e3f4a0094ae689aaaefa76d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.688904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4905647f1e3f4a0094ae689aaaefa76d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.731693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 913/1859] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:22.733001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca087ec0-c5a9-4ff1-b4c9-862702f0d90b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:22.733289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca087ec0-c5a9-4ff1-b4c9-862702f0d90b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:22.733566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca087ec0-c5a9-4ff1-b4c9-862702f0d90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:22.752481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ca087ec0-c5a9-4ff1-b4c9-862702f0d90b None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:22.753684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ca087ec0-c5a9-4ff1-b4c9-862702f0d90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:22.760664 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4905647f1e3f4a0094ae689aaaefa76d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.761618 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4905647f1e3f4a0094ae689aaaefa76d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.774269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4905647f1e3f4a0094ae689aaaefa76d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:22.780594 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 947/1860] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:22 2022] DELETE /identity/v3/users/4905647f1e3f4a0094ae689aaaefa76d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:22.781300 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:22.782668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:22.830855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 914/1861] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 5 15:33:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:22.831785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca087ec0-c5a9-4ff1-b4c9-862702f0d90b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:22.833272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ca087ec0-c5a9-4ff1-b4c9-862702f0d90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:22.848961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca087ec0-c5a9-4ff1-b4c9-862702f0d90b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:22.854381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfa1dc-6a28-4186-9ccd-d2c63caae5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:22.855056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfa1dc-6a28-4186-9ccd-d2c63caae5bb admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:22.855337 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfa1dc-6a28-4186-9ccd-d2c63caae5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:22.859225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfa1dc-6a28-4186-9ccd-d2c63caae5bb admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:22.859225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfa1dc-6a28-4186-9ccd-d2c63caae5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:22.859225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfa1dc-6a28-4186-9ccd-d2c63caae5bb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:22.861462 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887aa63b-6bc6-4b3e-84a1-03ac5abd87b5 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:22.868383 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:22.869603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:22.869894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:22.870564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] PATH_INFO: `/v3/projects/4184d329900c4733b885b5c352d9313a` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:22.871821 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4184d329900c4733b885b5c352d9313a)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:22.873959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:22.979846 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 915/1862] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:22 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:22.981756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfa1dc-6a28-4186-9ccd-d2c63caae5bb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:22.983750 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-58cfa1dc-6a28-4186-9ccd-d2c63caae5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:23.008273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfa1dc-6a28-4186-9ccd-d2c63caae5bb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:23.013493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b13d2-359b-4951-9df7-5e45a36a7618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:23.032524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b13d2-359b-4951-9df7-5e45a36a7618 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:23.032524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b13d2-359b-4951-9df7-5e45a36a7618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:23.032524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b13d2-359b-4951-9df7-5e45a36a7618 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:23.032524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b13d2-359b-4951-9df7-5e45a36a7618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:23.032524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b13d2-359b-4951-9df7-5e45a36a7618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:23.032524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b13d2-359b-4951-9df7-5e45a36a7618 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:23.033512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 916/1863] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:23.033512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b13d2-359b-4951-9df7-5e45a36a7618 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:23.037452 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a70b13d2-359b-4951-9df7-5e45a36a7618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:23.095771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4184d329900c4733b885b5c352d9313a', 'request_id': 'req-bc928809-b9d9-47a5-bd49-7cee6238ac5b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:23.116436 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4184d329900c4733b885b5c352d9313a', 'request_id': 'req-bc928809-b9d9-47a5-bd49-7cee6238ac5b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:23.190026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4184d329900c4733b885b5c352d9313a', 'request_id': 'req-bc928809-b9d9-47a5-bd49-7cee6238ac5b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:23.209287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] The token cache is being invalidate because project 4184d329900c4733b885b5c352d9313a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:23.211902 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:23.212984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:23.215630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 948/1864] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:22 2022] DELETE /identity/v3/projects/4184d329900c4733b885b5c352d9313a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:23.216986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:23.218590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:23.232378 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b13d2-359b-4951-9df7-5e45a36a7618 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:23.344815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe33ca-d2d1-4f0a-b177-d3e31cfff622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:23.349295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe33ca-d2d1-4f0a-b177-d3e31cfff622 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:23.349295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe33ca-d2d1-4f0a-b177-d3e31cfff622 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:23.349295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe33ca-d2d1-4f0a-b177-d3e31cfff622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:23.350445 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7bbe33ca-d2d1-4f0a-b177-d3e31cfff622 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:23.355210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc928809-b9d9-47a5-bd49-7cee6238ac5b admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:23.361783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240ce6-024f-4eb2-9b42-d5c282480767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:23.362529 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240ce6-024f-4eb2-9b42-d5c282480767 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:23.362812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240ce6-024f-4eb2-9b42-d5c282480767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:23.363087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240ce6-024f-4eb2-9b42-d5c282480767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:23.363882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12240ce6-024f-4eb2-9b42-d5c282480767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:23.365586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12240ce6-024f-4eb2-9b42-d5c282480767 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:23.383699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 949/1865] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:23.383699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240ce6-024f-4eb2-9b42-d5c282480767 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:23.385254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe33ca-d2d1-4f0a-b177-d3e31cfff622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:23.387606 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe33ca-d2d1-4f0a-b177-d3e31cfff622 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:23.395580 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-12240ce6-024f-4eb2-9b42-d5c282480767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:23.404318 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 917/1866] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:23.405215 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe33ca-d2d1-4f0a-b177-d3e31cfff622 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:23.417548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7bbe33ca-d2d1-4f0a-b177-d3e31cfff622 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:23.425532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240ce6-024f-4eb2-9b42-d5c282480767 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:23.439706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe33ca-d2d1-4f0a-b177-d3e31cfff622 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:23.440400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc53f6-a41f-4ce3-9594-ac93f3ad5159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:23.441217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc53f6-a41f-4ce3-9594-ac93f3ad5159 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:23.441501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc53f6-a41f-4ce3-9594-ac93f3ad5159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:23.441781 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc53f6-a41f-4ce3-9594-ac93f3ad5159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:23.442551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc53f6-a41f-4ce3-9594-ac93f3ad5159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:23.444516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc53f6-a41f-4ce3-9594-ac93f3ad5159 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:23.447313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:23.448211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:23.448678 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:23.448961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] PATH_INFO: `/v3/users/4b44107634964ee0b6287dd0abaca1a7` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:23.450366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b44107634964ee0b6287dd0abaca1a7)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:23.452345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:23.590380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 950/1867] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:23 2022] POST /identity/v3/projects => generated 405 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:23.591649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc53f6-a41f-4ce3-9594-ac93f3ad5159 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:23.667575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc53f6-a41f-4ce3-9594-ac93f3ad5159 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:23.672888 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0f77-ce96-43f5-b893-d293a71764ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:23.673952 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0f77-ce96-43f5-b893-d293a71764ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:23.674242 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0f77-ce96-43f5-b893-d293a71764ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:23.674552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0f77-ce96-43f5-b893-d293a71764ca admin admin] PATH_INFO: `/v3/projects/53ae931879594323a8bf2076585e955f/users/a6b0822e73c343549b69a834284bf0d6/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:23.694798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0f77-ce96-43f5-b893-d293a71764ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ae931879594323a8bf2076585e955f, user_id=a6b0822e73c343549b69a834284bf0d6, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:23.698651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0f77-ce96-43f5-b893-d293a71764ca admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:23.699821 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b44107634964ee0b6287dd0abaca1a7'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:23.708034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b44107634964ee0b6287dd0abaca1a7'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:23.708776 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b44107634964ee0b6287dd0abaca1a7'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:23.709481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b44107634964ee0b6287dd0abaca1a7'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:23.723428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b44107634964ee0b6287dd0abaca1a7'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:23.805645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 951/1868] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:23 2022] PUT /identity/v3/projects/53ae931879594323a8bf2076585e955f/users/a6b0822e73c343549b69a834284bf0d6/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:23.807106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0f77-ce96-43f5-b893-d293a71764ca admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:23.809209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a21e0f77-ce96-43f5-b893-d293a71764ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:23.832938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 918/1869] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:23 2022] DELETE /identity/v3/users/4b44107634964ee0b6287dd0abaca1a7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:23.833855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:23.835213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:23.904806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0f77-ce96-43f5-b893-d293a71764ca admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:23.911937 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672a495-a526-4ae3-8fe5-d4487fd72ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:23.914578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a495-a526-4ae3-8fe5-d4487fd72ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:23.915263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a495-a526-4ae3-8fe5-d4487fd72ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:23.915548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a495-a526-4ae3-8fe5-d4487fd72ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:23.916314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672a495-a526-4ae3-8fe5-d4487fd72ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:23.917073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de3d6d-3f19-4967-8bad-038029fc392b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:23.919082 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672a495-a526-4ae3-8fe5-d4487fd72ee5 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:23.922572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdae11-ca65-49b8-b473-27c475e45fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:23.924410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdae11-ca65-49b8-b473-27c475e45fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:23.924847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdae11-ca65-49b8-b473-27c475e45fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:23.925271 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdae11-ca65-49b8-b473-27c475e45fe2 admin admin] PATH_INFO: `/v3/projects/ae2e5adce9ea4372b0f099e148b50769` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:23.927473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdae11-ca65-49b8-b473-27c475e45fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae2e5adce9ea4372b0f099e148b50769)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:23.930528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdae11-ca65-49b8-b473-27c475e45fe2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.032847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 952/1870] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:23 2022] POST /identity/v3/users => generated 303 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:24.033803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672a495-a526-4ae3-8fe5-d4487fd72ee5 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:24.039278 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9672a495-a526-4ae3-8fe5-d4487fd72ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.064310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672a495-a526-4ae3-8fe5-d4487fd72ee5 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:24.086511 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bacdae11-ca65-49b8-b473-27c475e45fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae2e5adce9ea4372b0f099e148b50769', 'request_id': 'req-bacdae11-ca65-49b8-b473-27c475e45fe2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.096851 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bacdae11-ca65-49b8-b473-27c475e45fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae2e5adce9ea4372b0f099e148b50769', 'request_id': 'req-bacdae11-ca65-49b8-b473-27c475e45fe2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.134575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093d41c-9536-49c1-9b8e-1c6f601de200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:24.135261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093d41c-9536-49c1-9b8e-1c6f601de200 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.135551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093d41c-9536-49c1-9b8e-1c6f601de200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.135832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093d41c-9536-49c1-9b8e-1c6f601de200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.136567 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093d41c-9536-49c1-9b8e-1c6f601de200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:24.138268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093d41c-9536-49c1-9b8e-1c6f601de200 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.152256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 953/1871] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:24.152256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093d41c-9536-49c1-9b8e-1c6f601de200 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:24.162324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093d41c-9536-49c1-9b8e-1c6f601de200 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:24.167417 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d672700-10ff-4059-8a4b-ee767d551618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:24.168169 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d672700-10ff-4059-8a4b-ee767d551618 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.168462 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d672700-10ff-4059-8a4b-ee767d551618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.168741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d672700-10ff-4059-8a4b-ee767d551618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.169469 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d672700-10ff-4059-8a4b-ee767d551618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:24.171135 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d672700-10ff-4059-8a4b-ee767d551618 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.183358 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 954/1872] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:24.184172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d672700-10ff-4059-8a4b-ee767d551618 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:24.195798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d672700-10ff-4059-8a4b-ee767d551618 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:24.200579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764507c2-1c5e-4ac9-be62-0212395b8eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:24.201463 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764507c2-1c5e-4ac9-be62-0212395b8eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.201750 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764507c2-1c5e-4ac9-be62-0212395b8eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.202030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764507c2-1c5e-4ac9-be62-0212395b8eeb admin admin] PATH_INFO: `/v3/projects/53ae931879594323a8bf2076585e955f/users/a6b0822e73c343549b69a834284bf0d6/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.203947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bacdae11-ca65-49b8-b473-27c475e45fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae2e5adce9ea4372b0f099e148b50769', 'request_id': 'req-bacdae11-ca65-49b8-b473-27c475e45fe2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.204720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764507c2-1c5e-4ac9-be62-0212395b8eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ae931879594323a8bf2076585e955f, user_id=a6b0822e73c343549b69a834284bf0d6, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:24.207413 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764507c2-1c5e-4ac9-be62-0212395b8eeb admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.216771 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bacdae11-ca65-49b8-b473-27c475e45fe2 admin admin] The token cache is being invalidate because project ae2e5adce9ea4372b0f099e148b50769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:24.217831 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bacdae11-ca65-49b8-b473-27c475e45fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.218528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bacdae11-ca65-49b8-b473-27c475e45fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.229298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 955/1873] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:24 2022] PUT /identity/v3/projects/53ae931879594323a8bf2076585e955f/users/a6b0822e73c343549b69a834284bf0d6/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:24.229298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764507c2-1c5e-4ac9-be62-0212395b8eeb admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:24.229545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 919/1874] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:23 2022] DELETE /identity/v3/projects/ae2e5adce9ea4372b0f099e148b50769 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:24.229545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd97a-2e17-47ad-9397-b516fc34ed35 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.229545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd97a-2e17-47ad-9397-b516fc34ed35 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.229545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd97a-2e17-47ad-9397-b516fc34ed35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.231951 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-764507c2-1c5e-4ac9-be62-0212395b8eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.259290 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5ecfd97a-2e17-47ad-9397-b516fc34ed35 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:24.260641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5ecfd97a-2e17-47ad-9397-b516fc34ed35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.309703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764507c2-1c5e-4ac9-be62-0212395b8eeb admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:24.315758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c64d9-41ae-4962-aa7a-c24d6dee098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:24.316054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c64d9-41ae-4962-aa7a-c24d6dee098f admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.316447 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c64d9-41ae-4962-aa7a-c24d6dee098f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.316821 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c64d9-41ae-4962-aa7a-c24d6dee098f admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.317660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c64d9-41ae-4962-aa7a-c24d6dee098f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:24.319466 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c64d9-41ae-4962-aa7a-c24d6dee098f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.336865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 956/1875] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:24.336865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1a68e-5ad0-4f4f-89e1-312ebf9f0979 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.336865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1a68e-5ad0-4f4f-89e1-312ebf9f0979 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.336865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1a68e-5ad0-4f4f-89e1-312ebf9f0979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.344286 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 920/1876] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:24.345341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfd97a-2e17-47ad-9397-b516fc34ed35 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:24.346670 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5ecfd97a-2e17-47ad-9397-b516fc34ed35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.362638 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfd97a-2e17-47ad-9397-b516fc34ed35 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:24.367788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:24.368912 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.369201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.369478 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] PATH_INFO: `/v3/projects/4465e04005484222a616e7fee986ff55` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.370701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4465e04005484222a616e7fee986ff55)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:24.372802 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.382090 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-28e1a68e-5ad0-4f4f-89e1-312ebf9f0979 None None] MFA Rules not processed for user `a6b0822e73c343549b69a834284bf0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:24.388622 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-28e1a68e-5ad0-4f4f-89e1-312ebf9f0979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.461990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 957/1877] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:24.463179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1a68e-5ad0-4f4f-89e1-312ebf9f0979 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:24.473332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1a68e-5ad0-4f4f-89e1-312ebf9f0979 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:24.478803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c38c9-d6c9-4dfc-ace6-e1d76d4cb247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:24.479696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c38c9-d6c9-4dfc-ace6-e1d76d4cb247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.480002 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c38c9-d6c9-4dfc-ace6-e1d76d4cb247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.480285 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c38c9-d6c9-4dfc-ace6-e1d76d4cb247 admin admin] PATH_INFO: `/v3/projects/f32ce1ee7a2c475c82452d971b7e5f1a/users/0a53255040714c8ba7300843a6a49b37/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.498355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c38c9-d6c9-4dfc-ace6-e1d76d4cb247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32ce1ee7a2c475c82452d971b7e5f1a, user_id=0a53255040714c8ba7300843a6a49b37, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:24.501131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c38c9-d6c9-4dfc-ace6-e1d76d4cb247 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.506565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4465e04005484222a616e7fee986ff55', 'request_id': 'req-acef7282-3fa1-421d-b450-909621f68ffc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.514514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4465e04005484222a616e7fee986ff55', 'request_id': 'req-acef7282-3fa1-421d-b450-909621f68ffc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.592708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 958/1878] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:24 2022] PUT /identity/v3/projects/f32ce1ee7a2c475c82452d971b7e5f1a/users/0a53255040714c8ba7300843a6a49b37/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:24.593999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5495a82-ac1a-42b1-867d-5ae47270a219 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.594314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5495a82-ac1a-42b1-867d-5ae47270a219 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.594597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5495a82-ac1a-42b1-867d-5ae47270a219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.598417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4465e04005484222a616e7fee986ff55', 'request_id': 'req-acef7282-3fa1-421d-b450-909621f68ffc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.610893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] The token cache is being invalidate because project 4465e04005484222a616e7fee986ff55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:24.611184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.611856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:24.612443 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-d5495a82-ac1a-42b1-867d-5ae47270a219 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:24.613765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 921/1879] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:24 2022] DELETE /identity/v3/projects/4465e04005484222a616e7fee986ff55 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:24.613958 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d5495a82-ac1a-42b1-867d-5ae47270a219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.614578 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:24.615785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.679956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 959/1880] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:24.680079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7282-3fa1-421d-b450-909621f68ffc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:24.680170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acd057-666a-4495-8534-5f443285faa3 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.680170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acd057-666a-4495-8534-5f443285faa3 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.680170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acd057-666a-4495-8534-5f443285faa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.710192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b5acd057-666a-4495-8534-5f443285faa3 None None] MFA Rules not processed for user `0a53255040714c8ba7300843a6a49b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:24.712016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b5acd057-666a-4495-8534-5f443285faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.749769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38114ce-90ff-40da-9a71-f6d50ef5e94c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:24.750463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38114ce-90ff-40da-9a71-f6d50ef5e94c service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.750744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38114ce-90ff-40da-9a71-f6d50ef5e94c service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.751018 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38114ce-90ff-40da-9a71-f6d50ef5e94c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.752870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a38114ce-90ff-40da-9a71-f6d50ef5e94c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.798072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 960/1881] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:24.799420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7dfb-04a4-4a0d-97c2-7a78ee51d26c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.799827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7dfb-04a4-4a0d-97c2-7a78ee51d26c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.800110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7dfb-04a4-4a0d-97c2-7a78ee51d26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.829536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-194a7dfb-04a4-4a0d-97c2-7a78ee51d26c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:24.830587 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-194a7dfb-04a4-4a0d-97c2-7a78ee51d26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.844483 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 961/1882] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:24.845747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a7dfb-04a4-4a0d-97c2-7a78ee51d26c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:24.848999 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38114ce-90ff-40da-9a71-f6d50ef5e94c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:24.850685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38114ce-90ff-40da-9a71-f6d50ef5e94c service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.857170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a7dfb-04a4-4a0d-97c2-7a78ee51d26c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:24.861959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 922/1883] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:24.862079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1ce5f-bd93-41db-bc76-9be1e783a86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:24.862639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1ce5f-bd93-41db-bc76-9be1e783a86b admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.862755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38114ce-90ff-40da-9a71-f6d50ef5e94c service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:24.863003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1ce5f-bd93-41db-bc76-9be1e783a86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.863254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1ce5f-bd93-41db-bc76-9be1e783a86b admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.863940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a38114ce-90ff-40da-9a71-f6d50ef5e94c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.864040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1ce5f-bd93-41db-bc76-9be1e783a86b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:24.864332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1ce5f-bd93-41db-bc76-9be1e783a86b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:24.865922 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1ce5f-bd93-41db-bc76-9be1e783a86b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.877257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38114ce-90ff-40da-9a71-f6d50ef5e94c service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:24.878942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 962/1884] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:24.880044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938af76-80d6-4521-b700-7d2dbdb50c87 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.880336 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938af76-80d6-4521-b700-7d2dbdb50c87 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.880609 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938af76-80d6-4521-b700-7d2dbdb50c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.883391 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390441ea-d28a-47f5-8eae-cb1153f558fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:24.887661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390441ea-d28a-47f5-8eae-cb1153f558fc admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.887661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390441ea-d28a-47f5-8eae-cb1153f558fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.887661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390441ea-d28a-47f5-8eae-cb1153f558fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.887661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390441ea-d28a-47f5-8eae-cb1153f558fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:24.887661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390441ea-d28a-47f5-8eae-cb1153f558fc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.905994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-1938af76-80d6-4521-b700-7d2dbdb50c87 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:24.907273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1938af76-80d6-4521-b700-7d2dbdb50c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:24.918960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 963/1885] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:24.918960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938af76-80d6-4521-b700-7d2dbdb50c87 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:24.931813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938af76-80d6-4521-b700-7d2dbdb50c87 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:24.936946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35666dda-4588-4648-a21c-8c6fd7d66728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:24.937648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35666dda-4588-4648-a21c-8c6fd7d66728 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:24.937930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35666dda-4588-4648-a21c-8c6fd7d66728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:24.938208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35666dda-4588-4648-a21c-8c6fd7d66728 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:24.940736 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35666dda-4588-4648-a21c-8c6fd7d66728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:24.943001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35666dda-4588-4648-a21c-8c6fd7d66728 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:24.994317 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 923/1886] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:24 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:24.994317 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390441ea-d28a-47f5-8eae-cb1153f558fc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.042333 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 964/1887] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:24 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:25.042333 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35666dda-4588-4648-a21c-8c6fd7d66728 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.042911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-35666dda-4588-4648-a21c-8c6fd7d66728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:25.058880 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390441ea-d28a-47f5-8eae-cb1153f558fc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.108485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35666dda-4588-4648-a21c-8c6fd7d66728 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.112411 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6729e-f1d7-480d-815d-6b260d8c73e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.113103 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6729e-f1d7-480d-815d-6b260d8c73e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.113389 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6729e-f1d7-480d-815d-6b260d8c73e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.113667 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6729e-f1d7-480d-815d-6b260d8c73e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.115521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4bd6729e-f1d7-480d-815d-6b260d8c73e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:25.117479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335c8f8-d49d-4707-8f7d-85a8b852eeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.118357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335c8f8-d49d-4707-8f7d-85a8b852eeed admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.118469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335c8f8-d49d-4707-8f7d-85a8b852eeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.118740 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335c8f8-d49d-4707-8f7d-85a8b852eeed admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.119461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335c8f8-d49d-4707-8f7d-85a8b852eeed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:25.119765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335c8f8-d49d-4707-8f7d-85a8b852eeed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.121346 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335c8f8-d49d-4707-8f7d-85a8b852eeed admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.133353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 924/1888] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:25.134266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335c8f8-d49d-4707-8f7d-85a8b852eeed admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.145600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335c8f8-d49d-4707-8f7d-85a8b852eeed admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.151421 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976d469-81dd-4b27-9cb4-7e1370d58285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.152052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976d469-81dd-4b27-9cb4-7e1370d58285 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.152422 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976d469-81dd-4b27-9cb4-7e1370d58285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.152705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976d469-81dd-4b27-9cb4-7e1370d58285 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.153389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976d469-81dd-4b27-9cb4-7e1370d58285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.155341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976d469-81dd-4b27-9cb4-7e1370d58285 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.180853 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6729e-f1d7-480d-815d-6b260d8c73e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.182350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6729e-f1d7-480d-815d-6b260d8c73e3 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.192988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 965/1889] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:25.192988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6729e-f1d7-480d-815d-6b260d8c73e3 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.203140 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6729e-f1d7-480d-815d-6b260d8c73e3 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.208000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701223d6-2a6a-42c4-bbae-05ae0eb74937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.208918 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701223d6-2a6a-42c4-bbae-05ae0eb74937 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.209323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701223d6-2a6a-42c4-bbae-05ae0eb74937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.209699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701223d6-2a6a-42c4-bbae-05ae0eb74937 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.211239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701223d6-2a6a-42c4-bbae-05ae0eb74937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.213261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701223d6-2a6a-42c4-bbae-05ae0eb74937 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.252797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 925/1890] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:25 2022] POST /identity/v3/users => generated 309 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:25.252797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976d469-81dd-4b27-9cb4-7e1370d58285 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.261599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976d469-81dd-4b27-9cb4-7e1370d58285 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.266363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c332682-e696-4541-b181-c2fdb7c249b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.267544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c332682-e696-4541-b181-c2fdb7c249b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.267544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c332682-e696-4541-b181-c2fdb7c249b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.267544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c332682-e696-4541-b181-c2fdb7c249b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.268235 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c332682-e696-4541-b181-c2fdb7c249b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.270153 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c332682-e696-4541-b181-c2fdb7c249b5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.316769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 966/1891] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:25 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:25.317830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701223d6-2a6a-42c4-bbae-05ae0eb74937 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.328270 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701223d6-2a6a-42c4-bbae-05ae0eb74937 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.333176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9491d-9282-4306-b95d-4ea2506f987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.333904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9491d-9282-4306-b95d-4ea2506f987b admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.334190 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9491d-9282-4306-b95d-4ea2506f987b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.334499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9491d-9282-4306-b95d-4ea2506f987b admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.335905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9491d-9282-4306-b95d-4ea2506f987b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.338129 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9491d-9282-4306-b95d-4ea2506f987b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.352135 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 967/1892] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:25.352135 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9491d-9282-4306-b95d-4ea2506f987b admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.352671 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 926/1893] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:25 2022] POST /identity/v3/projects => generated 355 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:25.353735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c332682-e696-4541-b181-c2fdb7c249b5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.360364 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9491d-9282-4306-b95d-4ea2506f987b admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.420083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c332682-e696-4541-b181-c2fdb7c249b5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.421081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c235e1b-e368-458f-8cf7-415054af9ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.421928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c235e1b-e368-458f-8cf7-415054af9ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.422597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c235e1b-e368-458f-8cf7-415054af9ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.423125 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c235e1b-e368-458f-8cf7-415054af9ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.424101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c235e1b-e368-458f-8cf7-415054af9ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.425551 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25279188-8cf9-45e6-a562-b21ef9b1fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.426590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c235e1b-e368-458f-8cf7-415054af9ef7 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.426879 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25279188-8cf9-45e6-a562-b21ef9b1fe36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.427283 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25279188-8cf9-45e6-a562-b21ef9b1fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.427676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25279188-8cf9-45e6-a562-b21ef9b1fe36 admin admin] PATH_INFO: `/v3/projects/49722941cfc0461c9632ea1aa1de8811/users/25fb654d677040c889f9b6eaf12689a0/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.444288 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 968/1894] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:25.445659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c235e1b-e368-458f-8cf7-415054af9ef7 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.456818 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c235e1b-e368-458f-8cf7-415054af9ef7 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.466982 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a94d5a-42b1-4d5a-8ede-9753ab32a3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.467684 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94d5a-42b1-4d5a-8ede-9753ab32a3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.468114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94d5a-42b1-4d5a-8ede-9753ab32a3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.472690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94d5a-42b1-4d5a-8ede-9753ab32a3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.472690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a94d5a-42b1-4d5a-8ede-9753ab32a3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.472690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a94d5a-42b1-4d5a-8ede-9753ab32a3d8 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.476775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25279188-8cf9-45e6-a562-b21ef9b1fe36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49722941cfc0461c9632ea1aa1de8811, user_id=25fb654d677040c889f9b6eaf12689a0, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.479663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25279188-8cf9-45e6-a562-b21ef9b1fe36 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.573980 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 927/1895] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:25 2022] PUT /identity/v3/projects/49722941cfc0461c9632ea1aa1de8811/users/25fb654d677040c889f9b6eaf12689a0/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:25.574886 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25279188-8cf9-45e6-a562-b21ef9b1fe36 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.578371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 969/1896] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:25 2022] POST /identity/v3/users => generated 278 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:25.578371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a94d5a-42b1-4d5a-8ede-9753ab32a3d8 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.610267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a94d5a-42b1-4d5a-8ede-9753ab32a3d8 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.686194 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f77d-109f-434a-b36f-af53752be203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.686945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f77d-109f-434a-b36f-af53752be203 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.687233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f77d-109f-434a-b36f-af53752be203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.687512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f77d-109f-434a-b36f-af53752be203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.688287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9f77d-109f-434a-b36f-af53752be203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.690060 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9f77d-109f-434a-b36f-af53752be203 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.700808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25279188-8cf9-45e6-a562-b21ef9b1fe36 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.702987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 970/1897] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:33:25.703998 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f77d-109f-434a-b36f-af53752be203 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.710731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71985f5-d2e3-4c42-9c8a-c3aa788e095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.711797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71985f5-d2e3-4c42-9c8a-c3aa788e095b admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.712724 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71985f5-d2e3-4c42-9c8a-c3aa788e095b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.712724 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71985f5-d2e3-4c42-9c8a-c3aa788e095b admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.713430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71985f5-d2e3-4c42-9c8a-c3aa788e095b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.716051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f77d-109f-434a-b36f-af53752be203 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.716215 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71985f5-d2e3-4c42-9c8a-c3aa788e095b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.722780 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dee449-afb6-4bb1-a28b-fb81529a749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.723912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dee449-afb6-4bb1-a28b-fb81529a749a admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.724215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dee449-afb6-4bb1-a28b-fb81529a749a admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.724500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dee449-afb6-4bb1-a28b-fb81529a749a admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.725256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dee449-afb6-4bb1-a28b-fb81529a749a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.728083 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dee449-afb6-4bb1-a28b-fb81529a749a admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.730940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 928/1898] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:25.731922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71985f5-d2e3-4c42-9c8a-c3aa788e095b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.744214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 971/1899] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:25.749497 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dee449-afb6-4bb1-a28b-fb81529a749a admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.756134 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71985f5-d2e3-4c42-9c8a-c3aa788e095b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.765727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dee449-afb6-4bb1-a28b-fb81529a749a admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.772665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe8a8b-934a-44ca-a4a8-2c07d48b200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.774488 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe8a8b-934a-44ca-a4a8-2c07d48b200e admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.774812 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe8a8b-934a-44ca-a4a8-2c07d48b200e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.775096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe8a8b-934a-44ca-a4a8-2c07d48b200e admin admin] PATH_INFO: `/v3/projects/49722941cfc0461c9632ea1aa1de8811/users/25fb654d677040c889f9b6eaf12689a0/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.777380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe8a8b-934a-44ca-a4a8-2c07d48b200e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49722941cfc0461c9632ea1aa1de8811, user_id=25fb654d677040c889f9b6eaf12689a0, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.780268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c6e30-e0c5-4f2b-926d-c4ddcb4bd113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.781208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c6e30-e0c5-4f2b-926d-c4ddcb4bd113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.781490 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c6e30-e0c5-4f2b-926d-c4ddcb4bd113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.781750 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe8a8b-934a-44ca-a4a8-2c07d48b200e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.781864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c6e30-e0c5-4f2b-926d-c4ddcb4bd113 admin admin] PATH_INFO: `/v3/projects/a5d0ddfd307f4ceba75cf8eae24f3e57/users/bae5f45acff445768ed29fad3d1d9549/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.797593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 929/1900] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:25 2022] PUT /identity/v3/projects/49722941cfc0461c9632ea1aa1de8811/users/25fb654d677040c889f9b6eaf12689a0/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:25.799274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c6e30-e0c5-4f2b-926d-c4ddcb4bd113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d0ddfd307f4ceba75cf8eae24f3e57, user_id=bae5f45acff445768ed29fad3d1d9549, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.802216 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c6e30-e0c5-4f2b-926d-c4ddcb4bd113 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.807263 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe8a8b-934a-44ca-a4a8-2c07d48b200e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:25.871779 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe8a8b-934a-44ca-a4a8-2c07d48b200e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:25.876794 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffecf3-be85-477c-8afc-0c364dc4bf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:25.877475 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffecf3-be85-477c-8afc-0c364dc4bf77 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.877763 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffecf3-be85-477c-8afc-0c364dc4bf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.878046 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffecf3-be85-477c-8afc-0c364dc4bf77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.878808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffecf3-be85-477c-8afc-0c364dc4bf77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:25.880476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffecf3-be85-477c-8afc-0c364dc4bf77 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:25.896062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 930/1901] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:25.896062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9e9f5-70cb-4e73-a542-a34153002234 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:25.896062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9e9f5-70cb-4e73-a542-a34153002234 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:25.896062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9e9f5-70cb-4e73-a542-a34153002234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:25.932897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-60b9e9f5-70cb-4e73-a542-a34153002234 None None] MFA Rules not processed for user `25fb654d677040c889f9b6eaf12689a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:25.934403 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-60b9e9f5-70cb-4e73-a542-a34153002234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:25.940823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 972/1902] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:25 2022] PUT /identity/v3/projects/a5d0ddfd307f4ceba75cf8eae24f3e57/users/bae5f45acff445768ed29fad3d1d9549/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:25.944221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c6e30-e0c5-4f2b-926d-c4ddcb4bd113 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.041261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 931/1903] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:26.042821 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1f363-2416-4139-97f3-462a61e46f39 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.043174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1f363-2416-4139-97f3-462a61e46f39 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.043518 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1f363-2416-4139-97f3-462a61e46f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.054859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c6e30-e0c5-4f2b-926d-c4ddcb4bd113 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.061179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf7628-2e2d-4a80-ade9-f71de304d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.062095 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf7628-2e2d-4a80-ade9-f71de304d026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.062410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf7628-2e2d-4a80-ade9-f71de304d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.062749 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf7628-2e2d-4a80-ade9-f71de304d026 admin admin] PATH_INFO: `/v3/projects/f046cbfb36e541ab9cc1cf1bf1b5922c/users/8981bca66f3d4820a2cb45e8975a4562/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.080610 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5eb1f363-2416-4139-97f3-462a61e46f39 None None] MFA Rules not processed for user `bae5f45acff445768ed29fad3d1d9549`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:26.081883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5eb1f363-2416-4139-97f3-462a61e46f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:26.083535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf7628-2e2d-4a80-ade9-f71de304d026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f046cbfb36e541ab9cc1cf1bf1b5922c, user_id=8981bca66f3d4820a2cb45e8975a4562, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.087511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf7628-2e2d-4a80-ade9-f71de304d026 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.150989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 932/1904] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:26.152878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1f363-2416-4139-97f3-462a61e46f39 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.184940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 973/1905] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:25 2022] PUT /identity/v3/projects/f046cbfb36e541ab9cc1cf1bf1b5922c/users/8981bca66f3d4820a2cb45e8975a4562/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:26.185944 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf7628-2e2d-4a80-ade9-f71de304d026 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.205262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1f363-2416-4139-97f3-462a61e46f39 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.250511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf7628-2e2d-4a80-ade9-f71de304d026 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.256675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd985d-bbf4-4dca-9e13-44dd3b8becd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.257687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd985d-bbf4-4dca-9e13-44dd3b8becd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.257996 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd985d-bbf4-4dca-9e13-44dd3b8becd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.258360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd985d-bbf4-4dca-9e13-44dd3b8becd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.259057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd985d-bbf4-4dca-9e13-44dd3b8becd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.261262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd985d-bbf4-4dca-9e13-44dd3b8becd3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.263201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309411b0-362a-4749-9a3c-f68dcbd71b3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.263857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309411b0-362a-4749-9a3c-f68dcbd71b3b service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.264136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309411b0-362a-4749-9a3c-f68dcbd71b3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.264416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309411b0-362a-4749-9a3c-f68dcbd71b3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.331813 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309411b0-362a-4749-9a3c-f68dcbd71b3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.333252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309411b0-362a-4749-9a3c-f68dcbd71b3b service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.343736 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 933/1906] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:26 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:26.345150 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e0f9-c6c6-451e-967c-5eaa9d5e76b8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.345319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e0f9-c6c6-451e-967c-5eaa9d5e76b8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.345604 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e0f9-c6c6-451e-967c-5eaa9d5e76b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.348824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 974/1907] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:26 2022] POST /identity/v3/projects => generated 367 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:26.354573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd985d-bbf4-4dca-9e13-44dd3b8becd3 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.373407 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9fc2e0f9-c6c6-451e-967c-5eaa9d5e76b8 None None] MFA Rules not processed for user `8981bca66f3d4820a2cb45e8975a4562`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:26.374705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9fc2e0f9-c6c6-451e-967c-5eaa9d5e76b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:26.450556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd985d-bbf4-4dca-9e13-44dd3b8becd3 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.451388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 934/1908] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:26.452266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2e0f9-c6c6-451e-967c-5eaa9d5e76b8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.469946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9fc2e0f9-c6c6-451e-967c-5eaa9d5e76b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:26.470048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533531e1-310d-46ee-9032-da8a40d9d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.470048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533531e1-310d-46ee-9032-da8a40d9d8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.470048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533531e1-310d-46ee-9032-da8a40d9d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.470048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533531e1-310d-46ee-9032-da8a40d9d8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.470422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533531e1-310d-46ee-9032-da8a40d9d8e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.470422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533531e1-310d-46ee-9032-da8a40d9d8e7 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.471851 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2e0f9-c6c6-451e-967c-5eaa9d5e76b8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.476681 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.477581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.477859 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.478141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] PATH_INFO: `/v3/users/5ca62753d1e342f89135152222aaf379` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.479390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca62753d1e342f89135152222aaf379)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.481395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.595027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 975/1909] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:26 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:26.595027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533531e1-310d-46ee-9032-da8a40d9d8e7 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.608062 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533531e1-310d-46ee-9032-da8a40d9d8e7 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.612981 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad21ae-0079-4804-b4fd-1721a02f3be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.613753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad21ae-0079-4804-b4fd-1721a02f3be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.614047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad21ae-0079-4804-b4fd-1721a02f3be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.614383 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad21ae-0079-4804-b4fd-1721a02f3be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.615115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad21ae-0079-4804-b4fd-1721a02f3be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.617645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad21ae-0079-4804-b4fd-1721a02f3be0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.718414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca62753d1e342f89135152222aaf379'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:26.725503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca62753d1e342f89135152222aaf379'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:26.726677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca62753d1e342f89135152222aaf379'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:26.727300 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca62753d1e342f89135152222aaf379'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:26.739542 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca62753d1e342f89135152222aaf379'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:26.747217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 976/1910] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:26 2022] POST /identity/v3/projects => generated 355 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:26.747217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad21ae-0079-4804-b4fd-1721a02f3be0 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.747217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-07ad21ae-0079-4804-b4fd-1721a02f3be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:26.817915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad21ae-0079-4804-b4fd-1721a02f3be0 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.824910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.825833 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.826142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.826983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] PATH_INFO: `/v3/users/0a53255040714c8ba7300843a6a49b37` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.828315 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a53255040714c8ba7300843a6a49b37)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.832486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.873603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 935/1911] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:26 2022] DELETE /identity/v3/users/5ca62753d1e342f89135152222aaf379 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:26.874838 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.876213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:26.943654 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146cbde-7200-42d3-bb5b-a52bd20b31ca admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.949206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3fa36-6743-46a8-aebe-6ea851762ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.949933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3fa36-6743-46a8-aebe-6ea851762ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.950151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3fa36-6743-46a8-aebe-6ea851762ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.950564 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3fa36-6743-46a8-aebe-6ea851762ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.951267 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3fa36-6743-46a8-aebe-6ea851762ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.952883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3fa36-6743-46a8-aebe-6ea851762ab1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:26.963314 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 936/1912] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:26.964116 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3fa36-6743-46a8-aebe-6ea851762ab1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:26.971205 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8ce3fa36-6743-46a8-aebe-6ea851762ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:26.983836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3fa36-6743-46a8-aebe-6ea851762ab1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:26.988377 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512368c-232f-4cce-9e9b-e3238f005a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:26.989028 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512368c-232f-4cce-9e9b-e3238f005a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:26.991149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512368c-232f-4cce-9e9b-e3238f005a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:26.991149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512368c-232f-4cce-9e9b-e3238f005a7e admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:26.991149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512368c-232f-4cce-9e9b-e3238f005a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:26.993052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512368c-232f-4cce-9e9b-e3238f005a7e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:27.046238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a53255040714c8ba7300843a6a49b37'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:27.053677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a53255040714c8ba7300843a6a49b37'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:27.064857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 937/1913] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:26 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:27.071658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1e3a6-0ce4-4070-b1e4-5d84e867384e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.071658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1e3a6-0ce4-4070-b1e4-5d84e867384e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.071658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1e3a6-0ce4-4070-b1e4-5d84e867384e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.086489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c0a1e3a6-0ce4-4070-b1e4-5d84e867384e None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:27.087821 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c0a1e3a6-0ce4-4070-b1e4-5d84e867384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:27.096415 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 938/1914] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:27.105366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1e3a6-0ce4-4070-b1e4-5d84e867384e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:27.107827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1e3a6-0ce4-4070-b1e4-5d84e867384e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:27.113183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07925560-54e2-4984-8734-52e881b49f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:27.114138 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07925560-54e2-4984-8734-52e881b49f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.114481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07925560-54e2-4984-8734-52e881b49f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.114753 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07925560-54e2-4984-8734-52e881b49f40 admin admin] PATH_INFO: `/v3/projects/625cdb8cb5184367b24f37df4da1168e/users/8cd5f221471b40349a8a81c02128e08e/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.131050 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07925560-54e2-4984-8734-52e881b49f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=625cdb8cb5184367b24f37df4da1168e, user_id=8cd5f221471b40349a8a81c02128e08e, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:27.134266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07925560-54e2-4984-8734-52e881b49f40 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:27.146820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a53255040714c8ba7300843a6a49b37'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:27.147434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a53255040714c8ba7300843a6a49b37'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:27.162078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a53255040714c8ba7300843a6a49b37'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:27.170558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 977/1915] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:26 2022] DELETE /identity/v3/users/0a53255040714c8ba7300843a6a49b37 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:27.171318 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:27.174782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:27.214976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 939/1916] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:27 2022] PUT /identity/v3/projects/625cdb8cb5184367b24f37df4da1168e/users/8cd5f221471b40349a8a81c02128e08e/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:27.214976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07925560-54e2-4984-8734-52e881b49f40 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:27.214976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-07925560-54e2-4984-8734-52e881b49f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:27.244715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1af2-e32b-4e6d-b8f3-b8e6407d8151 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:27.283006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07925560-54e2-4984-8734-52e881b49f40 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:27.287345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d1be1-0209-4281-8721-1ffc091e2d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:27.287998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d1be1-0209-4281-8721-1ffc091e2d6f service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.288279 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d1be1-0209-4281-8721-1ffc091e2d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.289683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d1be1-0209-4281-8721-1ffc091e2d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.292039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-399d1be1-0209-4281-8721-1ffc091e2d6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:27.307752 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21388fb9-1c70-43d0-ace9-63918b1bde7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:27.308519 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21388fb9-1c70-43d0-ace9-63918b1bde7b admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.308759 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21388fb9-1c70-43d0-ace9-63918b1bde7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.309037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21388fb9-1c70-43d0-ace9-63918b1bde7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.309767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21388fb9-1c70-43d0-ace9-63918b1bde7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:27.312058 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21388fb9-1c70-43d0-ace9-63918b1bde7b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:27.324116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 978/1917] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:27.324816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d62c6-5828-4e27-9e49-633d11aa5511 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.325200 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d62c6-5828-4e27-9e49-633d11aa5511 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.325758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d62c6-5828-4e27-9e49-633d11aa5511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.343746 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-fc0d62c6-5828-4e27-9e49-633d11aa5511 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:27.344950 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-fc0d62c6-5828-4e27-9e49-633d11aa5511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:27.356571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 979/1918] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:27.360607 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d62c6-5828-4e27-9e49-633d11aa5511 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:27.361895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-fc0d62c6-5828-4e27-9e49-633d11aa5511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:27.372768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d1be1-0209-4281-8721-1ffc091e2d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:27.374479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d62c6-5828-4e27-9e49-633d11aa5511 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:27.374661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d1be1-0209-4281-8721-1ffc091e2d6f service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:27.379296 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeb5f8-0ed0-481c-80c3-5afc3460f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:27.380264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb5f8-0ed0-481c-80c3-5afc3460f4ff admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.380264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb5f8-0ed0-481c-80c3-5afc3460f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.380506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb5f8-0ed0-481c-80c3-5afc3460f4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.384025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeb5f8-0ed0-481c-80c3-5afc3460f4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:27.384025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeb5f8-0ed0-481c-80c3-5afc3460f4ff admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:27.386080 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 940/1919] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:27.386949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d1be1-0209-4281-8721-1ffc091e2d6f service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:27.394153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 980/1920] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:27.396766 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d1be1-0209-4281-8721-1ffc091e2d6f service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:27.399295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeb5f8-0ed0-481c-80c3-5afc3460f4ff admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:27.402825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03982649-90c3-4cdc-a2a3-3f26394814fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:27.403731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03982649-90c3-4cdc-a2a3-3f26394814fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.404016 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03982649-90c3-4cdc-a2a3-3f26394814fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.404348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03982649-90c3-4cdc-a2a3-3f26394814fd admin admin] PATH_INFO: `/v3/projects/e5fa670e64fb4ed8bafbe7091f2c72d3/users/e5f1de5d379046ac9fe6a8f3fdc998ed/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.410240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeb5f8-0ed0-481c-80c3-5afc3460f4ff admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:27.414647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a679169-beab-4b71-bd64-2fba121c2025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:27.415962 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a679169-beab-4b71-bd64-2fba121c2025 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.416249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a679169-beab-4b71-bd64-2fba121c2025 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.416523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a679169-beab-4b71-bd64-2fba121c2025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.421559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03982649-90c3-4cdc-a2a3-3f26394814fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5fa670e64fb4ed8bafbe7091f2c72d3, user_id=e5f1de5d379046ac9fe6a8f3fdc998ed, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:27.424401 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03982649-90c3-4cdc-a2a3-3f26394814fd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:27.426981 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a679169-beab-4b71-bd64-2fba121c2025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:27.428568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a679169-beab-4b71-bd64-2fba121c2025 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:27.439695 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 981/1921] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:27.440585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a679169-beab-4b71-bd64-2fba121c2025 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:27.450865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a679169-beab-4b71-bd64-2fba121c2025 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:27.455640 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21092498-098b-40e6-8b4f-830fc1776460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:27.456565 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21092498-098b-40e6-8b4f-830fc1776460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.456861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21092498-098b-40e6-8b4f-830fc1776460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.457149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21092498-098b-40e6-8b4f-830fc1776460 admin admin] PATH_INFO: `/v3/projects/625cdb8cb5184367b24f37df4da1168e/users/8cd5f221471b40349a8a81c02128e08e/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.459151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21092498-098b-40e6-8b4f-830fc1776460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=625cdb8cb5184367b24f37df4da1168e, user_id=8cd5f221471b40349a8a81c02128e08e, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:27.462347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21092498-098b-40e6-8b4f-830fc1776460 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:27.481862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 982/1922] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:27 2022] PUT /identity/v3/projects/625cdb8cb5184367b24f37df4da1168e/users/8cd5f221471b40349a8a81c02128e08e/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:27.491799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2cba3-6a6e-4c10-b703-125e78375404 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.492479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2cba3-6a6e-4c10-b703-125e78375404 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.492934 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2cba3-6a6e-4c10-b703-125e78375404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.523548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e6a2cba3-6a6e-4c10-b703-125e78375404 None None] MFA Rules not processed for user `8cd5f221471b40349a8a81c02128e08e`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:27.531272 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e6a2cba3-6a6e-4c10-b703-125e78375404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:27.558457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 941/1923] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:27 2022] PUT /identity/v3/projects/e5fa670e64fb4ed8bafbe7091f2c72d3/users/e5f1de5d379046ac9fe6a8f3fdc998ed/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:27.563938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03982649-90c3-4cdc-a2a3-3f26394814fd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:27.599311 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 983/1924] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:27.610857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2cba3-6a6e-4c10-b703-125e78375404 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:27.612558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e6a2cba3-6a6e-4c10-b703-125e78375404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:27.631206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03982649-90c3-4cdc-a2a3-3f26394814fd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:27.636748 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5abf8b-5300-4789-8fcc-054702c886e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:27.637460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5abf8b-5300-4789-8fcc-054702c886e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.637747 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5abf8b-5300-4789-8fcc-054702c886e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.638029 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5abf8b-5300-4789-8fcc-054702c886e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.638788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5abf8b-5300-4789-8fcc-054702c886e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:27.640419 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5abf8b-5300-4789-8fcc-054702c886e6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:27.650314 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 942/1925] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:27.655063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5abf8b-5300-4789-8fcc-054702c886e6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:27.665606 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5abf8b-5300-4789-8fcc-054702c886e6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:27.670522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c2714-492c-430d-a9fd-e8be046fc877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:27.671470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c2714-492c-430d-a9fd-e8be046fc877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.672086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c2714-492c-430d-a9fd-e8be046fc877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.672086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c2714-492c-430d-a9fd-e8be046fc877 admin admin] PATH_INFO: `/v3/projects/e5fa670e64fb4ed8bafbe7091f2c72d3/users/e5f1de5d379046ac9fe6a8f3fdc998ed/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.674034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c2714-492c-430d-a9fd-e8be046fc877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5fa670e64fb4ed8bafbe7091f2c72d3, user_id=e5f1de5d379046ac9fe6a8f3fdc998ed, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:27.677005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c2714-492c-430d-a9fd-e8be046fc877 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:27.680602 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2cba3-6a6e-4c10-b703-125e78375404 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:27.690513 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 943/1926] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:27 2022] PUT /identity/v3/projects/e5fa670e64fb4ed8bafbe7091f2c72d3/users/e5f1de5d379046ac9fe6a8f3fdc998ed/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:27.709593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93393b-bf4e-49d8-ae52-1f52d0e00f28 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.709895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93393b-bf4e-49d8-ae52-1f52d0e00f28 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.710180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93393b-bf4e-49d8-ae52-1f52d0e00f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.763971 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3f93393b-bf4e-49d8-ae52-1f52d0e00f28 None None] MFA Rules not processed for user `e5f1de5d379046ac9fe6a8f3fdc998ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:27.765902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3f93393b-bf4e-49d8-ae52-1f52d0e00f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:27.767116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca53028-6b42-4085-b03a-af5375a5dd35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:27.768070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca53028-6b42-4085-b03a-af5375a5dd35 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:27.768428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca53028-6b42-4085-b03a-af5375a5dd35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:27.768782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca53028-6b42-4085-b03a-af5375a5dd35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:27.890567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 944/1927] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:27 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:27.901271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca53028-6b42-4085-b03a-af5375a5dd35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:27.903022 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca53028-6b42-4085-b03a-af5375a5dd35 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:27.913135 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 984/1928] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:33:28.029883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93393b-bf4e-49d8-ae52-1f52d0e00f28 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:28.034252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3f93393b-bf4e-49d8-ae52-1f52d0e00f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:28.035157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca53028-6b42-4085-b03a-af5375a5dd35 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:28.037605 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7ca53028-6b42-4085-b03a-af5375a5dd35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:28.086727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca53028-6b42-4085-b03a-af5375a5dd35 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:28.168353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:28.169390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:28.169749 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:28.170136 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] PATH_INFO: `/v3/projects/723dc54312d0498a811a3f78d1eb4e93` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:28.171787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=723dc54312d0498a811a3f78d1eb4e93)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:28.173867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:28.175288 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93393b-bf4e-49d8-ae52-1f52d0e00f28 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:28.183281 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:28.184175 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:28.184533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:28.184807 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] PATH_INFO: `/v3/projects/f32ce1ee7a2c475c82452d971b7e5f1a` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:28.186175 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32ce1ee7a2c475c82452d971b7e5f1a)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:28.188176 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:28.301035 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723dc54312d0498a811a3f78d1eb4e93', 'request_id': 'req-8b13accd-6299-46f3-9156-80e1e0711b92'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.307864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723dc54312d0498a811a3f78d1eb4e93', 'request_id': 'req-8b13accd-6299-46f3-9156-80e1e0711b92'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.353050 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32ce1ee7a2c475c82452d971b7e5f1a', 'request_id': 'req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.359261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32ce1ee7a2c475c82452d971b7e5f1a', 'request_id': 'req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.432666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723dc54312d0498a811a3f78d1eb4e93', 'request_id': 'req-8b13accd-6299-46f3-9156-80e1e0711b92'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.444105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] The token cache is being invalidate because project 723dc54312d0498a811a3f78d1eb4e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:28.460416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.460416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.460416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 985/1929] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:28 2022] DELETE /identity/v3/projects/723dc54312d0498a811a3f78d1eb4e93 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:28.460416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:28.460416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:28.512770 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13accd-6299-46f3-9156-80e1e0711b92 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:28.562453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa530b0b-d962-4b43-99ae-3657a37681cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:28.563026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530b0b-d962-4b43-99ae-3657a37681cd service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:28.563304 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530b0b-d962-4b43-99ae-3657a37681cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:28.563615 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530b0b-d962-4b43-99ae-3657a37681cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:28.565407 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-fa530b0b-d962-4b43-99ae-3657a37681cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:28.634186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa530b0b-d962-4b43-99ae-3657a37681cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:28.635647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa530b0b-d962-4b43-99ae-3657a37681cd service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:28.638168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32ce1ee7a2c475c82452d971b7e5f1a', 'request_id': 'req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.647664 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 986/1930] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:28 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:28.648901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa530b0b-d962-4b43-99ae-3657a37681cd service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:28.650137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] The token cache is being invalidate because project f32ce1ee7a2c475c82452d971b7e5f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:28.650372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-fa530b0b-d962-4b43-99ae-3657a37681cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:28.650475 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.651220 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:28.655956 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 945/1931] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:28 2022] DELETE /identity/v3/projects/f32ce1ee7a2c475c82452d971b7e5f1a => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:28.656781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:28.658316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:28.663229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa530b0b-d962-4b43-99ae-3657a37681cd service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:28.668643 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4888cb8-0466-4eb8-955e-5cc70fd90750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:28.669148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4888cb8-0466-4eb8-955e-5cc70fd90750 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:28.669436 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4888cb8-0466-4eb8-955e-5cc70fd90750 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:28.669712 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4888cb8-0466-4eb8-955e-5cc70fd90750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:28.673609 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b4888cb8-0466-4eb8-955e-5cc70fd90750 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:28.730555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8e007-1b15-47e4-9cb0-112f7d68efc6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:28.735385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:28.736437 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:28.736725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:28.737008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] PATH_INFO: `/v3/users/8b433cdcd5854b33a0ab8c714d05ce03` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:28.738246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b433cdcd5854b33a0ab8c714d05ce03)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:28.740358 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:28.740913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4888cb8-0466-4eb8-955e-5cc70fd90750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:28.742920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4888cb8-0466-4eb8-955e-5cc70fd90750 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:28.759493 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 987/1932] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:28.760773 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4888cb8-0466-4eb8-955e-5cc70fd90750 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:28.762441 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b4888cb8-0466-4eb8-955e-5cc70fd90750 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:28.787445 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4888cb8-0466-4eb8-955e-5cc70fd90750 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:28.793084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:28.794367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:28.797728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:28.797728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] PATH_INFO: `/v3/users/25fb654d677040c889f9b6eaf12689a0` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:28.797728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25fb654d677040c889f9b6eaf12689a0)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:28.799147 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:29.113522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b433cdcd5854b33a0ab8c714d05ce03'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.122631 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b433cdcd5854b33a0ab8c714d05ce03'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.123487 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b433cdcd5854b33a0ab8c714d05ce03'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.124148 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b433cdcd5854b33a0ab8c714d05ce03'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.138636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25fb654d677040c889f9b6eaf12689a0'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.139176 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b433cdcd5854b33a0ab8c714d05ce03'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.146647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25fb654d677040c889f9b6eaf12689a0'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.221370 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 946/1933] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:28 2022] DELETE /identity/v3/users/8b433cdcd5854b33a0ab8c714d05ce03 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:29.222529 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:29.228779 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:29.311083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969aab7-32f4-45af-a52d-79a87ef32785 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:29.316416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25fb654d677040c889f9b6eaf12689a0'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.317897 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25fb654d677040c889f9b6eaf12689a0'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.318069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:29.318402 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:29.326136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:29.326136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] PATH_INFO: `/v3/users/6edff234f6c545e08cdc113fe742e692` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:29.326136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6edff234f6c545e08cdc113fe742e692)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:29.326136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:29.334472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25fb654d677040c889f9b6eaf12689a0'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.341598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 988/1934] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:28 2022] DELETE /identity/v3/users/25fb654d677040c889f9b6eaf12689a0 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:29.342513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:29.344379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:29.410021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd276c8-cbfc-4144-95ca-927a005ee5b4 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:29.414232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b2332-60ea-4eb7-a93e-b77763373f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:29.414930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b2332-60ea-4eb7-a93e-b77763373f15 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:29.415216 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b2332-60ea-4eb7-a93e-b77763373f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:29.415497 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b2332-60ea-4eb7-a93e-b77763373f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:29.418901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2e8b2332-60ea-4eb7-a93e-b77763373f15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:29.491876 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b2332-60ea-4eb7-a93e-b77763373f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:29.493561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b2332-60ea-4eb7-a93e-b77763373f15 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:29.504966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 989/1935] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:29 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:29.654316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6edff234f6c545e08cdc113fe742e692'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.672505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6edff234f6c545e08cdc113fe742e692'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.674310 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6edff234f6c545e08cdc113fe742e692'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.675286 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6edff234f6c545e08cdc113fe742e692'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.706667 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6edff234f6c545e08cdc113fe742e692'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:29.806642 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 947/1936] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:29 2022] DELETE /identity/v3/users/6edff234f6c545e08cdc113fe742e692 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:29.810994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badede1b-6691-4cf7-a567-a99b855e44f1 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:29.812793 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badede1b-6691-4cf7-a567-a99b855e44f1 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:29.813444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badede1b-6691-4cf7-a567-a99b855e44f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:29.854951 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-badede1b-6691-4cf7-a567-a99b855e44f1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:29.856649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-badede1b-6691-4cf7-a567-a99b855e44f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:29.965220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 990/1937] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:29.984069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:29.986077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:30.073942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf99d40-cf43-4a8c-aee6-0cbb92882fce admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:30.078741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc336d98-9270-4454-8f5e-634dd6d53c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:30.079533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc336d98-9270-4454-8f5e-634dd6d53c57 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:30.079783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc336d98-9270-4454-8f5e-634dd6d53c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:30.080115 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc336d98-9270-4454-8f5e-634dd6d53c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:30.093384 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc336d98-9270-4454-8f5e-634dd6d53c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:30.094906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc336d98-9270-4454-8f5e-634dd6d53c57 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:30.114370 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 948/1938] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:30.235321 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badede1b-6691-4cf7-a567-a99b855e44f1 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:30.237032 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-badede1b-6691-4cf7-a567-a99b855e44f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:30.247477 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc336d98-9270-4454-8f5e-634dd6d53c57 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:30.262688 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badede1b-6691-4cf7-a567-a99b855e44f1 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:30.264557 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bc336d98-9270-4454-8f5e-634dd6d53c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:30.267757 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:30.268649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:30.268930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:30.269510 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6 admin admin] PATH_INFO: `/v3/projects/49722941cfc0461c9632ea1aa1de8811` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:30.271104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49722941cfc0461c9632ea1aa1de8811)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:30.273615 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:30.294669 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc336d98-9270-4454-8f5e-634dd6d53c57 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:30.309770 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:30.310460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:30.310868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:30.320209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] PATH_INFO: `/v3/projects/2c2d28f9e6bd46229a698ad38de49e15` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:30.324507 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2d28f9e6bd46229a698ad38de49e15)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:30.327642 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:30.537167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49722941cfc0461c9632ea1aa1de8811', 'request_id': 'req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:30.538028 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2d28f9e6bd46229a698ad38de49e15', 'request_id': 'req-e3c61711-a379-464a-a3a8-3fe35bec5269'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:30.546121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49722941cfc0461c9632ea1aa1de8811', 'request_id': 'req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:30.546956 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2d28f9e6bd46229a698ad38de49e15', 'request_id': 'req-e3c61711-a379-464a-a3a8-3fe35bec5269'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:30.707049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49722941cfc0461c9632ea1aa1de8811', 'request_id': 'req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:30.720192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6 admin admin] The token cache is being invalidate because project 49722941cfc0461c9632ea1aa1de8811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:30.720742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:30.721771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-834acc0d-b722-4dee-8b1e-083dd6dd0ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:30.728548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 991/1939] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:30 2022] DELETE /identity/v3/projects/49722941cfc0461c9632ea1aa1de8811 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:30.730217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7b242-392d-464b-97a8-562c300eef7d None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:30.730563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7b242-392d-464b-97a8-562c300eef7d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:30.730851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7b242-392d-464b-97a8-562c300eef7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:30.753631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-88c7b242-392d-464b-97a8-562c300eef7d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:30.757964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-88c7b242-392d-464b-97a8-562c300eef7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:30.806462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2d28f9e6bd46229a698ad38de49e15', 'request_id': 'req-e3c61711-a379-464a-a3a8-3fe35bec5269'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:30.828437 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] The token cache is being invalidate because project 2c2d28f9e6bd46229a698ad38de49e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:30.830655 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:30.833375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:30.842424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 949/1940] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:30 2022] DELETE /identity/v3/projects/2c2d28f9e6bd46229a698ad38de49e15 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:30.844030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:30.852970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:30.868434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 992/1941] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:30.870173 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f66862-bfa8-4246-b8f2-083b3c638bb7 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:30.870569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f66862-bfa8-4246-b8f2-083b3c638bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:30.870861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f66862-bfa8-4246-b8f2-083b3c638bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:30.900201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-01f66862-bfa8-4246-b8f2-083b3c638bb7 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:30.901656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-01f66862-bfa8-4246-b8f2-083b3c638bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:30.917498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 993/1942] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:30.918923 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f66862-bfa8-4246-b8f2-083b3c638bb7 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:30.933369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f66862-bfa8-4246-b8f2-083b3c638bb7 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:30.942231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4fe5-befd-4de8-9cab-0e6af76535b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:30.943470 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4fe5-befd-4de8-9cab-0e6af76535b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:30.943763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4fe5-befd-4de8-9cab-0e6af76535b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:30.944044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4fe5-befd-4de8-9cab-0e6af76535b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:30.946981 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf4fe5-befd-4de8-9cab-0e6af76535b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:30.947324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf4fe5-befd-4de8-9cab-0e6af76535b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:30.951991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf4fe5-befd-4de8-9cab-0e6af76535b7 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:30.982849 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 994/1943] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:30.987433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4fe5-befd-4de8-9cab-0e6af76535b7 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:31.003438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4fe5-befd-4de8-9cab-0e6af76535b7 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:31.010001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b567a-cd63-47f5-93a4-6dbb87b1eeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:31.010871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b567a-cd63-47f5-93a4-6dbb87b1eeb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:31.011124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b567a-cd63-47f5-93a4-6dbb87b1eeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:31.011540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b567a-cd63-47f5-93a4-6dbb87b1eeb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:31.012439 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b567a-cd63-47f5-93a4-6dbb87b1eeb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:31.014610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b567a-cd63-47f5-93a4-6dbb87b1eeb5 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:31.020903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c61711-a379-464a-a3a8-3fe35bec5269 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:31.025985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:31.026905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:31.027191 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:31.027527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] PATH_INFO: `/v3/users/ef34bf3dcb534712b1960d07c22ca0b0` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:31.028809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef34bf3dcb534712b1960d07c22ca0b0)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:31.030793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:31.145926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 995/1944] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:30 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:31.150066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b567a-cd63-47f5-93a4-6dbb87b1eeb5 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:31.270859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b567a-cd63-47f5-93a4-6dbb87b1eeb5 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:31.279800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b3835-7a1d-42bf-8503-bf3281a0cb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:31.281495 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b3835-7a1d-42bf-8503-bf3281a0cb64 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:31.281892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b3835-7a1d-42bf-8503-bf3281a0cb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:31.282337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b3835-7a1d-42bf-8503-bf3281a0cb64 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:31.283200 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b3835-7a1d-42bf-8503-bf3281a0cb64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:31.285688 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b3835-7a1d-42bf-8503-bf3281a0cb64 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:31.302790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef34bf3dcb534712b1960d07c22ca0b0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:31.312159 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef34bf3dcb534712b1960d07c22ca0b0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:31.313124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef34bf3dcb534712b1960d07c22ca0b0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:31.313742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef34bf3dcb534712b1960d07c22ca0b0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:31.332043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef34bf3dcb534712b1960d07c22ca0b0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:31.441709 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 996/1945] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:31 2022] POST /identity/v3/users => generated 287 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:31.443598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b3835-7a1d-42bf-8503-bf3281a0cb64 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:31.446525 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 950/1946] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:30 2022] DELETE /identity/v3/users/ef34bf3dcb534712b1960d07c22ca0b0 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:31.447560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-878b3835-7a1d-42bf-8503-bf3281a0cb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:31.448524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:31.450298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:31.471370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b3835-7a1d-42bf-8503-bf3281a0cb64 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:31.558511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:31.559775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:31.559883 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:31.560200 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] PATH_INFO: `/v3/projects/c9740d1a295f4dd88210a22caa27b90a` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:31.561945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9740d1a295f4dd88210a22caa27b90a)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:31.564131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:31.594967 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac96596-5300-4a78-b0b3-5edc4627a5a6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:31.602696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d9a6f-a411-4b77-bcd1-0d2ed628d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:31.603529 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d9a6f-a411-4b77-bcd1-0d2ed628d165 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:31.603852 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d9a6f-a411-4b77-bcd1-0d2ed628d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:31.604183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d9a6f-a411-4b77-bcd1-0d2ed628d165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:31.605783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d9a6f-a411-4b77-bcd1-0d2ed628d165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:31.606902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d9a6f-a411-4b77-bcd1-0d2ed628d165 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:31.619571 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 951/1947] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:31.629235 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d9a6f-a411-4b77-bcd1-0d2ed628d165 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:31.641623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d9a6f-a411-4b77-bcd1-0d2ed628d165 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:31.648639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aefad-884c-4ce5-8efe-f69e85cea2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:31.650135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aefad-884c-4ce5-8efe-f69e85cea2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:31.651691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aefad-884c-4ce5-8efe-f69e85cea2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:31.651691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aefad-884c-4ce5-8efe-f69e85cea2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:31.651691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aefad-884c-4ce5-8efe-f69e85cea2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:31.653409 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aefad-884c-4ce5-8efe-f69e85cea2e7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:31.670244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 952/1948] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:33:31.671593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aefad-884c-4ce5-8efe-f69e85cea2e7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:31.695645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aefad-884c-4ce5-8efe-f69e85cea2e7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:31.699312 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9740d1a295f4dd88210a22caa27b90a', 'request_id': 'req-6ce6c9d6-ebd1-420b-9990-85cee795e657'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:31.706466 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9740d1a295f4dd88210a22caa27b90a', 'request_id': 'req-6ce6c9d6-ebd1-420b-9990-85cee795e657'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:31.763064 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef845d-cf09-42df-9f30-6e9c89eca0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:31.764135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef845d-cf09-42df-9f30-6e9c89eca0cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:31.764960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef845d-cf09-42df-9f30-6e9c89eca0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:31.764960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef845d-cf09-42df-9f30-6e9c89eca0cd admin admin] PATH_INFO: `/v3/projects/3dc95aa59f3b4ea1b0b8ba25a30ff48c/users/1991dac63aab41c5a1889a2735edb3c2/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:31.781977 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef845d-cf09-42df-9f30-6e9c89eca0cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc95aa59f3b4ea1b0b8ba25a30ff48c, user_id=1991dac63aab41c5a1889a2735edb3c2, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:31.785418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef845d-cf09-42df-9f30-6e9c89eca0cd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:31.795089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9740d1a295f4dd88210a22caa27b90a', 'request_id': 'req-6ce6c9d6-ebd1-420b-9990-85cee795e657'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:31.825025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] The token cache is being invalidate because project c9740d1a295f4dd88210a22caa27b90a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:31.826903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:31.828053 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:31.830007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 997/1949] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:31 2022] DELETE /identity/v3/projects/c9740d1a295f4dd88210a22caa27b90a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:31.839390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:31.841104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:31.862047 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 953/1950] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:31 2022] PUT /identity/v3/projects/3dc95aa59f3b4ea1b0b8ba25a30ff48c/users/1991dac63aab41c5a1889a2735edb3c2/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:31.876686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e3bb6-0b3a-4e1d-bed0-22104ccabde5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:31.877033 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e3bb6-0b3a-4e1d-bed0-22104ccabde5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:31.877316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e3bb6-0b3a-4e1d-bed0-22104ccabde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:31.883162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6c9d6-ebd1-420b-9990-85cee795e657 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:31.952114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b82e3bb6-0b3a-4e1d-bed0-22104ccabde5 None None] MFA Rules not processed for user `1991dac63aab41c5a1889a2735edb3c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:31.953463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b82e3bb6-0b3a-4e1d-bed0-22104ccabde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:32.028329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:32.030839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:32.032038 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:32.032151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] PATH_INFO: `/v3/users/a6b0822e73c343549b69a834284bf0d6` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:32.036033 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b0822e73c343549b69a834284bf0d6)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:32.040207 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:32.088325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 954/1951] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:32.092995 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e3bb6-0b3a-4e1d-bed0-22104ccabde5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:32.102824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b82e3bb6-0b3a-4e1d-bed0-22104ccabde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:32.171038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e3bb6-0b3a-4e1d-bed0-22104ccabde5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:32.186329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aa5d3-6009-4509-8bbc-48033130fd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:32.187062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aa5d3-6009-4509-8bbc-48033130fd40 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:32.187296 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aa5d3-6009-4509-8bbc-48033130fd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:32.187578 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aa5d3-6009-4509-8bbc-48033130fd40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:32.188285 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3aa5d3-6009-4509-8bbc-48033130fd40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:32.190213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3aa5d3-6009-4509-8bbc-48033130fd40 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:32.349218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 955/1952] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:32 2022] POST /identity/v3/projects => generated 373 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:32.351475 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aa5d3-6009-4509-8bbc-48033130fd40 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:32.454298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b0822e73c343549b69a834284bf0d6'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:32.473504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b0822e73c343549b69a834284bf0d6'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:32.487242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aa5d3-6009-4509-8bbc-48033130fd40 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:32.492630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf4675-d6c9-4829-99f0-3d07df6312ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:32.493798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf4675-d6c9-4829-99f0-3d07df6312ef admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:32.493798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf4675-d6c9-4829-99f0-3d07df6312ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:32.493965 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf4675-d6c9-4829-99f0-3d07df6312ef admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:32.494688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf4675-d6c9-4829-99f0-3d07df6312ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:32.496638 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf4675-d6c9-4829-99f0-3d07df6312ef admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:32.561600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b0822e73c343549b69a834284bf0d6'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:32.562915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b0822e73c343549b69a834284bf0d6'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:32.580393 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b0822e73c343549b69a834284bf0d6'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:32.605770 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 998/1953] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:31 2022] DELETE /identity/v3/users/a6b0822e73c343549b69a834284bf0d6 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:32.608477 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 956/1954] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:32 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:32.609320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf4675-d6c9-4829-99f0-3d07df6312ef admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:32.619435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:32.620705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7bbf4675-d6c9-4829-99f0-3d07df6312ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:32.629790 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:32.652605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf4675-d6c9-4829-99f0-3d07df6312ef admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:32.729107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe303e1-f867-4fca-bac8-05324e1d49c1 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:32.737761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeec3cf-3054-48a0-90c8-c6691477277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:32.738741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec3cf-3054-48a0-90c8-c6691477277d admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:32.739212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec3cf-3054-48a0-90c8-c6691477277d admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:32.739690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec3cf-3054-48a0-90c8-c6691477277d admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:32.740589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeec3cf-3054-48a0-90c8-c6691477277d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:32.743902 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeec3cf-3054-48a0-90c8-c6691477277d admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:32.756139 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 999/1955] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:32.761361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeec3cf-3054-48a0-90c8-c6691477277d admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:32.782974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeec3cf-3054-48a0-90c8-c6691477277d admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:32.789336 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933e66a-6709-435a-ab6b-50b5b5876118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:32.790416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933e66a-6709-435a-ab6b-50b5b5876118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:32.790761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933e66a-6709-435a-ab6b-50b5b5876118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:32.791099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933e66a-6709-435a-ab6b-50b5b5876118 admin admin] PATH_INFO: `/v3/projects/69d6f2ce81b34ee49e2d7898e052ab17/users/57041b4a76d147258fcfa23e9e9298d4/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:32.792829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950d3c9-fdac-4b72-920f-81d2a07cdc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:32.793905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950d3c9-fdac-4b72-920f-81d2a07cdc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:32.794313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950d3c9-fdac-4b72-920f-81d2a07cdc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:32.794521 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950d3c9-fdac-4b72-920f-81d2a07cdc13 admin admin] PATH_INFO: `/v3/projects/c454b7b35d2b4234839e10e67346aabd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:32.796284 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950d3c9-fdac-4b72-920f-81d2a07cdc13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c454b7b35d2b4234839e10e67346aabd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:32.797801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950d3c9-fdac-4b72-920f-81d2a07cdc13 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:32.810797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933e66a-6709-435a-ab6b-50b5b5876118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d6f2ce81b34ee49e2d7898e052ab17, user_id=57041b4a76d147258fcfa23e9e9298d4, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:32.818663 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933e66a-6709-435a-ab6b-50b5b5876118 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:32.891382 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1000/1956] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:32 2022] PUT /identity/v3/projects/69d6f2ce81b34ee49e2d7898e052ab17/users/57041b4a76d147258fcfa23e9e9298d4/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:32.896778 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933e66a-6709-435a-ab6b-50b5b5876118 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:32.977209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4950d3c9-fdac-4b72-920f-81d2a07cdc13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c454b7b35d2b4234839e10e67346aabd', 'request_id': 'req-4950d3c9-fdac-4b72-920f-81d2a07cdc13'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:32.988612 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4950d3c9-fdac-4b72-920f-81d2a07cdc13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c454b7b35d2b4234839e10e67346aabd', 'request_id': 'req-4950d3c9-fdac-4b72-920f-81d2a07cdc13'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:33.034104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933e66a-6709-435a-ab6b-50b5b5876118 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:33.138546 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4950d3c9-fdac-4b72-920f-81d2a07cdc13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c454b7b35d2b4234839e10e67346aabd', 'request_id': 'req-4950d3c9-fdac-4b72-920f-81d2a07cdc13'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:33.153923 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4950d3c9-fdac-4b72-920f-81d2a07cdc13 admin admin] The token cache is being invalidate because project c454b7b35d2b4234839e10e67346aabd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:33.154239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4950d3c9-fdac-4b72-920f-81d2a07cdc13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:33.155013 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4950d3c9-fdac-4b72-920f-81d2a07cdc13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:33.156688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 957/1957] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:32 2022] DELETE /identity/v3/projects/c454b7b35d2b4234839e10e67346aabd => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:33.172645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cafdcf-6c83-46e1-9eb0-f4c90e10799f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:33.173340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cafdcf-6c83-46e1-9eb0-f4c90e10799f admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.173569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8e93b-2f15-49a0-afd1-23004e2d5648 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.173676 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cafdcf-6c83-46e1-9eb0-f4c90e10799f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.173892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cafdcf-6c83-46e1-9eb0-f4c90e10799f admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.174004 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8e93b-2f15-49a0-afd1-23004e2d5648 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.174235 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8e93b-2f15-49a0-afd1-23004e2d5648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.174661 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cafdcf-6c83-46e1-9eb0-f4c90e10799f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:33.176648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cafdcf-6c83-46e1-9eb0-f4c90e10799f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:33.194533 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1001/1958] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:33.197235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cafdcf-6c83-46e1-9eb0-f4c90e10799f admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:33.203151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a1cafdcf-6c83-46e1-9eb0-f4c90e10799f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:33.210942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7ce8e93b-2f15-49a0-afd1-23004e2d5648 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:33.214895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7ce8e93b-2f15-49a0-afd1-23004e2d5648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:33.229590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cafdcf-6c83-46e1-9eb0-f4c90e10799f admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:33.233239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 958/1959] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:33.251333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4c5c7-49c6-4a9f-ab9d-3247bb8e833f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.251904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b0366-e35a-4e0c-a384-901a05b01332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:33.254050 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4c5c7-49c6-4a9f-ab9d-3247bb8e833f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.254478 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4c5c7-49c6-4a9f-ab9d-3247bb8e833f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.254745 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b0366-e35a-4e0c-a384-901a05b01332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.255039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b0366-e35a-4e0c-a384-901a05b01332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.255320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b0366-e35a-4e0c-a384-901a05b01332 admin admin] PATH_INFO: `/v3/projects/69d6f2ce81b34ee49e2d7898e052ab17/users/57041b4a76d147258fcfa23e9e9298d4/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.261964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b0366-e35a-4e0c-a384-901a05b01332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d6f2ce81b34ee49e2d7898e052ab17, user_id=57041b4a76d147258fcfa23e9e9298d4, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:33.268596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b0366-e35a-4e0c-a384-901a05b01332 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:33.280363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1002/1960] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:33 2022] PUT /identity/v3/projects/69d6f2ce81b34ee49e2d7898e052ab17/users/57041b4a76d147258fcfa23e9e9298d4/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:33.291508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42683729-15cd-41a9-be3f-68befb31a528 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.291812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42683729-15cd-41a9-be3f-68befb31a528 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.292153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42683729-15cd-41a9-be3f-68befb31a528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.321184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-85f4c5c7-49c6-4a9f-ab9d-3247bb8e833f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:33.322432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-85f4c5c7-49c6-4a9f-ab9d-3247bb8e833f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:33.348303 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-42683729-15cd-41a9-be3f-68befb31a528 None None] MFA Rules not processed for user `57041b4a76d147258fcfa23e9e9298d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:33.350162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-42683729-15cd-41a9-be3f-68befb31a528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:33.419023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 959/1961] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:33.423492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4c5c7-49c6-4a9f-ab9d-3247bb8e833f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:33.436924 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4c5c7-49c6-4a9f-ab9d-3247bb8e833f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:33.437057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1003/1962] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:33.440265 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bd41c-677b-48c5-9cf9-1cbb9c7756dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:33.440998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bd41c-677b-48c5-9cf9-1cbb9c7756dd admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.441309 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bd41c-677b-48c5-9cf9-1cbb9c7756dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.441574 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bd41c-677b-48c5-9cf9-1cbb9c7756dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.442339 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bd41c-677b-48c5-9cf9-1cbb9c7756dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:33.442654 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bd41c-677b-48c5-9cf9-1cbb9c7756dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:33.444318 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bd41c-677b-48c5-9cf9-1cbb9c7756dd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:33.457502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 960/1963] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:33.459370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42683729-15cd-41a9-be3f-68befb31a528 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:33.462225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bd41c-677b-48c5-9cf9-1cbb9c7756dd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:33.463801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-42683729-15cd-41a9-be3f-68befb31a528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:33.475999 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bd41c-677b-48c5-9cf9-1cbb9c7756dd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:33.482047 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35648efa-5d6f-4403-bf57-1ee6f03d1c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:33.483063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35648efa-5d6f-4403-bf57-1ee6f03d1c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.483624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35648efa-5d6f-4403-bf57-1ee6f03d1c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.484247 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35648efa-5d6f-4403-bf57-1ee6f03d1c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.485362 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35648efa-5d6f-4403-bf57-1ee6f03d1c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:33.488055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35648efa-5d6f-4403-bf57-1ee6f03d1c1b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:33.489730 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42683729-15cd-41a9-be3f-68befb31a528 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:33.496460 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:33.497758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.498203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.498657 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] PATH_INFO: `/v3/projects/53ae931879594323a8bf2076585e955f` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.499890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ae931879594323a8bf2076585e955f)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:33.501820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:33.638048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 961/1964] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:33 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:33.639164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35648efa-5d6f-4403-bf57-1ee6f03d1c1b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:33.646922 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ae931879594323a8bf2076585e955f', 'request_id': 'req-43cffb09-4dd0-4841-8a2d-73f83e50b775'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:33.654549 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ae931879594323a8bf2076585e955f', 'request_id': 'req-43cffb09-4dd0-4841-8a2d-73f83e50b775'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:33.701383 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35648efa-5d6f-4403-bf57-1ee6f03d1c1b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:33.706550 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a512f-7be5-47ff-aaac-fd7339f8dce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:33.707180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a512f-7be5-47ff-aaac-fd7339f8dce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.707466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a512f-7be5-47ff-aaac-fd7339f8dce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.707747 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a512f-7be5-47ff-aaac-fd7339f8dce2 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.708426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a512f-7be5-47ff-aaac-fd7339f8dce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:33.711444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a512f-7be5-47ff-aaac-fd7339f8dce2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:33.738108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ae931879594323a8bf2076585e955f', 'request_id': 'req-43cffb09-4dd0-4841-8a2d-73f83e50b775'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:33.749160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] The token cache is being invalidate because project 53ae931879594323a8bf2076585e955f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:33.749450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:33.750092 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:33.751810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1004/1965] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:33 2022] DELETE /identity/v3/projects/53ae931879594323a8bf2076585e955f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:33.752720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:33.754027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:33.823529 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 962/1966] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:33 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:33.823641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cffb09-4dd0-4841-8a2d-73f83e50b775 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:33.823719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20391db1-1144-4092-9567-e2c4f0b9c01a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.823719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20391db1-1144-4092-9567-e2c4f0b9c01a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.823719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20391db1-1144-4092-9567-e2c4f0b9c01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.841427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-20391db1-1144-4092-9567-e2c4f0b9c01a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:33.842691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-20391db1-1144-4092-9567-e2c4f0b9c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:33.851198 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 963/1967] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:33.851972 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20391db1-1144-4092-9567-e2c4f0b9c01a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:33.853187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-20391db1-1144-4092-9567-e2c4f0b9c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:33.864451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20391db1-1144-4092-9567-e2c4f0b9c01a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:33.871273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2784-5192-43fc-af4c-40acca101be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:33.871939 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2784-5192-43fc-af4c-40acca101be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.872218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2784-5192-43fc-af4c-40acca101be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.872494 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2784-5192-43fc-af4c-40acca101be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.873211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2784-5192-43fc-af4c-40acca101be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:33.873378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a071d3-699f-4560-9bca-17e17638cb0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:33.874045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a071d3-699f-4560-9bca-17e17638cb0b service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.874347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a071d3-699f-4560-9bca-17e17638cb0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.874624 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a071d3-699f-4560-9bca-17e17638cb0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.874845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2784-5192-43fc-af4c-40acca101be3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:33.876389 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e6a071d3-699f-4560-9bca-17e17638cb0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:33.886611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 964/1968] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:33.886611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55ad0a-1fb0-4239-87b4-2f85db14dbd5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.886828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55ad0a-1fb0-4239-87b4-2f85db14dbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.887049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55ad0a-1fb0-4239-87b4-2f85db14dbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.905262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cf55ad0a-1fb0-4239-87b4-2f85db14dbd5 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:33.906445 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cf55ad0a-1fb0-4239-87b4-2f85db14dbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:33.916302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 965/1969] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:33.917107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55ad0a-1fb0-4239-87b4-2f85db14dbd5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:33.929612 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55ad0a-1fb0-4239-87b4-2f85db14dbd5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:33.934397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb804cb0-2a2f-4aef-b81f-aad14b738166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:33.935056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804cb0-2a2f-4aef-b81f-aad14b738166 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.935336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804cb0-2a2f-4aef-b81f-aad14b738166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.935614 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804cb0-2a2f-4aef-b81f-aad14b738166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.936327 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb804cb0-2a2f-4aef-b81f-aad14b738166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:33.937916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb804cb0-2a2f-4aef-b81f-aad14b738166 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:33.940048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a071d3-699f-4560-9bca-17e17638cb0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:33.941328 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a071d3-699f-4560-9bca-17e17638cb0b service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:33.949946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 966/1970] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:33.949946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb804cb0-2a2f-4aef-b81f-aad14b738166 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:33.953754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1005/1971] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:33.954983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a071d3-699f-4560-9bca-17e17638cb0b service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:33.959976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb804cb0-2a2f-4aef-b81f-aad14b738166 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:33.965119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea532de-78ed-480b-9d0b-a3d7d8b5284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:33.965798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a071d3-699f-4560-9bca-17e17638cb0b service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:33.966327 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea532de-78ed-480b-9d0b-a3d7d8b5284e admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.966713 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea532de-78ed-480b-9d0b-a3d7d8b5284e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.966878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea532de-78ed-480b-9d0b-a3d7d8b5284e admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.967601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea532de-78ed-480b-9d0b-a3d7d8b5284e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:33.967908 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea532de-78ed-480b-9d0b-a3d7d8b5284e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:33.969496 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea532de-78ed-480b-9d0b-a3d7d8b5284e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:33.971004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0c398-fdbd-4bce-bfa1-79e302c313c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:33.971928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c398-fdbd-4bce-bfa1-79e302c313c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:33.972184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c398-fdbd-4bce-bfa1-79e302c313c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:33.972630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c398-fdbd-4bce-bfa1-79e302c313c0 admin admin] PATH_INFO: `/v3/projects/8683b51e4909484ea07d9508e11ed256/users/9af6f43e494f485196d6ba2245bceed3/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:33.995038 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0c398-fdbd-4bce-bfa1-79e302c313c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8683b51e4909484ea07d9508e11ed256, user_id=9af6f43e494f485196d6ba2245bceed3, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:33.998007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0c398-fdbd-4bce-bfa1-79e302c313c0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:34.000287 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 967/1972] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:34.003572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea532de-78ed-480b-9d0b-a3d7d8b5284e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:34.014830 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea532de-78ed-480b-9d0b-a3d7d8b5284e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:34.019160 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435f066-f4ef-4b63-addd-69158a0127df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:34.020161 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435f066-f4ef-4b63-addd-69158a0127df admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:34.020443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435f066-f4ef-4b63-addd-69158a0127df admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:34.020727 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435f066-f4ef-4b63-addd-69158a0127df admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:34.021424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435f066-f4ef-4b63-addd-69158a0127df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:34.023538 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435f066-f4ef-4b63-addd-69158a0127df admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:34.110983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1006/1973] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:33 2022] PUT /identity/v3/projects/8683b51e4909484ea07d9508e11ed256/users/9af6f43e494f485196d6ba2245bceed3/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:34.115972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a439c5-1516-420c-bd0f-e980ad99e6c4 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:34.116264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a439c5-1516-420c-bd0f-e980ad99e6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:34.117294 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a439c5-1516-420c-bd0f-e980ad99e6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:34.131183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 968/1974] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:34 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:34.135258 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-05a439c5-1516-420c-bd0f-e980ad99e6c4 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:34.136444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-05a439c5-1516-420c-bd0f-e980ad99e6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:34.137767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435f066-f4ef-4b63-addd-69158a0127df admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:34.205215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1007/1975] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:34.211069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435f066-f4ef-4b63-addd-69158a0127df admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:34.212585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a439c5-1516-420c-bd0f-e980ad99e6c4 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:34.214340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-05a439c5-1516-420c-bd0f-e980ad99e6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:34.217454 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc15a4b-a9ed-48c7-99ae-c7497f863289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:34.218345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc15a4b-a9ed-48c7-99ae-c7497f863289 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:34.218633 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc15a4b-a9ed-48c7-99ae-c7497f863289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:34.218910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc15a4b-a9ed-48c7-99ae-c7497f863289 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:34.219600 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc15a4b-a9ed-48c7-99ae-c7497f863289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:34.221558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc15a4b-a9ed-48c7-99ae-c7497f863289 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:34.277105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a439c5-1516-420c-bd0f-e980ad99e6c4 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:34.281773 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3acc3-6a52-4755-b067-c527f87950fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:34.282644 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3acc3-6a52-4755-b067-c527f87950fa service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:34.282923 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3acc3-6a52-4755-b067-c527f87950fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:34.283195 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3acc3-6a52-4755-b067-c527f87950fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:34.293969 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3acc3-6a52-4755-b067-c527f87950fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:34.295439 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3acc3-6a52-4755-b067-c527f87950fa service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:34.305494 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1008/1976] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:33:34.306440 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3acc3-6a52-4755-b067-c527f87950fa service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:34.330209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 969/1977] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:34 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:34.334108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc15a4b-a9ed-48c7-99ae-c7497f863289 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:34.348675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc15a4b-a9ed-48c7-99ae-c7497f863289 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:34.354389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493f29c-3eb2-4a5a-b38f-f758345644bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:34.355063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493f29c-3eb2-4a5a-b38f-f758345644bc admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:34.358840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493f29c-3eb2-4a5a-b38f-f758345644bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:34.358840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493f29c-3eb2-4a5a-b38f-f758345644bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:34.358840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493f29c-3eb2-4a5a-b38f-f758345644bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:34.358840 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493f29c-3eb2-4a5a-b38f-f758345644bc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:34.361055 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3acc3-6a52-4755-b067-c527f87950fa service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:34.364770 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcde970-ed99-423d-b4cb-236d6714bd95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:34.365424 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde970-ed99-423d-b4cb-236d6714bd95 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:34.365710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde970-ed99-423d-b4cb-236d6714bd95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:34.365990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde970-ed99-423d-b4cb-236d6714bd95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:34.368777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6bcde970-ed99-423d-b4cb-236d6714bd95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:34.369002 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 970/1978] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:33:34.373126 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493f29c-3eb2-4a5a-b38f-f758345644bc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:34.383178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493f29c-3eb2-4a5a-b38f-f758345644bc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:34.387806 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c7ca4-d2d3-4c15-89b9-e8947c00d157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:34.388505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7ca4-d2d3-4c15-89b9-e8947c00d157 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:34.390268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7ca4-d2d3-4c15-89b9-e8947c00d157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:34.390268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7ca4-d2d3-4c15-89b9-e8947c00d157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:34.390268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c7ca4-d2d3-4c15-89b9-e8947c00d157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:34.391461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c7ca4-d2d3-4c15-89b9-e8947c00d157 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:34.402562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 971/1979] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:33:34.406797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c7ca4-d2d3-4c15-89b9-e8947c00d157 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:34.416401 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c7ca4-d2d3-4c15-89b9-e8947c00d157 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:34.421385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a49dbf-664b-4d9d-9a41-da1259696ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:34.422376 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a49dbf-664b-4d9d-9a41-da1259696ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:34.422671 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a49dbf-664b-4d9d-9a41-da1259696ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:34.422955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a49dbf-664b-4d9d-9a41-da1259696ce6 admin admin] PATH_INFO: `/v3/projects/6ba582b892a841fc909875cf3761d6ed/users/811c93b18a304bfea7fd8edbcd6cc74f/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:34.431206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcde970-ed99-423d-b4cb-236d6714bd95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:34.432683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcde970-ed99-423d-b4cb-236d6714bd95 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:34.441120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a49dbf-664b-4d9d-9a41-da1259696ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba582b892a841fc909875cf3761d6ed, user_id=811c93b18a304bfea7fd8edbcd6cc74f, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:34.442418 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1009/1980] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:34.444122 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a49dbf-664b-4d9d-9a41-da1259696ce6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:34.583208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 972/1981] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:34 2022] PUT /identity/v3/projects/6ba582b892a841fc909875cf3761d6ed/users/811c93b18a304bfea7fd8edbcd6cc74f/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:34.595325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b8f4f-eb97-4572-8c17-174ce1e33234 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:34.595623 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b8f4f-eb97-4572-8c17-174ce1e33234 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:34.595913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b8f4f-eb97-4572-8c17-174ce1e33234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:34.626079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-760b8f4f-eb97-4572-8c17-174ce1e33234 None None] MFA Rules not processed for user `811c93b18a304bfea7fd8edbcd6cc74f`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:34.627194 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-760b8f4f-eb97-4572-8c17-174ce1e33234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:34.694717 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1010/1982] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:34.699496 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a49dbf-664b-4d9d-9a41-da1259696ce6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:34.769478 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a49dbf-664b-4d9d-9a41-da1259696ce6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:34.774623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273a3b6-6152-4435-837b-f381129a47ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:34.775341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273a3b6-6152-4435-837b-f381129a47ed admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:34.775677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273a3b6-6152-4435-837b-f381129a47ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:34.775928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273a3b6-6152-4435-837b-f381129a47ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:34.776614 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273a3b6-6152-4435-837b-f381129a47ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:34.778590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273a3b6-6152-4435-837b-f381129a47ed admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:34.872356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 973/1983] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:34 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:34.873403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b8f4f-eb97-4572-8c17-174ce1e33234 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:34.884299 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b8f4f-eb97-4572-8c17-174ce1e33234 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:34.958041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78c3fa-c52c-448a-bf41-094423a25515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:34.958699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78c3fa-c52c-448a-bf41-094423a25515 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:34.958986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78c3fa-c52c-448a-bf41-094423a25515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:34.959266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78c3fa-c52c-448a-bf41-094423a25515 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:34.959985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78c3fa-c52c-448a-bf41-094423a25515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:34.962502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78c3fa-c52c-448a-bf41-094423a25515 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:35.070265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1011/1984] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:34 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:35.074721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273a3b6-6152-4435-837b-f381129a47ed admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:35.084842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273a3b6-6152-4435-837b-f381129a47ed admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:35.089891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e69e4-0cbf-4620-b9ae-2db5419c2b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:35.090613 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e69e4-0cbf-4620-b9ae-2db5419c2b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:35.090901 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e69e4-0cbf-4620-b9ae-2db5419c2b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:35.091183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e69e4-0cbf-4620-b9ae-2db5419c2b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:35.091942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e69e4-0cbf-4620-b9ae-2db5419c2b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:35.093548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e69e4-0cbf-4620-b9ae-2db5419c2b60 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:35.105150 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 974/1985] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:35.113582 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78c3fa-c52c-448a-bf41-094423a25515 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:35.123972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78c3fa-c52c-448a-bf41-094423a25515 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:35.129344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60191845-3c6d-4fc5-abf6-ba2193a1070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:35.131422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60191845-3c6d-4fc5-abf6-ba2193a1070e admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:35.131422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60191845-3c6d-4fc5-abf6-ba2193a1070e admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:35.131422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60191845-3c6d-4fc5-abf6-ba2193a1070e admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:35.131422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60191845-3c6d-4fc5-abf6-ba2193a1070e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:35.133187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60191845-3c6d-4fc5-abf6-ba2193a1070e admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:35.147187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1012/1986] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:35.151939 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e69e4-0cbf-4620-b9ae-2db5419c2b60 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:35.162300 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e69e4-0cbf-4620-b9ae-2db5419c2b60 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:35.167978 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c7b44-a5c0-4dc7-96ff-c74e0e86f812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:35.169013 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c7b44-a5c0-4dc7-96ff-c74e0e86f812 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:35.169337 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c7b44-a5c0-4dc7-96ff-c74e0e86f812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:35.169621 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c7b44-a5c0-4dc7-96ff-c74e0e86f812 admin admin] PATH_INFO: `/v3/projects/37655fc53c894319ab8be7940987006c/users/703806ee865e4b908c112380223d9a8b/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:35.188823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c7b44-a5c0-4dc7-96ff-c74e0e86f812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37655fc53c894319ab8be7940987006c, user_id=703806ee865e4b908c112380223d9a8b, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:35.193006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c7b44-a5c0-4dc7-96ff-c74e0e86f812 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:35.287385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 975/1987] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:35 2022] PUT /identity/v3/projects/37655fc53c894319ab8be7940987006c/users/703806ee865e4b908c112380223d9a8b/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:35.292454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36a1b-ed55-43a6-969e-135188754ec9 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:35.292751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36a1b-ed55-43a6-969e-135188754ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:35.293030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36a1b-ed55-43a6-969e-135188754ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:35.323183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e0d36a1b-ed55-43a6-969e-135188754ec9 None None] MFA Rules not processed for user `703806ee865e4b908c112380223d9a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:35.324525 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e0d36a1b-ed55-43a6-969e-135188754ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:35.397396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1013/1988] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:35.398862 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c7b44-a5c0-4dc7-96ff-c74e0e86f812 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:35.473958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c7b44-a5c0-4dc7-96ff-c74e0e86f812 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:35.481438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b7918-b10e-41ad-b59d-00fe4463c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:35.482105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b7918-b10e-41ad-b59d-00fe4463c91f admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:35.482420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b7918-b10e-41ad-b59d-00fe4463c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:35.482765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b7918-b10e-41ad-b59d-00fe4463c91f admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:35.483424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b7918-b10e-41ad-b59d-00fe4463c91f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:35.485329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b7918-b10e-41ad-b59d-00fe4463c91f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:35.616382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 976/1989] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:35 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:35.620886 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d36a1b-ed55-43a6-969e-135188754ec9 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:35.631583 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d36a1b-ed55-43a6-969e-135188754ec9 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:35.687504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e88ea-5496-4464-82d8-ec0ce9d2ce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:35.688173 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e88ea-5496-4464-82d8-ec0ce9d2ce27 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:35.688452 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e88ea-5496-4464-82d8-ec0ce9d2ce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:35.688726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e88ea-5496-4464-82d8-ec0ce9d2ce27 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:35.689423 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e88ea-5496-4464-82d8-ec0ce9d2ce27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:35.691476 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e88ea-5496-4464-82d8-ec0ce9d2ce27 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:35.799861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9d158-c4b1-42e3-a7ac-1710db4992a0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:35.800180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9d158-c4b1-42e3-a7ac-1710db4992a0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:35.801450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9d158-c4b1-42e3-a7ac-1710db4992a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:35.821233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1014/1990] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:35 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:35.825332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e88ea-5496-4464-82d8-ec0ce9d2ce27 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:35.836101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e88ea-5496-4464-82d8-ec0ce9d2ce27 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:35.842911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a4f9d158-c4b1-42e3-a7ac-1710db4992a0 None None] MFA Rules not processed for user `9af6f43e494f485196d6ba2245bceed3`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:35.844199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a4f9d158-c4b1-42e3-a7ac-1710db4992a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:35.846321 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60835d3-4e00-4a09-8444-a170bb0fc8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:35.847007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60835d3-4e00-4a09-8444-a170bb0fc8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:35.847274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60835d3-4e00-4a09-8444-a170bb0fc8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:35.847542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60835d3-4e00-4a09-8444-a170bb0fc8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:35.848295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60835d3-4e00-4a09-8444-a170bb0fc8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:35.849879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60835d3-4e00-4a09-8444-a170bb0fc8b6 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:35.873700 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1015/1991] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:33:35.875260 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60835d3-4e00-4a09-8444-a170bb0fc8b6 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:35.888478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60835d3-4e00-4a09-8444-a170bb0fc8b6 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:35.899080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc5781-e1be-4baa-b430-309eb4f989f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:35.904593 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc5781-e1be-4baa-b430-309eb4f989f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:35.904593 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc5781-e1be-4baa-b430-309eb4f989f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:35.904593 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc5781-e1be-4baa-b430-309eb4f989f1 admin admin] PATH_INFO: `/v3/projects/1d30110bfbae4b068c0c85cc9fe6d1df/users/afa8bdc1072d459eb8961122be301029/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:35.927771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc5781-e1be-4baa-b430-309eb4f989f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d30110bfbae4b068c0c85cc9fe6d1df, user_id=afa8bdc1072d459eb8961122be301029, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:35.933308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc5781-e1be-4baa-b430-309eb4f989f1 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:35.961718 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 977/1992] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:35.992527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9d158-c4b1-42e3-a7ac-1710db4992a0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:35.994032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a4f9d158-c4b1-42e3-a7ac-1710db4992a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:36.029490 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1016/1993] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:35 2022] PUT /identity/v3/projects/1d30110bfbae4b068c0c85cc9fe6d1df/users/afa8bdc1072d459eb8961122be301029/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:36.030428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc5781-e1be-4baa-b430-309eb4f989f1 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:36.061261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9d158-c4b1-42e3-a7ac-1710db4992a0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:36.109650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc5781-e1be-4baa-b430-309eb4f989f1 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:36.117539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84885beb-e364-4bd8-83f1-735f2c662670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:36.118538 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84885beb-e364-4bd8-83f1-735f2c662670 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:36.118896 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84885beb-e364-4bd8-83f1-735f2c662670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:36.119378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84885beb-e364-4bd8-83f1-735f2c662670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:36.120188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84885beb-e364-4bd8-83f1-735f2c662670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:36.121773 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84885beb-e364-4bd8-83f1-735f2c662670 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:36.123052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f152a32-8255-40c8-a262-22fc74bb9746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:36.123921 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f152a32-8255-40c8-a262-22fc74bb9746 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:36.124435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f152a32-8255-40c8-a262-22fc74bb9746 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:36.124557 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f152a32-8255-40c8-a262-22fc74bb9746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:36.137735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1017/1994] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:36.138793 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84885beb-e364-4bd8-83f1-735f2c662670 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:36.150121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84885beb-e364-4bd8-83f1-735f2c662670 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:36.156107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3011e25-8a49-41b2-8290-45b11efb41a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:36.157293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3011e25-8a49-41b2-8290-45b11efb41a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:36.157638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3011e25-8a49-41b2-8290-45b11efb41a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:36.157817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3011e25-8a49-41b2-8290-45b11efb41a2 admin admin] PATH_INFO: `/v3/projects/1d30110bfbae4b068c0c85cc9fe6d1df/users/afa8bdc1072d459eb8961122be301029/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:36.159841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3011e25-8a49-41b2-8290-45b11efb41a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d30110bfbae4b068c0c85cc9fe6d1df, user_id=afa8bdc1072d459eb8961122be301029, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:36.162512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3011e25-8a49-41b2-8290-45b11efb41a2 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:36.174143 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1018/1995] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:36 2022] PUT /identity/v3/projects/1d30110bfbae4b068c0c85cc9fe6d1df/users/afa8bdc1072d459eb8961122be301029/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:36.185082 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6752d55-0438-4ca5-9317-0f751430a4b6 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:36.185676 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6752d55-0438-4ca5-9317-0f751430a4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:36.186021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6752d55-0438-4ca5-9317-0f751430a4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:36.202897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f152a32-8255-40c8-a262-22fc74bb9746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:36.204464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f152a32-8255-40c8-a262-22fc74bb9746 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:36.214890 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 978/1996] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:36.215966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-f6752d55-0438-4ca5-9317-0f751430a4b6 None None] MFA Rules not processed for user `afa8bdc1072d459eb8961122be301029`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:36.217363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-f6752d55-0438-4ca5-9317-0f751430a4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:36.293607 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1019/1997] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:36.848843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f152a32-8255-40c8-a262-22fc74bb9746 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:36.860769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f152a32-8255-40c8-a262-22fc74bb9746 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:36.912201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2b72a-37bf-45fe-9b43-c8f4b8289dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:36.912774 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2b72a-37bf-45fe-9b43-c8f4b8289dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:36.913059 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2b72a-37bf-45fe-9b43-c8f4b8289dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:36.913340 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2b72a-37bf-45fe-9b43-c8f4b8289dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:36.968372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2b72a-37bf-45fe-9b43-c8f4b8289dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:36.969807 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2b72a-37bf-45fe-9b43-c8f4b8289dc4 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:36.978854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 979/1998] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:37.363748 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6752d55-0438-4ca5-9317-0f751430a4b6 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:37.365302 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-f6752d55-0438-4ca5-9317-0f751430a4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:37.431548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6752d55-0438-4ca5-9317-0f751430a4b6 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:37.436967 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:37.437853 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:37.438131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:37.438439 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] PATH_INFO: `/v3/users/bae5f45acff445768ed29fad3d1d9549` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:37.439651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bae5f45acff445768ed29fad3d1d9549)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:37.441593 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:37.664097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bae5f45acff445768ed29fad3d1d9549'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:37.671430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bae5f45acff445768ed29fad3d1d9549'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:37.740966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bae5f45acff445768ed29fad3d1d9549'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:37.742751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bae5f45acff445768ed29fad3d1d9549'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:37.755603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bae5f45acff445768ed29fad3d1d9549'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:37.762232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1020/1999] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:37 2022] DELETE /identity/v3/users/bae5f45acff445768ed29fad3d1d9549 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:37.766634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa526bd-b641-4da2-ac99-b0e98f4ec7ba None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:37.767045 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa526bd-b641-4da2-ac99-b0e98f4ec7ba None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:37.767199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa526bd-b641-4da2-ac99-b0e98f4ec7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:37.784131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1fa526bd-b641-4da2-ac99-b0e98f4ec7ba None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:37.785337 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1fa526bd-b641-4da2-ac99-b0e98f4ec7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:37.845461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 980/2000] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:37.856324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:37.858347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:37.920174 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed32087-4bba-4dd5-9aa2-c0370b8be31a admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:37.923881 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e87643-957a-46db-9c53-3be04725c2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:37.924627 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e87643-957a-46db-9c53-3be04725c2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:37.924911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e87643-957a-46db-9c53-3be04725c2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:37.925192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e87643-957a-46db-9c53-3be04725c2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:37.935418 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e87643-957a-46db-9c53-3be04725c2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:37.936850 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e87643-957a-46db-9c53-3be04725c2d2 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:37.946842 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1021/2001] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:38.326375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa526bd-b641-4da2-ac99-b0e98f4ec7ba None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:38.327808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1fa526bd-b641-4da2-ac99-b0e98f4ec7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:38.341884 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa526bd-b641-4da2-ac99-b0e98f4ec7ba None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:38.347327 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b6160-a167-475e-8efd-b7b0b34db76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:38.348212 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b6160-a167-475e-8efd-b7b0b34db76c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:38.348556 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b6160-a167-475e-8efd-b7b0b34db76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:38.348867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b6160-a167-475e-8efd-b7b0b34db76c admin admin] PATH_INFO: `/v3/projects/a5d0ddfd307f4ceba75cf8eae24f3e57` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:38.350078 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b6160-a167-475e-8efd-b7b0b34db76c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d0ddfd307f4ceba75cf8eae24f3e57)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:38.355190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b6160-a167-475e-8efd-b7b0b34db76c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:38.416073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26283f26-cb3e-4dde-9c1b-70f2d0af58ca None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:38.416585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26283f26-cb3e-4dde-9c1b-70f2d0af58ca None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:38.416674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26283f26-cb3e-4dde-9c1b-70f2d0af58ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:38.435819 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-26283f26-cb3e-4dde-9c1b-70f2d0af58ca None None] MFA Rules not processed for user `9af6f43e494f485196d6ba2245bceed3`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:38.437028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-26283f26-cb3e-4dde-9c1b-70f2d0af58ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:38.493475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1022/2002] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:38.514590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-955b6160-a167-475e-8efd-b7b0b34db76c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d0ddfd307f4ceba75cf8eae24f3e57', 'request_id': 'req-955b6160-a167-475e-8efd-b7b0b34db76c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:38.520749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-955b6160-a167-475e-8efd-b7b0b34db76c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d0ddfd307f4ceba75cf8eae24f3e57', 'request_id': 'req-955b6160-a167-475e-8efd-b7b0b34db76c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:38.646838 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-955b6160-a167-475e-8efd-b7b0b34db76c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d0ddfd307f4ceba75cf8eae24f3e57', 'request_id': 'req-955b6160-a167-475e-8efd-b7b0b34db76c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:38.658995 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-955b6160-a167-475e-8efd-b7b0b34db76c admin admin] The token cache is being invalidate because project a5d0ddfd307f4ceba75cf8eae24f3e57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:38.659286 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-955b6160-a167-475e-8efd-b7b0b34db76c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:38.659936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-955b6160-a167-475e-8efd-b7b0b34db76c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:38.662001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 981/2003] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:38 2022] DELETE /identity/v3/projects/a5d0ddfd307f4ceba75cf8eae24f3e57 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:38.666168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26283f26-cb3e-4dde-9c1b-70f2d0af58ca None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:38.677726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26283f26-cb3e-4dde-9c1b-70f2d0af58ca None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:38.747914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:38.748925 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:38.749307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:38.749674 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] PATH_INFO: `/v3/users/8cd5f221471b40349a8a81c02128e08e` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:38.763568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd5f221471b40349a8a81c02128e08e)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:38.765806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:38.830028 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6c68b-f3fc-4b1e-bb12-14fd01854a15 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:38.830596 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6c68b-f3fc-4b1e-bb12-14fd01854a15 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:38.830690 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6c68b-f3fc-4b1e-bb12-14fd01854a15 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:38.832144 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 982/2004] 10.222.0.44 () {54 vars in 912 bytes} [Thu May 5 15:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:33:38.840350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aa058-d83c-4fa8-8232-52166dfaa3f6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:38.840534 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aa058-d83c-4fa8-8232-52166dfaa3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:38.849962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aa058-d83c-4fa8-8232-52166dfaa3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:38.866596 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1a8aa058-d83c-4fa8-8232-52166dfaa3f6 None None] MFA Rules not processed for user `c5efb606fb1b422182ab91576088c85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:38.868008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1a8aa058-d83c-4fa8-8232-52166dfaa3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:38.924268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 983/2005] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:33:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:38.937550 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aa058-d83c-4fa8-8232-52166dfaa3f6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:38.938970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1a8aa058-d83c-4fa8-8232-52166dfaa3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:38.949331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aa058-d83c-4fa8-8232-52166dfaa3f6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:38.953030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b861afd-7257-46cc-8851-9fa31ab6a197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:38.953674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b861afd-7257-46cc-8851-9fa31ab6a197 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:38.953957 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b861afd-7257-46cc-8851-9fa31ab6a197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:38.954235 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b861afd-7257-46cc-8851-9fa31ab6a197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:38.961870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b861afd-7257-46cc-8851-9fa31ab6a197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:38.963316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b861afd-7257-46cc-8851-9fa31ab6a197 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:38.971427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 984/2006] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:33:38.990045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd5f221471b40349a8a81c02128e08e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:39.004375 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd5f221471b40349a8a81c02128e08e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:39.075481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd5f221471b40349a8a81c02128e08e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:39.076112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd5f221471b40349a8a81c02128e08e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:39.090370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd5f221471b40349a8a81c02128e08e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:39.097009 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1023/2007] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:38 2022] DELETE /identity/v3/users/8cd5f221471b40349a8a81c02128e08e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:39.316308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b861afd-7257-46cc-8851-9fa31ab6a197 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:39.317956 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6b861afd-7257-46cc-8851-9fa31ab6a197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:39.379999 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b861afd-7257-46cc-8851-9fa31ab6a197 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:39.450938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d4f6f-54db-46db-aec7-4d7dd23893e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:39.451692 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d4f6f-54db-46db-aec7-4d7dd23893e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:39.451881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d4f6f-54db-46db-aec7-4d7dd23893e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:39.452165 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d4f6f-54db-46db-aec7-4d7dd23893e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:39.454164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-de6d4f6f-54db-46db-aec7-4d7dd23893e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:39.512220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:39.512220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:39.531021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d4f6f-54db-46db-aec7-4d7dd23893e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:39.532930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d4f6f-54db-46db-aec7-4d7dd23893e7 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:39.547126 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 985/2008] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:39.595536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a04849-bf11-4f29-abed-3ed0958fdfe9 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:39.601770 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:39.603555 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:39.610213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:39.610213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a admin admin] PATH_INFO: `/v3/projects/625cdb8cb5184367b24f37df4da1168e` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:39.610213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=625cdb8cb5184367b24f37df4da1168e)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:39.610213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:39.738847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625cdb8cb5184367b24f37df4da1168e', 'request_id': 'req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:39.744998 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625cdb8cb5184367b24f37df4da1168e', 'request_id': 'req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:39.821594 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625cdb8cb5184367b24f37df4da1168e', 'request_id': 'req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:39.832542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a admin admin] The token cache is being invalidate because project 625cdb8cb5184367b24f37df4da1168e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:39.832973 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:39.833597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-014d91a2-2e27-46a7-a351-0bb5b2e55a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:39.835421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1024/2009] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:39 2022] DELETE /identity/v3/projects/625cdb8cb5184367b24f37df4da1168e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:39.840274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fd437-0bf9-493d-8287-f8ce53f7dda0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:39.840765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fd437-0bf9-493d-8287-f8ce53f7dda0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:39.840861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fd437-0bf9-493d-8287-f8ce53f7dda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:39.858611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-934fd437-0bf9-493d-8287-f8ce53f7dda0 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:39.859792 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-934fd437-0bf9-493d-8287-f8ce53f7dda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:39.919997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 986/2010] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:39.928184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42283140-317d-4c1e-8cc6-f76f503eb309 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:39.928475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42283140-317d-4c1e-8cc6-f76f503eb309 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:39.929384 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42283140-317d-4c1e-8cc6-f76f503eb309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:39.947473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-42283140-317d-4c1e-8cc6-f76f503eb309 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:39.948770 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-42283140-317d-4c1e-8cc6-f76f503eb309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:39.958044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1025/2011] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:39.962674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fd437-0bf9-493d-8287-f8ce53f7dda0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:39.972169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fd437-0bf9-493d-8287-f8ce53f7dda0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:39.977870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab5684-2467-4bfa-a212-8ae5aa852cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:39.978624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab5684-2467-4bfa-a212-8ae5aa852cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:39.978974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab5684-2467-4bfa-a212-8ae5aa852cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:39.979260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab5684-2467-4bfa-a212-8ae5aa852cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:39.980006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab5684-2467-4bfa-a212-8ae5aa852cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:39.980292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab5684-2467-4bfa-a212-8ae5aa852cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:39.981964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab5684-2467-4bfa-a212-8ae5aa852cc2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:39.994434 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 987/2012] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:33:39.998741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42283140-317d-4c1e-8cc6-f76f503eb309 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:40.009299 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42283140-317d-4c1e-8cc6-f76f503eb309 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:40.015377 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73922c-c075-464c-a737-ccf0349f266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:40.015991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73922c-c075-464c-a737-ccf0349f266b admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:40.016280 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73922c-c075-464c-a737-ccf0349f266b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:40.016584 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73922c-c075-464c-a737-ccf0349f266b admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:40.017464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73922c-c075-464c-a737-ccf0349f266b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:40.019617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73922c-c075-464c-a737-ccf0349f266b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:40.148631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1026/2013] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:39 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:40.152544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab5684-2467-4bfa-a212-8ae5aa852cc2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:40.164978 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab5684-2467-4bfa-a212-8ae5aa852cc2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:40.220586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7caf124-cb5e-4574-8e8c-45b7876098b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:40.221258 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7caf124-cb5e-4574-8e8c-45b7876098b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:40.221973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7caf124-cb5e-4574-8e8c-45b7876098b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:40.221973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7caf124-cb5e-4574-8e8c-45b7876098b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:40.222545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7caf124-cb5e-4574-8e8c-45b7876098b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:40.224438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7caf124-cb5e-4574-8e8c-45b7876098b1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:40.356269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 988/2014] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:40 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:40.360565 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73922c-c075-464c-a737-ccf0349f266b admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:40.370899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73922c-c075-464c-a737-ccf0349f266b admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:40.375370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86939f-ea16-49ac-b309-3851217cf01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:40.376051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86939f-ea16-49ac-b309-3851217cf01a admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:40.376336 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86939f-ea16-49ac-b309-3851217cf01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:40.376613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86939f-ea16-49ac-b309-3851217cf01a admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:40.377346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86939f-ea16-49ac-b309-3851217cf01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:40.378989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86939f-ea16-49ac-b309-3851217cf01a admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:40.390902 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1027/2015] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:40.396869 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7caf124-cb5e-4574-8e8c-45b7876098b1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:40.407973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7caf124-cb5e-4574-8e8c-45b7876098b1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:40.412850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2773f1-586a-4504-8a7e-074c30806e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:40.414228 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2773f1-586a-4504-8a7e-074c30806e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:40.414548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2773f1-586a-4504-8a7e-074c30806e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:40.414832 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2773f1-586a-4504-8a7e-074c30806e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:40.415565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2773f1-586a-4504-8a7e-074c30806e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:40.417275 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2773f1-586a-4504-8a7e-074c30806e83 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:40.427693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 989/2016] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:40.432735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86939f-ea16-49ac-b309-3851217cf01a admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:40.442805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86939f-ea16-49ac-b309-3851217cf01a admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:40.448193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49762bb9-3a0d-4e58-a431-2a901a735ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:40.449132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49762bb9-3a0d-4e58-a431-2a901a735ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:40.449422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49762bb9-3a0d-4e58-a431-2a901a735ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:40.449750 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49762bb9-3a0d-4e58-a431-2a901a735ecf admin admin] PATH_INFO: `/v3/projects/28e97a14d27746e1b375aab136543705/users/0392ec167ed04ece91d9cbfc58467a13/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:40.464421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49762bb9-3a0d-4e58-a431-2a901a735ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e97a14d27746e1b375aab136543705, user_id=0392ec167ed04ece91d9cbfc58467a13, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:40.467183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49762bb9-3a0d-4e58-a431-2a901a735ecf admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:40.569887 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1028/2017] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:40 2022] PUT /identity/v3/projects/28e97a14d27746e1b375aab136543705/users/0392ec167ed04ece91d9cbfc58467a13/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:40.584935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85dc84-bc4c-4db3-8aa2-5fac0c31266d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:40.585887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85dc84-bc4c-4db3-8aa2-5fac0c31266d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:40.586167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85dc84-bc4c-4db3-8aa2-5fac0c31266d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:40.618880 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fc85dc84-bc4c-4db3-8aa2-5fac0c31266d None None] MFA Rules not processed for user `0392ec167ed04ece91d9cbfc58467a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:40.620183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fc85dc84-bc4c-4db3-8aa2-5fac0c31266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:40.687642 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 990/2018] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:40.692012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49762bb9-3a0d-4e58-a431-2a901a735ecf admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:40.753917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49762bb9-3a0d-4e58-a431-2a901a735ecf admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:40.771088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b5698-9a49-4fdd-8152-0c3ce11dab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:40.772088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5698-9a49-4fdd-8152-0c3ce11dab3d admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:40.772646 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5698-9a49-4fdd-8152-0c3ce11dab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:40.774052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5698-9a49-4fdd-8152-0c3ce11dab3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:40.774956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b5698-9a49-4fdd-8152-0c3ce11dab3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:40.777689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b5698-9a49-4fdd-8152-0c3ce11dab3d admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:40.874436 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1029/2019] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:40 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:40.878737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85dc84-bc4c-4db3-8aa2-5fac0c31266d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:40.889367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85dc84-bc4c-4db3-8aa2-5fac0c31266d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:40.946474 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8b4af-796b-48e2-b183-239f1cec6fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:40.947430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b4af-796b-48e2-b183-239f1cec6fac admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:40.947714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b4af-796b-48e2-b183-239f1cec6fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:40.948022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b4af-796b-48e2-b183-239f1cec6fac admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:40.948714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8b4af-796b-48e2-b183-239f1cec6fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:40.950659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8b4af-796b-48e2-b183-239f1cec6fac admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:41.014875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 991/2020] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:40 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:41.019051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b5698-9a49-4fdd-8152-0c3ce11dab3d admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:41.030301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b5698-9a49-4fdd-8152-0c3ce11dab3d admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:41.035027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1abf22-8016-44d7-82f0-3c780ae97b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:41.035690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1abf22-8016-44d7-82f0-3c780ae97b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:41.035974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1abf22-8016-44d7-82f0-3c780ae97b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:41.036251 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1abf22-8016-44d7-82f0-3c780ae97b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:41.037017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1abf22-8016-44d7-82f0-3c780ae97b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:41.039927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1abf22-8016-44d7-82f0-3c780ae97b69 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:41.050379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1030/2021] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:41.055103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8b4af-796b-48e2-b183-239f1cec6fac admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:41.065701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8b4af-796b-48e2-b183-239f1cec6fac admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:41.070916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45c835-8b9c-42f5-a378-c17930f5efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:41.071806 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45c835-8b9c-42f5-a378-c17930f5efc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:41.072122 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45c835-8b9c-42f5-a378-c17930f5efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:41.072350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45c835-8b9c-42f5-a378-c17930f5efc6 admin admin] PATH_INFO: `/v3/projects/f735e8ba753241a5be9dec732176b134/users/d267657332194b5393e066ad4bc7f759/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:41.090742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45c835-8b9c-42f5-a378-c17930f5efc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f735e8ba753241a5be9dec732176b134, user_id=d267657332194b5393e066ad4bc7f759, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:41.093439 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45c835-8b9c-42f5-a378-c17930f5efc6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:41.186894 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 992/2022] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:41 2022] PUT /identity/v3/projects/f735e8ba753241a5be9dec732176b134/users/d267657332194b5393e066ad4bc7f759/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:41.191059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1abf22-8016-44d7-82f0-3c780ae97b69 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:41.201504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1abf22-8016-44d7-82f0-3c780ae97b69 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:41.256203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc0a7a-1f3c-4bfa-b07c-87ad87cfa126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:41.256879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0a7a-1f3c-4bfa-b07c-87ad87cfa126 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:41.257154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0a7a-1f3c-4bfa-b07c-87ad87cfa126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:41.257507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0a7a-1f3c-4bfa-b07c-87ad87cfa126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:41.258238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc0a7a-1f3c-4bfa-b07c-87ad87cfa126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:41.259904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc0a7a-1f3c-4bfa-b07c-87ad87cfa126 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:41.270802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1031/2023] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:41.275968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45c835-8b9c-42f5-a378-c17930f5efc6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:41.286878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45c835-8b9c-42f5-a378-c17930f5efc6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:41.292525 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b59ff-d300-4c25-9c75-6da231d89714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:41.293423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b59ff-d300-4c25-9c75-6da231d89714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:41.299979 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b59ff-d300-4c25-9c75-6da231d89714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:41.299979 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b59ff-d300-4c25-9c75-6da231d89714 admin admin] PATH_INFO: `/v3/projects/f735e8ba753241a5be9dec732176b134/users/d267657332194b5393e066ad4bc7f759/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:41.301859 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b59ff-d300-4c25-9c75-6da231d89714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f735e8ba753241a5be9dec732176b134, user_id=d267657332194b5393e066ad4bc7f759, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:41.305045 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b59ff-d300-4c25-9c75-6da231d89714 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:41.319980 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 993/2024] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:41 2022] PUT /identity/v3/projects/f735e8ba753241a5be9dec732176b134/users/d267657332194b5393e066ad4bc7f759/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:41.329512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14785a-40b3-4110-818a-8a2c632c778f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:41.329809 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14785a-40b3-4110-818a-8a2c632c778f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:41.330092 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14785a-40b3-4110-818a-8a2c632c778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:41.359901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-8a14785a-40b3-4110-818a-8a2c632c778f None None] MFA Rules not processed for user `d267657332194b5393e066ad4bc7f759`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:41.361107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8a14785a-40b3-4110-818a-8a2c632c778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:41.430221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1032/2025] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:41.441016 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b59ff-d300-4c25-9c75-6da231d89714 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:41.442776 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-373b59ff-d300-4c25-9c75-6da231d89714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:41.499896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b59ff-d300-4c25-9c75-6da231d89714 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:41.503588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ada0b4-b4f1-438d-b3aa-22795905d339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:41.504286 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ada0b4-b4f1-438d-b3aa-22795905d339 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:41.504570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ada0b4-b4f1-438d-b3aa-22795905d339 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:41.504875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ada0b4-b4f1-438d-b3aa-22795905d339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:41.563660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ada0b4-b4f1-438d-b3aa-22795905d339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:41.565448 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ada0b4-b4f1-438d-b3aa-22795905d339 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:41.575244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 994/2026] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:43.446992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14785a-40b3-4110-818a-8a2c632c778f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:43.446992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8a14785a-40b3-4110-818a-8a2c632c778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:43.458531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14785a-40b3-4110-818a-8a2c632c778f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:43.462230 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab69fc5-1317-4fe9-95c4-75aaa3e006c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:43.462893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab69fc5-1317-4fe9-95c4-75aaa3e006c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:43.463173 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab69fc5-1317-4fe9-95c4-75aaa3e006c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:43.463446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab69fc5-1317-4fe9-95c4-75aaa3e006c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:43.465129 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-dab69fc5-1317-4fe9-95c4-75aaa3e006c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:43.528735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab69fc5-1317-4fe9-95c4-75aaa3e006c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:43.530172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab69fc5-1317-4fe9-95c4-75aaa3e006c5 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:43.541296 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1033/2027] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:47.485901 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ada0b4-b4f1-438d-b3aa-22795905d339 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:47.497612 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ada0b4-b4f1-438d-b3aa-22795905d339 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:47.502125 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb33bf-0876-4d5f-a68b-c59e4f55c95c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:47.503482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb33bf-0876-4d5f-a68b-c59e4f55c95c service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:47.503482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb33bf-0876-4d5f-a68b-c59e4f55c95c service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:47.503482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb33bf-0876-4d5f-a68b-c59e4f55c95c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:47.514670 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb33bf-0876-4d5f-a68b-c59e4f55c95c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:47.516092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb33bf-0876-4d5f-a68b-c59e4f55c95c service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:47.529336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 995/2028] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:49.598153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab69fc5-1317-4fe9-95c4-75aaa3e006c5 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:49.601462 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-dab69fc5-1317-4fe9-95c4-75aaa3e006c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:49.668408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab69fc5-1317-4fe9-95c4-75aaa3e006c5 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:49.672927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc0d50-3722-4531-b02f-809758bae5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:49.673889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc0d50-3722-4531-b02f-809758bae5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:49.674104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc0d50-3722-4531-b02f-809758bae5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:49.674411 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc0d50-3722-4531-b02f-809758bae5d8 admin admin] PATH_INFO: `/v3/users/987d85f00a4e47568c4085979ea8f8ee` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:49.675593 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc0d50-3722-4531-b02f-809758bae5d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=987d85f00a4e47568c4085979ea8f8ee)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:49.677801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc0d50-3722-4531-b02f-809758bae5d8 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:49.880876 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb33bf-0876-4d5f-a68b-c59e4f55c95c service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:49.883853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2ecb33bf-0876-4d5f-a68b-c59e4f55c95c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:49.900295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-29cc0d50-3722-4531-b02f-809758bae5d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987d85f00a4e47568c4085979ea8f8ee'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:49.909079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb33bf-0876-4d5f-a68b-c59e4f55c95c service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:49.916101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-29cc0d50-3722-4531-b02f-809758bae5d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987d85f00a4e47568c4085979ea8f8ee'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:49.925486 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:49.928136 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:49.929144 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:49.930504 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] PATH_INFO: `/v3/users/811c93b18a304bfea7fd8edbcd6cc74f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:49.932266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] RBAC: Authorizing `identity:delete_user(user_id=811c93b18a304bfea7fd8edbcd6cc74f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:49.934581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:49.976854 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-29cc0d50-3722-4531-b02f-809758bae5d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987d85f00a4e47568c4085979ea8f8ee'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:49.977226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-29cc0d50-3722-4531-b02f-809758bae5d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987d85f00a4e47568c4085979ea8f8ee'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:49.997857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-29cc0d50-3722-4531-b02f-809758bae5d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987d85f00a4e47568c4085979ea8f8ee'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:50.005157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1034/2029] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:49 2022] DELETE /identity/v3/users/987d85f00a4e47568c4085979ea8f8ee => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:50.162746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811c93b18a304bfea7fd8edbcd6cc74f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:50.169566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811c93b18a304bfea7fd8edbcd6cc74f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:50.170255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811c93b18a304bfea7fd8edbcd6cc74f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:50.170894 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811c93b18a304bfea7fd8edbcd6cc74f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:50.183190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811c93b18a304bfea7fd8edbcd6cc74f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:50.370470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 996/2030] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:49 2022] DELETE /identity/v3/users/811c93b18a304bfea7fd8edbcd6cc74f => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:50.375723 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187484c-7d78-41eb-853a-0b57fac02a12 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:50.376266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187484c-7d78-41eb-853a-0b57fac02a12 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:50.376704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187484c-7d78-41eb-853a-0b57fac02a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:50.380012 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:50.384802 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:50.424884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-1187484c-7d78-41eb-853a-0b57fac02a12 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:50.426687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1187484c-7d78-41eb-853a-0b57fac02a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:50.467505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198723c-d200-424d-aef3-948ac9a0352c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:50.472685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:50.475069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:50.475069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:50.475069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e admin admin] PATH_INFO: `/v3/projects/8b27b8154a1f4257b7add9ba2ba83eae` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:50.476086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b27b8154a1f4257b7add9ba2ba83eae)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:50.478042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:50.500354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1035/2031] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:50.510065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187484c-7d78-41eb-853a-0b57fac02a12 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:50.511586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1187484c-7d78-41eb-853a-0b57fac02a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:50.566850 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187484c-7d78-41eb-853a-0b57fac02a12 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:50.570783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b757c-5eb3-42ee-8674-912ce1ceb176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:50.571429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b757c-5eb3-42ee-8674-912ce1ceb176 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:50.571706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b757c-5eb3-42ee-8674-912ce1ceb176 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:50.571980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b757c-5eb3-42ee-8674-912ce1ceb176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:50.581455 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b757c-5eb3-42ee-8674-912ce1ceb176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:50.582978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b757c-5eb3-42ee-8674-912ce1ceb176 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:50.592968 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1036/2032] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:33:50.724134 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b27b8154a1f4257b7add9ba2ba83eae', 'request_id': 'req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:50.730506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b27b8154a1f4257b7add9ba2ba83eae', 'request_id': 'req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:50.841651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b27b8154a1f4257b7add9ba2ba83eae', 'request_id': 'req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:50.855003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e admin admin] The token cache is being invalidate because project 8b27b8154a1f4257b7add9ba2ba83eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:50.855584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:50.856966 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e2934c3a-5d16-4ffe-ac7c-090b83bde78e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:50.858637 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 997/2033] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:50 2022] DELETE /identity/v3/projects/8b27b8154a1f4257b7add9ba2ba83eae => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:50.863863 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217f5a-c7d0-4803-8adb-af613ecc4546 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:50.864342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217f5a-c7d0-4803-8adb-af613ecc4546 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:50.864435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217f5a-c7d0-4803-8adb-af613ecc4546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:50.885578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a6217f5a-c7d0-4803-8adb-af613ecc4546 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:50.887224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a6217f5a-c7d0-4803-8adb-af613ecc4546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:50.945786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1037/2034] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:50.953723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055ac0-0c0d-4798-8455-f2bbbdfbd6a7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:50.954239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055ac0-0c0d-4798-8455-f2bbbdfbd6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:50.954361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055ac0-0c0d-4798-8455-f2bbbdfbd6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:50.973596 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f4055ac0-0c0d-4798-8455-f2bbbdfbd6a7 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:50.974932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f4055ac0-0c0d-4798-8455-f2bbbdfbd6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:50.984273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 998/2035] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:50.988303 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6217f5a-c7d0-4803-8adb-af613ecc4546 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:50.998805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6217f5a-c7d0-4803-8adb-af613ecc4546 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:51.003406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799fb41-e75e-4953-afac-3c90592a3229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:51.004068 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799fb41-e75e-4953-afac-3c90592a3229 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:51.004353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799fb41-e75e-4953-afac-3c90592a3229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:51.004634 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799fb41-e75e-4953-afac-3c90592a3229 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:51.005372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799fb41-e75e-4953-afac-3c90592a3229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:51.005808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799fb41-e75e-4953-afac-3c90592a3229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:51.007486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799fb41-e75e-4953-afac-3c90592a3229 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:51.023856 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1038/2036] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:51.024998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4055ac0-0c0d-4798-8455-f2bbbdfbd6a7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:51.036630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4055ac0-0c0d-4798-8455-f2bbbdfbd6a7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:51.042453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e4f0f-2219-4ed4-a38c-331c945f2ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:51.043283 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e4f0f-2219-4ed4-a38c-331c945f2ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:51.043579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e4f0f-2219-4ed4-a38c-331c945f2ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:51.043867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e4f0f-2219-4ed4-a38c-331c945f2ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:51.044560 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e4f0f-2219-4ed4-a38c-331c945f2ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:51.046533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e4f0f-2219-4ed4-a38c-331c945f2ea1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:51.087839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799fb41-e75e-4953-afac-3c90592a3229 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:51.088145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d799fb41-e75e-4953-afac-3c90592a3229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:51.102527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799fb41-e75e-4953-afac-3c90592a3229 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:51.108770 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:51.109857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:51.110188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:51.110516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] PATH_INFO: `/v3/projects/6ba582b892a841fc909875cf3761d6ed` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:51.111767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba582b892a841fc909875cf3761d6ed)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:51.113712 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:51.188293 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 999/2037] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:51 2022] POST /identity/v3/projects => generated 393 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:51.192179 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e4f0f-2219-4ed4-a38c-331c945f2ea1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:51.277451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e4f0f-2219-4ed4-a38c-331c945f2ea1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:51.281354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba582b892a841fc909875cf3761d6ed', 'request_id': 'req-3553958b-ea0b-4074-ad11-8f73810a8199'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:51.291085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba582b892a841fc909875cf3761d6ed', 'request_id': 'req-3553958b-ea0b-4074-ad11-8f73810a8199'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:51.334776 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3af447-4de1-4719-ac9d-6ab3771afc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:51.335459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3af447-4de1-4719-ac9d-6ab3771afc15 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:51.335802 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3af447-4de1-4719-ac9d-6ab3771afc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:51.336099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3af447-4de1-4719-ac9d-6ab3771afc15 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:51.336803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3af447-4de1-4719-ac9d-6ab3771afc15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:51.339069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3af447-4de1-4719-ac9d-6ab3771afc15 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:51.372931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba582b892a841fc909875cf3761d6ed', 'request_id': 'req-3553958b-ea0b-4074-ad11-8f73810a8199'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:51.385729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] The token cache is being invalidate because project 6ba582b892a841fc909875cf3761d6ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:51.386020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:51.386753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:51.388687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1039/2038] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:51 2022] DELETE /identity/v3/projects/6ba582b892a841fc909875cf3761d6ed => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:51.392469 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:51.393982 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:51.408532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553958b-ea0b-4074-ad11-8f73810a8199 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:51.414912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5d472-f6ee-498a-aaad-0f7033e8fcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:51.415882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d472-f6ee-498a-aaad-0f7033e8fcac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:51.416239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d472-f6ee-498a-aaad-0f7033e8fcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:51.416591 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d472-f6ee-498a-aaad-0f7033e8fcac admin admin] PATH_INFO: `/v3/users/703806ee865e4b908c112380223d9a8b` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:51.417965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5d472-f6ee-498a-aaad-0f7033e8fcac admin admin] RBAC: Authorizing `identity:delete_user(user_id=703806ee865e4b908c112380223d9a8b)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:51.420019 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5d472-f6ee-498a-aaad-0f7033e8fcac admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:51.442384 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1000/2039] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:51 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:51.446676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3af447-4de1-4719-ac9d-6ab3771afc15 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:51.448911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7b3af447-4de1-4719-ac9d-6ab3771afc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:51.463594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3af447-4de1-4719-ac9d-6ab3771afc15 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:51.468772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517f401-a995-453b-b3f8-a4e19346a956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:51.475166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517f401-a995-453b-b3f8-a4e19346a956 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:51.475166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517f401-a995-453b-b3f8-a4e19346a956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:51.475166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517f401-a995-453b-b3f8-a4e19346a956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:51.475166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517f401-a995-453b-b3f8-a4e19346a956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:51.475166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517f401-a995-453b-b3f8-a4e19346a956 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:51.484211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1001/2040] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:33:51.487801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517f401-a995-453b-b3f8-a4e19346a956 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:51.499042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517f401-a995-453b-b3f8-a4e19346a956 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:51.505471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aeb22-c0fd-47af-bcc0-794c7b804e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:51.508197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aeb22-c0fd-47af-bcc0-794c7b804e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:51.508583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aeb22-c0fd-47af-bcc0-794c7b804e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:51.508964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aeb22-c0fd-47af-bcc0-794c7b804e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:51.509767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851aeb22-c0fd-47af-bcc0-794c7b804e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:51.511476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851aeb22-c0fd-47af-bcc0-794c7b804e49 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:51.527984 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1002/2041] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:51.528985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aeb22-c0fd-47af-bcc0-794c7b804e49 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:51.550842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aeb22-c0fd-47af-bcc0-794c7b804e49 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:51.559422 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae70e5-df3d-4db2-8ccf-c9ab94d58b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:51.560557 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae70e5-df3d-4db2-8ccf-c9ab94d58b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:51.560847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae70e5-df3d-4db2-8ccf-c9ab94d58b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:51.561131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae70e5-df3d-4db2-8ccf-c9ab94d58b08 admin admin] PATH_INFO: `/v3/projects/74c2460709bc4a908b9aa9361b7abfd4/users/d03ba17f93a34c77a027c03a0a800aad/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:51.576429 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae70e5-df3d-4db2-8ccf-c9ab94d58b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c2460709bc4a908b9aa9361b7abfd4, user_id=d03ba17f93a34c77a027c03a0a800aad, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:51.579242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae70e5-df3d-4db2-8ccf-c9ab94d58b08 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:51.633695 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2ae5d472-f6ee-498a-aaad-0f7033e8fcac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '703806ee865e4b908c112380223d9a8b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:51.640429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2ae5d472-f6ee-498a-aaad-0f7033e8fcac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '703806ee865e4b908c112380223d9a8b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:51.691861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1003/2042] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:51 2022] PUT /identity/v3/projects/74c2460709bc4a908b9aa9361b7abfd4/users/d03ba17f93a34c77a027c03a0a800aad/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:51.692789 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae70e5-df3d-4db2-8ccf-c9ab94d58b08 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:51.694494 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-41ae70e5-df3d-4db2-8ccf-c9ab94d58b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:51.717805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2ae5d472-f6ee-498a-aaad-0f7033e8fcac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '703806ee865e4b908c112380223d9a8b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:51.718454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2ae5d472-f6ee-498a-aaad-0f7033e8fcac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '703806ee865e4b908c112380223d9a8b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:51.731527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2ae5d472-f6ee-498a-aaad-0f7033e8fcac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '703806ee865e4b908c112380223d9a8b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:51.737431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1040/2043] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:51 2022] DELETE /identity/v3/users/703806ee865e4b908c112380223d9a8b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:51.741704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126acf1-1494-42ce-ae55-8726970fc755 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:51.741987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126acf1-1494-42ce-ae55-8726970fc755 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:51.742275 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126acf1-1494-42ce-ae55-8726970fc755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:51.766434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-8126acf1-1494-42ce-ae55-8726970fc755 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:51.766568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae70e5-df3d-4db2-8ccf-c9ab94d58b08 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:51.767834 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8126acf1-1494-42ce-ae55-8726970fc755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:51.847176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1041/2044] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:51.858242 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126acf1-1494-42ce-ae55-8726970fc755 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:51.862541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8126acf1-1494-42ce-ae55-8726970fc755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:51.863110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:51.864211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:51.864457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:51.864884 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] PATH_INFO: `/v3/users/8981bca66f3d4820a2cb45e8975a4562` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:51.867611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8981bca66f3d4820a2cb45e8975a4562)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:51.869515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:51.933363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126acf1-1494-42ce-ae55-8726970fc755 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:51.937033 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ab7ee-2271-44a5-ab36-8e08b5d753c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:51.945520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ab7ee-2271-44a5-ab36-8e08b5d753c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:51.945520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ab7ee-2271-44a5-ab36-8e08b5d753c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:51.945520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ab7ee-2271-44a5-ab36-8e08b5d753c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:51.948502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ab7ee-2271-44a5-ab36-8e08b5d753c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:51.949937 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ab7ee-2271-44a5-ab36-8e08b5d753c8 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:51.960755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1042/2045] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:52.120743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8981bca66f3d4820a2cb45e8975a4562'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.129865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8981bca66f3d4820a2cb45e8975a4562'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.129865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8981bca66f3d4820a2cb45e8975a4562'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.130615 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8981bca66f3d4820a2cb45e8975a4562'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.144141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8981bca66f3d4820a2cb45e8975a4562'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.265031 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1004/2046] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:51 2022] DELETE /identity/v3/users/8981bca66f3d4820a2cb45e8975a4562 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:52.269547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c07b36-f54f-46f2-b47a-b182ed529105 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:52.269848 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c07b36-f54f-46f2-b47a-b182ed529105 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:52.270148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c07b36-f54f-46f2-b47a-b182ed529105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:52.289498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-50c07b36-f54f-46f2-b47a-b182ed529105 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:52.290892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-50c07b36-f54f-46f2-b47a-b182ed529105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:52.307143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:52.310164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:52.378213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1043/2047] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:52.388612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c07b36-f54f-46f2-b47a-b182ed529105 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:52.390117 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-50c07b36-f54f-46f2-b47a-b182ed529105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:52.395691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661f532-dba0-40c7-9606-da3b1cf8c7a0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:52.400428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:52.401383 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:52.401739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:52.402085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] PATH_INFO: `/v3/projects/37655fc53c894319ab8be7940987006c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:52.403499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37655fc53c894319ab8be7940987006c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:52.405342 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:52.469885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c07b36-f54f-46f2-b47a-b182ed529105 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:52.473777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4c00b-3696-4bee-b6a4-57a58976c4a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:52.474474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4c00b-3696-4bee-b6a4-57a58976c4a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:52.474757 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4c00b-3696-4bee-b6a4-57a58976c4a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:52.475033 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4c00b-3696-4bee-b6a4-57a58976c4a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:52.484836 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4c00b-3696-4bee-b6a4-57a58976c4a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:52.486262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4c00b-3696-4bee-b6a4-57a58976c4a3 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:52.496505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1044/2048] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:33:52.564341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37655fc53c894319ab8be7940987006c', 'request_id': 'req-42b9f03e-92fc-411d-9928-6992b149a7d0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.570678 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37655fc53c894319ab8be7940987006c', 'request_id': 'req-42b9f03e-92fc-411d-9928-6992b149a7d0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.646830 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37655fc53c894319ab8be7940987006c', 'request_id': 'req-42b9f03e-92fc-411d-9928-6992b149a7d0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.658174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] The token cache is being invalidate because project 37655fc53c894319ab8be7940987006c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:52.658527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.659425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:52.660990 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1005/2049] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:52 2022] DELETE /identity/v3/projects/37655fc53c894319ab8be7940987006c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:52.665993 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4c00b-3696-4bee-b6a4-57a58976c4a3 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:52.686069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4c00b-3696-4bee-b6a4-57a58976c4a3 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:52.816575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:52.817483 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:52.817765 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:52.818036 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] PATH_INFO: `/v3/users/afa8bdc1072d459eb8961122be301029` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:52.819969 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa8bdc1072d459eb8961122be301029)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:52.821915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:52.995434 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:52.996975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:53.016856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9f03e-92fc-411d-9928-6992b149a7d0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:53.030609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:53.032328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:53.032618 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:53.032898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] PATH_INFO: `/v3/projects/f046cbfb36e541ab9cc1cf1bf1b5922c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:53.034744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f046cbfb36e541ab9cc1cf1bf1b5922c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:53.036669 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:53.044935 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa8bdc1072d459eb8961122be301029'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.053059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa8bdc1072d459eb8961122be301029'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.149430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa8bdc1072d459eb8961122be301029'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.150054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa8bdc1072d459eb8961122be301029'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.162523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa8bdc1072d459eb8961122be301029'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.169734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1045/2050] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:52 2022] DELETE /identity/v3/users/afa8bdc1072d459eb8961122be301029 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:53.206778 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f046cbfb36e541ab9cc1cf1bf1b5922c', 'request_id': 'req-fed96690-2618-49a1-bd7b-0c327c578c4f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.216209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f046cbfb36e541ab9cc1cf1bf1b5922c', 'request_id': 'req-fed96690-2618-49a1-bd7b-0c327c578c4f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.315485 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f046cbfb36e541ab9cc1cf1bf1b5922c', 'request_id': 'req-fed96690-2618-49a1-bd7b-0c327c578c4f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.326767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] The token cache is being invalidate because project f046cbfb36e541ab9cc1cf1bf1b5922c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:53.327051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.327706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.329222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1006/2051] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:52 2022] DELETE /identity/v3/projects/f046cbfb36e541ab9cc1cf1bf1b5922c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:53.333617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:53.335851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:53.402584 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4b9b1-3ae5-4d74-8e36-d684909acd70 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:53.464187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f59f1-1bc7-47c6-8662-f874b6745ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:53.465102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f59f1-1bc7-47c6-8662-f874b6745ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:53.465381 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f59f1-1bc7-47c6-8662-f874b6745ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:53.465675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f59f1-1bc7-47c6-8662-f874b6745ffb admin admin] PATH_INFO: `/v3/users/e5f1de5d379046ac9fe6a8f3fdc998ed` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:53.468072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f59f1-1bc7-47c6-8662-f874b6745ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f1de5d379046ac9fe6a8f3fdc998ed)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:53.468842 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f59f1-1bc7-47c6-8662-f874b6745ffb admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:53.670086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:53.673613 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:53.709444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed96690-2618-49a1-bd7b-0c327c578c4f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:53.715853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7d8e8-877d-42d6-8f61-375c363695f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:53.716973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7d8e8-877d-42d6-8f61-375c363695f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:53.717765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7d8e8-877d-42d6-8f61-375c363695f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:53.718224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7d8e8-877d-42d6-8f61-375c363695f6 admin admin] PATH_INFO: `/v3/projects/1d30110bfbae4b068c0c85cc9fe6d1df` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:53.719708 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7d8e8-877d-42d6-8f61-375c363695f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d30110bfbae4b068c0c85cc9fe6d1df)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:53.721952 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7d8e8-877d-42d6-8f61-375c363695f6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:53.723802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-237f59f1-1bc7-47c6-8662-f874b6745ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f1de5d379046ac9fe6a8f3fdc998ed'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.731092 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-237f59f1-1bc7-47c6-8662-f874b6745ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f1de5d379046ac9fe6a8f3fdc998ed'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.872092 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-237f59f1-1bc7-47c6-8662-f874b6745ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f1de5d379046ac9fe6a8f3fdc998ed'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.872728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-237f59f1-1bc7-47c6-8662-f874b6745ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f1de5d379046ac9fe6a8f3fdc998ed'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.891861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-237f59f1-1bc7-47c6-8662-f874b6745ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f1de5d379046ac9fe6a8f3fdc998ed'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.893857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a9c7d8e8-877d-42d6-8f61-375c363695f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d30110bfbae4b068c0c85cc9fe6d1df', 'request_id': 'req-a9c7d8e8-877d-42d6-8f61-375c363695f6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.902416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a9c7d8e8-877d-42d6-8f61-375c363695f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d30110bfbae4b068c0c85cc9fe6d1df', 'request_id': 'req-a9c7d8e8-877d-42d6-8f61-375c363695f6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:53.905451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1046/2052] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:53 2022] DELETE /identity/v3/users/e5f1de5d379046ac9fe6a8f3fdc998ed => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:54.009943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a9c7d8e8-877d-42d6-8f61-375c363695f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d30110bfbae4b068c0c85cc9fe6d1df', 'request_id': 'req-a9c7d8e8-877d-42d6-8f61-375c363695f6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:54.021104 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a9c7d8e8-877d-42d6-8f61-375c363695f6 admin admin] The token cache is being invalidate because project 1d30110bfbae4b068c0c85cc9fe6d1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:54.021394 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a9c7d8e8-877d-42d6-8f61-375c363695f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:54.022324 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a9c7d8e8-877d-42d6-8f61-375c363695f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:54.024166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1007/2053] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:53 2022] DELETE /identity/v3/projects/1d30110bfbae4b068c0c85cc9fe6d1df => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:54.030106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007197d-c869-4c91-8ba5-348abec1d7f0 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:54.030434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007197d-c869-4c91-8ba5-348abec1d7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:54.030713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007197d-c869-4c91-8ba5-348abec1d7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:54.064308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-1007197d-c869-4c91-8ba5-348abec1d7f0 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:54.067888 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1007197d-c869-4c91-8ba5-348abec1d7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:54.192056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1047/2054] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:54.196357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f31e8e-a66e-4659-a45c-7d631f203855 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:54.197379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f31e8e-a66e-4659-a45c-7d631f203855 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:54.198537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f31e8e-a66e-4659-a45c-7d631f203855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:54.223859 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a6f31e8e-a66e-4659-a45c-7d631f203855 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:54.227357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a6f31e8e-a66e-4659-a45c-7d631f203855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:54.239530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1008/2055] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:54.246537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007197d-c869-4c91-8ba5-348abec1d7f0 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:54.266569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007197d-c869-4c91-8ba5-348abec1d7f0 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:54.274444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15027cc-e1d3-4ef7-9378-a6b3166e3d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:54.280079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15027cc-e1d3-4ef7-9378-a6b3166e3d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:54.280079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15027cc-e1d3-4ef7-9378-a6b3166e3d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:54.280079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15027cc-e1d3-4ef7-9378-a6b3166e3d95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:54.280079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15027cc-e1d3-4ef7-9378-a6b3166e3d95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:54.280079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15027cc-e1d3-4ef7-9378-a6b3166e3d95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:54.280079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15027cc-e1d3-4ef7-9378-a6b3166e3d95 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:54.296268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1048/2056] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:54.301253 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f31e8e-a66e-4659-a45c-7d631f203855 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:54.315779 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f31e8e-a66e-4659-a45c-7d631f203855 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:54.327592 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86edb3e-1a9b-455f-9f50-b999ccaf9b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:54.328487 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86edb3e-1a9b-455f-9f50-b999ccaf9b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:54.328919 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86edb3e-1a9b-455f-9f50-b999ccaf9b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:54.329353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86edb3e-1a9b-455f-9f50-b999ccaf9b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:54.330061 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86edb3e-1a9b-455f-9f50-b999ccaf9b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:54.332256 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86edb3e-1a9b-455f-9f50-b999ccaf9b61 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:54.480264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15027cc-e1d3-4ef7-9378-a6b3166e3d95 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:54.482559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d15027cc-e1d3-4ef7-9378-a6b3166e3d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:54.494792 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1009/2057] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:54 2022] POST /identity/v3/projects => generated 391 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:54.500434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15027cc-e1d3-4ef7-9378-a6b3166e3d95 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:54.503517 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86edb3e-1a9b-455f-9f50-b999ccaf9b61 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:54.586636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:54.587274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:54.587563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:54.588436 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] PATH_INFO: `/v3/projects/e5fa670e64fb4ed8bafbe7091f2c72d3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:54.595362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5fa670e64fb4ed8bafbe7091f2c72d3)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:54.598267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:54.649966 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86edb3e-1a9b-455f-9f50-b999ccaf9b61 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:54.655666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ca460-5270-486b-9083-83b5f96c3b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:54.656807 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ca460-5270-486b-9083-83b5f96c3b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:54.657195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ca460-5270-486b-9083-83b5f96c3b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:54.657596 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ca460-5270-486b-9083-83b5f96c3b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:54.658442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ca460-5270-486b-9083-83b5f96c3b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:54.660608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ca460-5270-486b-9083-83b5f96c3b39 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:54.794505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5fa670e64fb4ed8bafbe7091f2c72d3', 'request_id': 'req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:54.801630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5fa670e64fb4ed8bafbe7091f2c72d3', 'request_id': 'req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:54.843080 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1010/2058] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:54 2022] POST /identity/v3/users => generated 296 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:54.845295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ca460-5270-486b-9083-83b5f96c3b39 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:54.847340 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bd4ca460-5270-486b-9083-83b5f96c3b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:54.864355 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ca460-5270-486b-9083-83b5f96c3b39 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:54.917100 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5fa670e64fb4ed8bafbe7091f2c72d3', 'request_id': 'req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:54.932424 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] The token cache is being invalidate because project e5fa670e64fb4ed8bafbe7091f2c72d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:54.932722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:54.933482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:54.939315 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1049/2059] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:54 2022] DELETE /identity/v3/projects/e5fa670e64fb4ed8bafbe7091f2c72d3 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:54.940248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:54.941741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:54.942701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec76a5f-93d2-4414-ad69-6be5b6ef1ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:54.943618 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76a5f-93d2-4414-ad69-6be5b6ef1ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:54.944387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76a5f-93d2-4414-ad69-6be5b6ef1ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:54.945116 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76a5f-93d2-4414-ad69-6be5b6ef1ffd admin admin] PATH_INFO: `/v3/users/0392ec167ed04ece91d9cbfc58467a13` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:54.946446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec76a5f-93d2-4414-ad69-6be5b6ef1ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0392ec167ed04ece91d9cbfc58467a13)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:54.948793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec76a5f-93d2-4414-ad69-6be5b6ef1ffd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:54.962233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ed2fa-5a49-4b70-bfbd-9e044bbad39e admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:54.969089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029494f-81f9-4fb5-8910-80a117ad6915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:54.969780 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029494f-81f9-4fb5-8910-80a117ad6915 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:54.970070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029494f-81f9-4fb5-8910-80a117ad6915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:54.970509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029494f-81f9-4fb5-8910-80a117ad6915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:54.971192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029494f-81f9-4fb5-8910-80a117ad6915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:54.973769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029494f-81f9-4fb5-8910-80a117ad6915 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:54.985747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1050/2060] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:54.987808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd32e4d-5aa7-4cbd-9010-c25208cba592 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:54.988800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd32e4d-5aa7-4cbd-9010-c25208cba592 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:54.989199 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd32e4d-5aa7-4cbd-9010-c25208cba592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.014974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-8cd32e4d-5aa7-4cbd-9010-c25208cba592 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:55.017028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8cd32e4d-5aa7-4cbd-9010-c25208cba592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:55.025719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1051/2061] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:55.028945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd32e4d-5aa7-4cbd-9010-c25208cba592 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:55.038821 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd32e4d-5aa7-4cbd-9010-c25208cba592 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:55.044001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3d4ff-fc6f-474a-9dfe-8f37c3833875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:55.044756 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3d4ff-fc6f-474a-9dfe-8f37c3833875 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:55.045315 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3d4ff-fc6f-474a-9dfe-8f37c3833875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:55.045439 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3d4ff-fc6f-474a-9dfe-8f37c3833875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.046261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3d4ff-fc6f-474a-9dfe-8f37c3833875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:55.048223 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3d4ff-fc6f-474a-9dfe-8f37c3833875 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:55.061775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1052/2062] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:55.061775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78727109-5806-46ac-822d-81491dfb356c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:55.061775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78727109-5806-46ac-822d-81491dfb356c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:55.061775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78727109-5806-46ac-822d-81491dfb356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.078965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-78727109-5806-46ac-822d-81491dfb356c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:55.080448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-78727109-5806-46ac-822d-81491dfb356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:55.091783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1053/2063] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:55.091783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78727109-5806-46ac-822d-81491dfb356c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:55.100515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78727109-5806-46ac-822d-81491dfb356c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:55.105122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043f248-0c42-4f57-85b5-da27a2a77326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:55.106004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f248-0c42-4f57-85b5-da27a2a77326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:55.106310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f248-0c42-4f57-85b5-da27a2a77326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:55.106575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f248-0c42-4f57-85b5-da27a2a77326 admin admin] PATH_INFO: `/v3/projects/59b27a36eee54240bfc3c54081be785c/users/224e9cd7bcde4ae19395c13ec7b12286/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.120738 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f248-0c42-4f57-85b5-da27a2a77326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b27a36eee54240bfc3c54081be785c, user_id=224e9cd7bcde4ae19395c13ec7b12286, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:55.123410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f248-0c42-4f57-85b5-da27a2a77326 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:55.183744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1ec76a5f-93d2-4414-ad69-6be5b6ef1ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0392ec167ed04ece91d9cbfc58467a13'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:55.191000 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1ec76a5f-93d2-4414-ad69-6be5b6ef1ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0392ec167ed04ece91d9cbfc58467a13'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:55.191686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1ec76a5f-93d2-4414-ad69-6be5b6ef1ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0392ec167ed04ece91d9cbfc58467a13'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:55.192300 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1ec76a5f-93d2-4414-ad69-6be5b6ef1ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0392ec167ed04ece91d9cbfc58467a13'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:55.205428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1ec76a5f-93d2-4414-ad69-6be5b6ef1ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0392ec167ed04ece91d9cbfc58467a13'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:55.238316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1054/2064] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:55 2022] PUT /identity/v3/projects/59b27a36eee54240bfc3c54081be785c/users/224e9cd7bcde4ae19395c13ec7b12286/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:55.247944 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043f248-0c42-4f57-85b5-da27a2a77326 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:55.247944 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c043f248-0c42-4f57-85b5-da27a2a77326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:55.317830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043f248-0c42-4f57-85b5-da27a2a77326 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:55.323975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817675d-d53d-48e7-afb7-d2fb63ed41a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:55.324785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817675d-d53d-48e7-afb7-d2fb63ed41a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:55.325082 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817675d-d53d-48e7-afb7-d2fb63ed41a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:55.327225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817675d-d53d-48e7-afb7-d2fb63ed41a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.327225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817675d-d53d-48e7-afb7-d2fb63ed41a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:55.327225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817675d-d53d-48e7-afb7-d2fb63ed41a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:55.328105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817675d-d53d-48e7-afb7-d2fb63ed41a4 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:55.341192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1055/2065] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:33:55.342895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438a384-0b8b-456d-bbca-75e10d356fca None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:55.343191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438a384-0b8b-456d-bbca-75e10d356fca None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:55.343472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438a384-0b8b-456d-bbca-75e10d356fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.361694 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1011/2066] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:54 2022] DELETE /identity/v3/users/0392ec167ed04ece91d9cbfc58467a13 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:55.362697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec76a5f-93d2-4414-ad69-6be5b6ef1ffd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:55.376116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b438a384-0b8b-456d-bbca-75e10d356fca None None] MFA Rules not processed for user `224e9cd7bcde4ae19395c13ec7b12286`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:55.377631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b438a384-0b8b-456d-bbca-75e10d356fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:55.446624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec76a5f-93d2-4414-ad69-6be5b6ef1ffd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:55.452025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7f7a1-d6fc-4a84-8c4f-97cd3ec84506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:55.452721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7f7a1-d6fc-4a84-8c4f-97cd3ec84506 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:55.459687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7f7a1-d6fc-4a84-8c4f-97cd3ec84506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:55.459687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7f7a1-d6fc-4a84-8c4f-97cd3ec84506 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.459687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7f7a1-d6fc-4a84-8c4f-97cd3ec84506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:55.459687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7f7a1-d6fc-4a84-8c4f-97cd3ec84506 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:55.460073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1056/2067] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:55.460073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e24767-c9e0-46df-9b85-4d96de29a5a9 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:55.460073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e24767-c9e0-46df-9b85-4d96de29a5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:55.460073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e24767-c9e0-46df-9b85-4d96de29a5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.480059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-05e24767-c9e0-46df-9b85-4d96de29a5a9 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:55.481277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-05e24767-c9e0-46df-9b85-4d96de29a5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:55.498615 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1057/2068] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:55.501740 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e24767-c9e0-46df-9b85-4d96de29a5a9 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:55.501740 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-05e24767-c9e0-46df-9b85-4d96de29a5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:55.574240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e24767-c9e0-46df-9b85-4d96de29a5a9 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:55.578385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee434cf6-1a51-45c6-833a-af712ae22beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:55.579273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee434cf6-1a51-45c6-833a-af712ae22beb service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:55.579657 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee434cf6-1a51-45c6-833a-af712ae22beb service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:55.580071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee434cf6-1a51-45c6-833a-af712ae22beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.591652 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee434cf6-1a51-45c6-833a-af712ae22beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:55.592625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1012/2069] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:55 2022] POST /identity/v3/projects => generated 363 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:55.593818 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7f7a1-d6fc-4a84-8c4f-97cd3ec84506 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:55.596161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee434cf6-1a51-45c6-833a-af712ae22beb service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:55.597263 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-02c7f7a1-d6fc-4a84-8c4f-97cd3ec84506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:55.608576 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1058/2070] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:55.610045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee434cf6-1a51-45c6-833a-af712ae22beb service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:55.627375 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee434cf6-1a51-45c6-833a-af712ae22beb service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:55.705845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4274b-c28e-4d61-87ff-d218a481decf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:55.706445 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4274b-c28e-4d61-87ff-d218a481decf admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:55.706731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4274b-c28e-4d61-87ff-d218a481decf admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:55.707008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4274b-c28e-4d61-87ff-d218a481decf admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.707761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4274b-c28e-4d61-87ff-d218a481decf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:55.711067 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4274b-c28e-4d61-87ff-d218a481decf admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:55.757843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7f7a1-d6fc-4a84-8c4f-97cd3ec84506 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:55.770407 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fabf1-44af-4816-9873-4292e83a0657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:55.771491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fabf1-44af-4816-9873-4292e83a0657 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:55.771777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fabf1-44af-4816-9873-4292e83a0657 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:55.772145 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fabf1-44af-4816-9873-4292e83a0657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.785049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fabf1-44af-4816-9873-4292e83a0657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:55.786958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fabf1-44af-4816-9873-4292e83a0657 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:55.798814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1013/2071] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:55.825583 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1059/2072] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:55 2022] POST /identity/v3/users => generated 282 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:55.826893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fabf1-44af-4816-9873-4292e83a0657 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:55.841020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fabf1-44af-4816-9873-4292e83a0657 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:55.852734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8674cf-d9ad-4022-8d7e-f75356b6e3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:55.855200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8674cf-d9ad-4022-8d7e-f75356b6e3fb admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:55.857472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8674cf-d9ad-4022-8d7e-f75356b6e3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:55.857472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8674cf-d9ad-4022-8d7e-f75356b6e3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.863101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8674cf-d9ad-4022-8d7e-f75356b6e3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:55.863101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8674cf-d9ad-4022-8d7e-f75356b6e3fb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:55.883949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1014/2073] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:55.885949 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4274b-c28e-4d61-87ff-d218a481decf admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:55.899800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4274b-c28e-4d61-87ff-d218a481decf admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:55.915426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9588798-98d6-4593-b8ca-e2733ed51700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:55.916121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9588798-98d6-4593-b8ca-e2733ed51700 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:55.916460 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9588798-98d6-4593-b8ca-e2733ed51700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:55.917342 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9588798-98d6-4593-b8ca-e2733ed51700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.917660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9588798-98d6-4593-b8ca-e2733ed51700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:55.921430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9588798-98d6-4593-b8ca-e2733ed51700 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:55.939380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1060/2074] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:55.940443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8674cf-d9ad-4022-8d7e-f75356b6e3fb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:55.954553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8674cf-d9ad-4022-8d7e-f75356b6e3fb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:55.962847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4fa71-9489-42c6-a600-d5e639713214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:55.964258 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4fa71-9489-42c6-a600-d5e639713214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:55.964753 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4fa71-9489-42c6-a600-d5e639713214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:55.965208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4fa71-9489-42c6-a600-d5e639713214 admin admin] PATH_INFO: `/v3/projects/191bc87fc7b842068a0ce3331b9934e4/users/53f30aba23c741079da8a8c224d39256/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:55.985060 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4fa71-9489-42c6-a600-d5e639713214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=191bc87fc7b842068a0ce3331b9934e4, user_id=53f30aba23c741079da8a8c224d39256, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:55.988696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4fa71-9489-42c6-a600-d5e639713214 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:56.149762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1015/2075] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:55 2022] PUT /identity/v3/projects/191bc87fc7b842068a0ce3331b9934e4/users/53f30aba23c741079da8a8c224d39256/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:56.161240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844875ac-c628-44d4-af9f-2fda731420df None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:56.161755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844875ac-c628-44d4-af9f-2fda731420df None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:56.161830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844875ac-c628-44d4-af9f-2fda731420df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:56.230991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-844875ac-c628-44d4-af9f-2fda731420df None None] MFA Rules not processed for user `53f30aba23c741079da8a8c224d39256`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:56.234568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-844875ac-c628-44d4-af9f-2fda731420df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:56.364983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1061/2076] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:56.370695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4fa71-9489-42c6-a600-d5e639713214 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:56.443554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4fa71-9489-42c6-a600-d5e639713214 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:56.457554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844875ac-c628-44d4-af9f-2fda731420df None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:56.461701 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-844875ac-c628-44d4-af9f-2fda731420df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:56.468112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2a3b8-6786-4b0d-808f-dc26d80c70e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:56.469282 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2a3b8-6786-4b0d-808f-dc26d80c70e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:56.469788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2a3b8-6786-4b0d-808f-dc26d80c70e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:56.470323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2a3b8-6786-4b0d-808f-dc26d80c70e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:56.471569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2a3b8-6786-4b0d-808f-dc26d80c70e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:56.475782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2a3b8-6786-4b0d-808f-dc26d80c70e0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:56.519116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844875ac-c628-44d4-af9f-2fda731420df None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:56.527154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:56.528693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:56.529099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:56.529576 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] PATH_INFO: `/v3/projects/28e97a14d27746e1b375aab136543705` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:56.531507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e97a14d27746e1b375aab136543705)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:56.533596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:56.632623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1016/2077] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:56 2022] POST /identity/v3/projects => generated 363 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:56.634500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2a3b8-6786-4b0d-808f-dc26d80c70e0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:56.676439 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e97a14d27746e1b375aab136543705', 'request_id': 'req-0e632c68-dd1b-4105-858f-85b441bc3944'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:56.686186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e97a14d27746e1b375aab136543705', 'request_id': 'req-0e632c68-dd1b-4105-858f-85b441bc3944'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:56.728096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2a3b8-6786-4b0d-808f-dc26d80c70e0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:56.785183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ec5b6-214c-4bbe-88f6-5a3d5f9ce55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:56.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ec5b6-214c-4bbe-88f6-5a3d5f9ce55c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:56.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ec5b6-214c-4bbe-88f6-5a3d5f9ce55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:56.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ec5b6-214c-4bbe-88f6-5a3d5f9ce55c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:56.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ec5b6-214c-4bbe-88f6-5a3d5f9ce55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:56.793970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ec5b6-214c-4bbe-88f6-5a3d5f9ce55c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:56.829154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e97a14d27746e1b375aab136543705', 'request_id': 'req-0e632c68-dd1b-4105-858f-85b441bc3944'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:56.843714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] The token cache is being invalidate because project 28e97a14d27746e1b375aab136543705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:56.844079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:56.844853 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:56.847864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1062/2078] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:56 2022] DELETE /identity/v3/projects/28e97a14d27746e1b375aab136543705 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:56.854989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:56.863923 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:56.876923 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e632c68-dd1b-4105-858f-85b441bc3944 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:56.881583 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:56.882454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:56.882738 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:56.883017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] PATH_INFO: `/v3/users/d267657332194b5393e066ad4bc7f759` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:56.884241 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d267657332194b5393e066ad4bc7f759)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:56.886152 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:57.029654 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1017/2079] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:56 2022] POST /identity/v3/users => generated 288 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:57.036036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ec5b6-214c-4bbe-88f6-5a3d5f9ce55c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:57.039660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ea1ec5b6-214c-4bbe-88f6-5a3d5f9ce55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:57.056192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ec5b6-214c-4bbe-88f6-5a3d5f9ce55c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:57.061365 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0955c-72d6-4a27-914e-2d862a169eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:57.062042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0955c-72d6-4a27-914e-2d862a169eac admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:57.062492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0955c-72d6-4a27-914e-2d862a169eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:57.062784 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0955c-72d6-4a27-914e-2d862a169eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.063711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0955c-72d6-4a27-914e-2d862a169eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:57.067926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0955c-72d6-4a27-914e-2d862a169eac admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:57.082147 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1018/2080] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:57.083455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0955c-72d6-4a27-914e-2d862a169eac admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:57.112971 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0955c-72d6-4a27-914e-2d862a169eac admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:57.122771 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804520d-526a-4c03-bd05-f0d45c949a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:57.123847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804520d-526a-4c03-bd05-f0d45c949a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:57.124425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804520d-526a-4c03-bd05-f0d45c949a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:57.124951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804520d-526a-4c03-bd05-f0d45c949a0b admin admin] PATH_INFO: `/v3/projects/1800cea007974af7a1f7004bafa80644/users/17414b5c70664e1e9aa4c5d026317fce/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.149057 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804520d-526a-4c03-bd05-f0d45c949a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1800cea007974af7a1f7004bafa80644, user_id=17414b5c70664e1e9aa4c5d026317fce, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:57.149981 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd267657332194b5393e066ad4bc7f759'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:57.152058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804520d-526a-4c03-bd05-f0d45c949a0b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:57.163406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd267657332194b5393e066ad4bc7f759'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:57.231416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1019/2081] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:57 2022] PUT /identity/v3/projects/1800cea007974af7a1f7004bafa80644/users/17414b5c70664e1e9aa4c5d026317fce/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:57.235309 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804520d-526a-4c03-bd05-f0d45c949a0b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:57.254975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd267657332194b5393e066ad4bc7f759'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:57.255614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd267657332194b5393e066ad4bc7f759'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:57.279289 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd267657332194b5393e066ad4bc7f759'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:57.293209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1063/2082] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:33:56 2022] DELETE /identity/v3/users/d267657332194b5393e066ad4bc7f759 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:57.332281 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804520d-526a-4c03-bd05-f0d45c949a0b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:57.401409 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde3fe8-e0dc-4af5-97f2-ef939f6c410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:57.402190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde3fe8-e0dc-4af5-97f2-ef939f6c410c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:57.402506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde3fe8-e0dc-4af5-97f2-ef939f6c410c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:57.403370 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde3fe8-e0dc-4af5-97f2-ef939f6c410c admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.403720 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde3fe8-e0dc-4af5-97f2-ef939f6c410c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:57.405459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde3fe8-e0dc-4af5-97f2-ef939f6c410c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:57.419854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1020/2083] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:33:57.421117 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:57.422668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:57.437791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ec1f9-eab2-4158-bad9-6b7a27b02aae admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:57.442643 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f68c3-aecc-4724-8a53-8b32a0a6d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:57.443548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f68c3-aecc-4724-8a53-8b32a0a6d460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:57.443860 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f68c3-aecc-4724-8a53-8b32a0a6d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:57.444877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f68c3-aecc-4724-8a53-8b32a0a6d460 admin admin] PATH_INFO: `/v3/projects/1800cea007974af7a1f7004bafa80644/users/17414b5c70664e1e9aa4c5d026317fce/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.447040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f68c3-aecc-4724-8a53-8b32a0a6d460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1800cea007974af7a1f7004bafa80644, user_id=17414b5c70664e1e9aa4c5d026317fce, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:57.449688 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f68c3-aecc-4724-8a53-8b32a0a6d460 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:57.462020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1064/2084] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:57 2022] PUT /identity/v3/projects/1800cea007974af7a1f7004bafa80644/users/17414b5c70664e1e9aa4c5d026317fce/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:57.472703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad89b0-c929-46a9-bab7-7d5634a28c59 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:57.472995 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad89b0-c929-46a9-bab7-7d5634a28c59 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:57.473280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad89b0-c929-46a9-bab7-7d5634a28c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.503803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f1ad89b0-c929-46a9-bab7-7d5634a28c59 None None] MFA Rules not processed for user `17414b5c70664e1e9aa4c5d026317fce`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:57.504864 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f1ad89b0-c929-46a9-bab7-7d5634a28c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:57.602496 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1021/2085] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:57 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:57.614201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f68c3-aecc-4724-8a53-8b32a0a6d460 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:57.617177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-301f68c3-aecc-4724-8a53-8b32a0a6d460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:57.685395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f68c3-aecc-4724-8a53-8b32a0a6d460 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:57.689921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b7195-eb45-46ab-af9c-a32cb0215d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:57.690530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b7195-eb45-46ab-af9c-a32cb0215d3b service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:57.690919 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b7195-eb45-46ab-af9c-a32cb0215d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:57.691113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b7195-eb45-46ab-af9c-a32cb0215d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.702812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b7195-eb45-46ab-af9c-a32cb0215d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:57.704245 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b7195-eb45-46ab-af9c-a32cb0215d3b service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:57.715847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1065/2086] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:57 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:57.941143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad89b0-c929-46a9-bab7-7d5634a28c59 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:57.944449 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b7195-eb45-46ab-af9c-a32cb0215d3b service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:57.948568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-174b7195-eb45-46ab-af9c-a32cb0215d3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:57.951805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad89b0-c929-46a9-bab7-7d5634a28c59 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:57.955404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86c18c-88be-4f50-87c6-993398a32a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:57.956383 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86c18c-88be-4f50-87c6-993398a32a2e service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:57.956503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86c18c-88be-4f50-87c6-993398a32a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:57.956759 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86c18c-88be-4f50-87c6-993398a32a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:57.958568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ff86c18c-88be-4f50-87c6-993398a32a2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:58.073952 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b7195-eb45-46ab-af9c-a32cb0215d3b service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:58.075188 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86c18c-88be-4f50-87c6-993398a32a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:58.079512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86c18c-88be-4f50-87c6-993398a32a2e service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:58.081559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442c16f-7b72-47c0-91db-adad4d58489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:58.082615 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442c16f-7b72-47c0-91db-adad4d58489c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:58.082965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442c16f-7b72-47c0-91db-adad4d58489c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:58.083355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442c16f-7b72-47c0-91db-adad4d58489c admin admin] PATH_INFO: `/v3/projects/f735e8ba753241a5be9dec732176b134` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:58.085383 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442c16f-7b72-47c0-91db-adad4d58489c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f735e8ba753241a5be9dec732176b134)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:58.087844 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442c16f-7b72-47c0-91db-adad4d58489c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:58.137815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1022/2087] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:57 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:58.213421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3442c16f-7b72-47c0-91db-adad4d58489c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f735e8ba753241a5be9dec732176b134', 'request_id': 'req-3442c16f-7b72-47c0-91db-adad4d58489c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:58.220892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3442c16f-7b72-47c0-91db-adad4d58489c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f735e8ba753241a5be9dec732176b134', 'request_id': 'req-3442c16f-7b72-47c0-91db-adad4d58489c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:58.344114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3442c16f-7b72-47c0-91db-adad4d58489c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f735e8ba753241a5be9dec732176b134', 'request_id': 'req-3442c16f-7b72-47c0-91db-adad4d58489c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:58.361998 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3442c16f-7b72-47c0-91db-adad4d58489c admin admin] The token cache is being invalidate because project f735e8ba753241a5be9dec732176b134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:33:58.362457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3442c16f-7b72-47c0-91db-adad4d58489c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:58.364995 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3442c16f-7b72-47c0-91db-adad4d58489c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:33:58.368451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1066/2088] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:33:57 2022] DELETE /identity/v3/projects/f735e8ba753241a5be9dec732176b134 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:33:58.380367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877c968-20fd-497c-9531-3008ecffa3d6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:58.380367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877c968-20fd-497c-9531-3008ecffa3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:58.380367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877c968-20fd-497c-9531-3008ecffa3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:58.409496 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2877c968-20fd-497c-9531-3008ecffa3d6 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:58.414688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2877c968-20fd-497c-9531-3008ecffa3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:58.525271 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1023/2089] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:58.529042 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87f510-aa03-4c1a-94a2-bc3864d5ada3 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:58.529513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87f510-aa03-4c1a-94a2-bc3864d5ada3 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:58.530011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87f510-aa03-4c1a-94a2-bc3864d5ada3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:58.559999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ee87f510-aa03-4c1a-94a2-bc3864d5ada3 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:58.561552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ee87f510-aa03-4c1a-94a2-bc3864d5ada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:58.577123 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1067/2090] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:58.582700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877c968-20fd-497c-9531-3008ecffa3d6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:58.596602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877c968-20fd-497c-9531-3008ecffa3d6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:58.616510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f299f33-cdfa-4454-9100-77ab9ad85b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:58.617968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f299f33-cdfa-4454-9100-77ab9ad85b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:58.618422 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f299f33-cdfa-4454-9100-77ab9ad85b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:58.618979 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f299f33-cdfa-4454-9100-77ab9ad85b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:58.619616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f299f33-cdfa-4454-9100-77ab9ad85b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:33:58.620004 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f299f33-cdfa-4454-9100-77ab9ad85b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:58.621723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f299f33-cdfa-4454-9100-77ab9ad85b74 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:58.639489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1024/2091] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:33:58.643646 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87f510-aa03-4c1a-94a2-bc3864d5ada3 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:58.655821 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87f510-aa03-4c1a-94a2-bc3864d5ada3 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:58.662735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff9e59-5e6a-43b8-a6ed-d43373c9caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:58.663650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff9e59-5e6a-43b8-a6ed-d43373c9caae admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:58.664033 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff9e59-5e6a-43b8-a6ed-d43373c9caae admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:58.664198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff9e59-5e6a-43b8-a6ed-d43373c9caae admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:58.665673 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff9e59-5e6a-43b8-a6ed-d43373c9caae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:58.667389 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff9e59-5e6a-43b8-a6ed-d43373c9caae admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:58.823733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1068/2092] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:33:58 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:58.823856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f299f33-cdfa-4454-9100-77ab9ad85b74 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:58.836877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f299f33-cdfa-4454-9100-77ab9ad85b74 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:58.921427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949f889-4c6b-4cab-8e74-22e5ca30845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:58.922116 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f889-4c6b-4cab-8e74-22e5ca30845a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:58.922463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f889-4c6b-4cab-8e74-22e5ca30845a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:58.922754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f889-4c6b-4cab-8e74-22e5ca30845a admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:58.926722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949f889-4c6b-4cab-8e74-22e5ca30845a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:58.929860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949f889-4c6b-4cab-8e74-22e5ca30845a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:59.027949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1025/2093] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:33:58 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:33:59.032132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff9e59-5e6a-43b8-a6ed-d43373c9caae admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:59.043314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff9e59-5e6a-43b8-a6ed-d43373c9caae admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:59.048022 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4224d-df81-4b48-9da9-69876eb71ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:59.048706 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4224d-df81-4b48-9da9-69876eb71ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:59.048989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4224d-df81-4b48-9da9-69876eb71ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:59.049268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4224d-df81-4b48-9da9-69876eb71ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:59.050005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4224d-df81-4b48-9da9-69876eb71ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:59.051911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4224d-df81-4b48-9da9-69876eb71ad0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:59.064639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1069/2094] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:59.068677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949f889-4c6b-4cab-8e74-22e5ca30845a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:59.084083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949f889-4c6b-4cab-8e74-22e5ca30845a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:59.089168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963458f6-f549-4d16-88c2-f245942c79a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:59.089848 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963458f6-f549-4d16-88c2-f245942c79a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:59.090135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963458f6-f549-4d16-88c2-f245942c79a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:59.090474 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963458f6-f549-4d16-88c2-f245942c79a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:59.091199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963458f6-f549-4d16-88c2-f245942c79a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:59.092791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963458f6-f549-4d16-88c2-f245942c79a6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:59.110054 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1026/2095] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:33:59.114634 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4224d-df81-4b48-9da9-69876eb71ad0 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:59.129181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4224d-df81-4b48-9da9-69876eb71ad0 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:59.132679 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dbd2e-cf39-4a42-a002-d9ab277702f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:59.134048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dbd2e-cf39-4a42-a002-d9ab277702f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:59.134366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dbd2e-cf39-4a42-a002-d9ab277702f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:59.134646 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dbd2e-cf39-4a42-a002-d9ab277702f5 admin admin] PATH_INFO: `/v3/projects/616b8963b4704bd687e27d009235e8fc/users/0c25a08e2ecd4657bab128aca6cb6ae8/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:59.157748 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dbd2e-cf39-4a42-a002-d9ab277702f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=616b8963b4704bd687e27d009235e8fc, user_id=0c25a08e2ecd4657bab128aca6cb6ae8, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:59.158007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dbd2e-cf39-4a42-a002-d9ab277702f5 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:59.251126 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1070/2096] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:33:59 2022] PUT /identity/v3/projects/616b8963b4704bd687e27d009235e8fc/users/0c25a08e2ecd4657bab128aca6cb6ae8/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:33:59.263683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227391e0-b38f-4f33-b93b-3f1f66dafaa9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:59.264259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227391e0-b38f-4f33-b93b-3f1f66dafaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:59.264711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227391e0-b38f-4f33-b93b-3f1f66dafaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:59.294232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-227391e0-b38f-4f33-b93b-3f1f66dafaa9 None None] MFA Rules not processed for user `0c25a08e2ecd4657bab128aca6cb6ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:59.295639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-227391e0-b38f-4f33-b93b-3f1f66dafaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:59.382993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1027/2097] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:59.396230 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dbd2e-cf39-4a42-a002-d9ab277702f5 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:59.402144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-466dbd2e-cf39-4a42-a002-d9ab277702f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:59.471924 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dbd2e-cf39-4a42-a002-d9ab277702f5 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:59.477720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f39bef-16a3-45b2-b2dc-ed39f8c4f078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:59.478511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f39bef-16a3-45b2-b2dc-ed39f8c4f078 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:59.478859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f39bef-16a3-45b2-b2dc-ed39f8c4f078 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:59.479345 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f39bef-16a3-45b2-b2dc-ed39f8c4f078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:59.490111 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f39bef-16a3-45b2-b2dc-ed39f8c4f078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:59.493508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f39bef-16a3-45b2-b2dc-ed39f8c4f078 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:59.505973 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1071/2098] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:59.681516 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252c359-1dec-4b91-8c40-6c5e046bc752 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:59.682020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252c359-1dec-4b91-8c40-6c5e046bc752 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:59.682323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252c359-1dec-4b91-8c40-6c5e046bc752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:59.710183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9252c359-1dec-4b91-8c40-6c5e046bc752 None None] MFA Rules not processed for user `d03ba17f93a34c77a027c03a0a800aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:59.711657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9252c359-1dec-4b91-8c40-6c5e046bc752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:59.775283 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1028/2099] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:59.785953 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f97fb-4875-40f1-9276-32cda4f4f7fe None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:59.786248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f97fb-4875-40f1-9276-32cda4f4f7fe None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:59.786560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f97fb-4875-40f1-9276-32cda4f4f7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:59.805408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-bf2f97fb-4875-40f1-9276-32cda4f4f7fe None None] MFA Rules not processed for user `d03ba17f93a34c77a027c03a0a800aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:59.806774 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-bf2f97fb-4875-40f1-9276-32cda4f4f7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:59.814515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1072/2100] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:33:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:59.825357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252c359-1dec-4b91-8c40-6c5e046bc752 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:59.826839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9252c359-1dec-4b91-8c40-6c5e046bc752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:59.899599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252c359-1dec-4b91-8c40-6c5e046bc752 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:59.905182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5d7a4-dc47-4a2a-b906-cf753d1bb70c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:59.905896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d7a4-dc47-4a2a-b906-cf753d1bb70c service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:59.906174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d7a4-dc47-4a2a-b906-cf753d1bb70c service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:59.906508 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d7a4-dc47-4a2a-b906-cf753d1bb70c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:59.915138 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5d7a4-dc47-4a2a-b906-cf753d1bb70c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:59.916709 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5d7a4-dc47-4a2a-b906-cf753d1bb70c service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:59.925395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1029/2101] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:33:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:00.836500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c379a5-9e72-4e04-acdc-43ff5cab2a11 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:00.837297 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c379a5-9e72-4e04-acdc-43ff5cab2a11 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:00.837747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c379a5-9e72-4e04-acdc-43ff5cab2a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:00.860209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-94c379a5-9e72-4e04-acdc-43ff5cab2a11 None None] MFA Rules not processed for user `d03ba17f93a34c77a027c03a0a800aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:00.861803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-94c379a5-9e72-4e04-acdc-43ff5cab2a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:00.869396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1073/2102] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:02.569427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c761f66-ef2c-4b8e-8a13-143306e4507b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:02.569427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c761f66-ef2c-4b8e-8a13-143306e4507b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:02.569427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c761f66-ef2c-4b8e-8a13-143306e4507b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:02.582385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3c761f66-ef2c-4b8e-8a13-143306e4507b None None] MFA Rules not processed for user `9af6f43e494f485196d6ba2245bceed3`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:02.583619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3c761f66-ef2c-4b8e-8a13-143306e4507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:02.646359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1030/2103] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:23.108504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c379a5-9e72-4e04-acdc-43ff5cab2a11 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:23.171768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c379a5-9e72-4e04-acdc-43ff5cab2a11 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:23.176381 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:23.177521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:23.177806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:23.178087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] PATH_INFO: `/v3/users/0c25a08e2ecd4657bab128aca6cb6ae8` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:23.179340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c25a08e2ecd4657bab128aca6cb6ae8)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:23.181268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:23.579661 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c25a08e2ecd4657bab128aca6cb6ae8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:23.587125 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c25a08e2ecd4657bab128aca6cb6ae8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:23.663731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c25a08e2ecd4657bab128aca6cb6ae8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:23.664739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c25a08e2ecd4657bab128aca6cb6ae8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:23.686544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c25a08e2ecd4657bab128aca6cb6ae8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:23.693334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1074/2104] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:34:23 2022] DELETE /identity/v3/users/0c25a08e2ecd4657bab128aca6cb6ae8 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:23.698529 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718492f-c610-44b1-a611-21cf77e8980a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:23.699703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718492f-c610-44b1-a611-21cf77e8980a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:23.700330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718492f-c610-44b1-a611-21cf77e8980a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:23.720259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e718492f-c610-44b1-a611-21cf77e8980a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:23.722315 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e718492f-c610-44b1-a611-21cf77e8980a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:23.795557 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1031/2105] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:34:23.806350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:23.808429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:23.867675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af536ef2-6468-4f61-bd9e-879ac3bc3fb3 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:23.871278 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc2e16-430f-4b0d-96f0-3ab62b846d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:23.871929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc2e16-430f-4b0d-96f0-3ab62b846d3a service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:23.872209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc2e16-430f-4b0d-96f0-3ab62b846d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:23.872484 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc2e16-430f-4b0d-96f0-3ab62b846d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:23.881617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc2e16-430f-4b0d-96f0-3ab62b846d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:23.883451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc2e16-430f-4b0d-96f0-3ab62b846d3a service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:23.893218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1075/2106] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:24.295652 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718492f-c610-44b1-a611-21cf77e8980a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:24.297967 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e718492f-c610-44b1-a611-21cf77e8980a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:24.317619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718492f-c610-44b1-a611-21cf77e8980a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:24.324077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ee999-172f-4464-b743-e98bfd7bcf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:24.325283 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ee999-172f-4464-b743-e98bfd7bcf51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:24.325565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ee999-172f-4464-b743-e98bfd7bcf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:24.326179 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ee999-172f-4464-b743-e98bfd7bcf51 admin admin] PATH_INFO: `/v3/projects/616b8963b4704bd687e27d009235e8fc` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:24.327827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ee999-172f-4464-b743-e98bfd7bcf51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=616b8963b4704bd687e27d009235e8fc)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:24.329814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ee999-172f-4464-b743-e98bfd7bcf51 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:24.507180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8c3ee999-172f-4464-b743-e98bfd7bcf51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616b8963b4704bd687e27d009235e8fc', 'request_id': 'req-8c3ee999-172f-4464-b743-e98bfd7bcf51'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:24.513406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8c3ee999-172f-4464-b743-e98bfd7bcf51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616b8963b4704bd687e27d009235e8fc', 'request_id': 'req-8c3ee999-172f-4464-b743-e98bfd7bcf51'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:24.575449 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8c3ee999-172f-4464-b743-e98bfd7bcf51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616b8963b4704bd687e27d009235e8fc', 'request_id': 'req-8c3ee999-172f-4464-b743-e98bfd7bcf51'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:24.587722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8c3ee999-172f-4464-b743-e98bfd7bcf51 admin admin] The token cache is being invalidate because project 616b8963b4704bd687e27d009235e8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:34:24.587963 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8c3ee999-172f-4464-b743-e98bfd7bcf51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:24.588744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8c3ee999-172f-4464-b743-e98bfd7bcf51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:24.590771 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1032/2107] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:34:24 2022] DELETE /identity/v3/projects/616b8963b4704bd687e27d009235e8fc => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:34:24.595843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c9740-e40b-4f5d-9fae-9608a2c05558 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:24.596326 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c9740-e40b-4f5d-9fae-9608a2c05558 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:24.596454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c9740-e40b-4f5d-9fae-9608a2c05558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:24.617816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-652c9740-e40b-4f5d-9fae-9608a2c05558 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:24.619384 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-652c9740-e40b-4f5d-9fae-9608a2c05558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:24.688461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1076/2108] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:24.697441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82dd6a-3930-41df-9f8c-d77e6ea30189 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:24.697741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82dd6a-3930-41df-9f8c-d77e6ea30189 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:24.698031 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82dd6a-3930-41df-9f8c-d77e6ea30189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:24.721296 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2e82dd6a-3930-41df-9f8c-d77e6ea30189 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:24.723094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2e82dd6a-3930-41df-9f8c-d77e6ea30189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:24.733714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c9740-e40b-4f5d-9fae-9608a2c05558 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:24.734958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1033/2109] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:34:24.735786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-652c9740-e40b-4f5d-9fae-9608a2c05558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:24.739215 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82dd6a-3930-41df-9f8c-d77e6ea30189 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:24.751082 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82dd6a-3930-41df-9f8c-d77e6ea30189 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:24.758708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c9740-e40b-4f5d-9fae-9608a2c05558 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:24.760020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8caa14e-618a-4d98-a24f-d735b47de8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:24.760319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caa14e-618a-4d98-a24f-d735b47de8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:24.761049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caa14e-618a-4d98-a24f-d735b47de8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:24.761049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caa14e-618a-4d98-a24f-d735b47de8d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:24.761585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8caa14e-618a-4d98-a24f-d735b47de8d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:34:24.761896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8caa14e-618a-4d98-a24f-d735b47de8d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:24.763552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8caa14e-618a-4d98-a24f-d735b47de8d4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:24.768034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680e5ea-5d8c-4402-b65c-13f733a1ee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:24.768968 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680e5ea-5d8c-4402-b65c-13f733a1ee5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:24.769257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680e5ea-5d8c-4402-b65c-13f733a1ee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:24.769535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680e5ea-5d8c-4402-b65c-13f733a1ee5f admin admin] PATH_INFO: `/v3/users/224e9cd7bcde4ae19395c13ec7b12286` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:24.771058 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680e5ea-5d8c-4402-b65c-13f733a1ee5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=224e9cd7bcde4ae19395c13ec7b12286)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:24.774213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680e5ea-5d8c-4402-b65c-13f733a1ee5f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:24.777598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1034/2110] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:34:24.781911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8caa14e-618a-4d98-a24f-d735b47de8d4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:24.792343 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8caa14e-618a-4d98-a24f-d735b47de8d4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:24.797124 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851caa5-cd7e-4daf-8cc0-9d1f70c8a6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:24.797952 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851caa5-cd7e-4daf-8cc0-9d1f70c8a6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:24.797952 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851caa5-cd7e-4daf-8cc0-9d1f70c8a6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:24.798244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851caa5-cd7e-4daf-8cc0-9d1f70c8a6a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:24.798963 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851caa5-cd7e-4daf-8cc0-9d1f70c8a6a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:24.801532 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851caa5-cd7e-4daf-8cc0-9d1f70c8a6a0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:24.940129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1035/2111] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:34:24 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:34:24.945635 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851caa5-cd7e-4daf-8cc0-9d1f70c8a6a0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:25.021944 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851caa5-cd7e-4daf-8cc0-9d1f70c8a6a0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:25.022197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405b8b0-8122-4569-a392-0920c5c07ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:25.023544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405b8b0-8122-4569-a392-0920c5c07ece admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:25.023830 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405b8b0-8122-4569-a392-0920c5c07ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:25.024116 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405b8b0-8122-4569-a392-0920c5c07ece admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:25.024804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405b8b0-8122-4569-a392-0920c5c07ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:25.026755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405b8b0-8122-4569-a392-0920c5c07ece admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:25.033179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3680e5ea-5d8c-4402-b65c-13f733a1ee5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224e9cd7bcde4ae19395c13ec7b12286'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:25.041265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3680e5ea-5d8c-4402-b65c-13f733a1ee5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224e9cd7bcde4ae19395c13ec7b12286'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:25.134971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3680e5ea-5d8c-4402-b65c-13f733a1ee5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224e9cd7bcde4ae19395c13ec7b12286'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:25.135683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3680e5ea-5d8c-4402-b65c-13f733a1ee5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224e9cd7bcde4ae19395c13ec7b12286'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:25.144461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1036/2112] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:34:24 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:25.145505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405b8b0-8122-4569-a392-0920c5c07ece admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:25.147143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1405b8b0-8122-4569-a392-0920c5c07ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:25.149337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3680e5ea-5d8c-4402-b65c-13f733a1ee5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224e9cd7bcde4ae19395c13ec7b12286'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:25.155703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1077/2113] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:34:24 2022] DELETE /identity/v3/users/224e9cd7bcde4ae19395c13ec7b12286 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:34:25.159807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec530-7417-4b37-af8e-a044a5d3451f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:25.159952 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405b8b0-8122-4569-a392-0920c5c07ece admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:25.165588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec530-7417-4b37-af8e-a044a5d3451f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:25.165588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec530-7417-4b37-af8e-a044a5d3451f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:25.178151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-926ec530-7417-4b37-af8e-a044a5d3451f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:25.180024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-926ec530-7417-4b37-af8e-a044a5d3451f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:25.222265 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30919c5-f83d-4778-bff4-bae4bf712a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:25.222679 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30919c5-f83d-4778-bff4-bae4bf712a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:25.222987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30919c5-f83d-4778-bff4-bae4bf712a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:25.223266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30919c5-f83d-4778-bff4-bae4bf712a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:25.224247 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30919c5-f83d-4778-bff4-bae4bf712a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:25.225627 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30919c5-f83d-4778-bff4-bae4bf712a00 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:25.237320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1037/2114] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:34:25.241366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30919c5-f83d-4778-bff4-bae4bf712a00 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:25.254165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1078/2115] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:34:25.254439 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30919c5-f83d-4778-bff4-bae4bf712a00 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:25.263545 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ec530-7417-4b37-af8e-a044a5d3451f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:25.265676 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-926ec530-7417-4b37-af8e-a044a5d3451f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:25.270444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb706c02-b1c0-4764-9c83-3a04609ce4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:25.271637 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb706c02-b1c0-4764-9c83-3a04609ce4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:25.274380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb706c02-b1c0-4764-9c83-3a04609ce4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:25.274380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb706c02-b1c0-4764-9c83-3a04609ce4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:25.275769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb706c02-b1c0-4764-9c83-3a04609ce4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:25.279814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb706c02-b1c0-4764-9c83-3a04609ce4c5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:25.297793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1038/2116] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:25.303355 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb706c02-b1c0-4764-9c83-3a04609ce4c5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:25.317408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb706c02-b1c0-4764-9c83-3a04609ce4c5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:25.335917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ec530-7417-4b37-af8e-a044a5d3451f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:25.339948 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac81beb-72a9-4af8-ba39-4ef2572cbd46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:25.340822 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac81beb-72a9-4af8-ba39-4ef2572cbd46 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:25.341123 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac81beb-72a9-4af8-ba39-4ef2572cbd46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:25.341387 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac81beb-72a9-4af8-ba39-4ef2572cbd46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:25.344260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ea81-31db-4344-931f-98750e879cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:25.347257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ea81-31db-4344-931f-98750e879cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:25.347257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ea81-31db-4344-931f-98750e879cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:25.347257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ea81-31db-4344-931f-98750e879cd0 admin admin] PATH_INFO: `/v3/projects/032afd73aa714944b269a63a6018b247/users/1aa74f42c9b346ec943b21feaaa572b9/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:25.356486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac81beb-72a9-4af8-ba39-4ef2572cbd46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:25.358739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac81beb-72a9-4af8-ba39-4ef2572cbd46 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:25.374577 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1079/2117] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:25.382026 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075ea81-31db-4344-931f-98750e879cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032afd73aa714944b269a63a6018b247, user_id=1aa74f42c9b346ec943b21feaaa572b9, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:25.384941 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075ea81-31db-4344-931f-98750e879cd0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:25.541670 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1039/2118] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:34:25 2022] PUT /identity/v3/projects/032afd73aa714944b269a63a6018b247/users/1aa74f42c9b346ec943b21feaaa572b9/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:25.551304 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c96ae-e57a-484d-90c8-251ed6e64275 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:25.551595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c96ae-e57a-484d-90c8-251ed6e64275 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:25.552129 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c96ae-e57a-484d-90c8-251ed6e64275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:25.578910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ac7c96ae-e57a-484d-90c8-251ed6e64275 None None] MFA Rules not processed for user `1aa74f42c9b346ec943b21feaaa572b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:25.580121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ac7c96ae-e57a-484d-90c8-251ed6e64275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:25.644606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1080/2119] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:25.658588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ea81-31db-4344-931f-98750e879cd0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:25.660859 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3075ea81-31db-4344-931f-98750e879cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:25.738364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ea81-31db-4344-931f-98750e879cd0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:25.742819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61c3fe-458b-415c-bd9d-478ebf83271d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:25.743513 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61c3fe-458b-415c-bd9d-478ebf83271d service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:25.743796 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61c3fe-458b-415c-bd9d-478ebf83271d service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:25.744074 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61c3fe-458b-415c-bd9d-478ebf83271d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:25.755932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61c3fe-458b-415c-bd9d-478ebf83271d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:25.755932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61c3fe-458b-415c-bd9d-478ebf83271d service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:25.764680 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1040/2120] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:34:25.886636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c96ae-e57a-484d-90c8-251ed6e64275 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:25.888311 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ac7c96ae-e57a-484d-90c8-251ed6e64275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:25.957875 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c96ae-e57a-484d-90c8-251ed6e64275 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:25.963018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcf011-1586-4654-b28b-d092ad87d5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:25.964037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcf011-1586-4654-b28b-d092ad87d5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:25.964325 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcf011-1586-4654-b28b-d092ad87d5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:25.964603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcf011-1586-4654-b28b-d092ad87d5eb admin admin] PATH_INFO: `/v3/projects/59b27a36eee54240bfc3c54081be785c` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:25.965842 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcf011-1586-4654-b28b-d092ad87d5eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b27a36eee54240bfc3c54081be785c)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:25.967781 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcf011-1586-4654-b28b-d092ad87d5eb admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:26.075081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f9fcf011-1586-4654-b28b-d092ad87d5eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b27a36eee54240bfc3c54081be785c', 'request_id': 'req-f9fcf011-1586-4654-b28b-d092ad87d5eb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:26.081610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f9fcf011-1586-4654-b28b-d092ad87d5eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b27a36eee54240bfc3c54081be785c', 'request_id': 'req-f9fcf011-1586-4654-b28b-d092ad87d5eb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:26.186401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f9fcf011-1586-4654-b28b-d092ad87d5eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b27a36eee54240bfc3c54081be785c', 'request_id': 'req-f9fcf011-1586-4654-b28b-d092ad87d5eb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:26.197705 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f9fcf011-1586-4654-b28b-d092ad87d5eb admin admin] The token cache is being invalidate because project 59b27a36eee54240bfc3c54081be785c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:34:26.198000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f9fcf011-1586-4654-b28b-d092ad87d5eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:26.198670 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f9fcf011-1586-4654-b28b-d092ad87d5eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:26.200227 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1081/2121] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:34:25 2022] DELETE /identity/v3/projects/59b27a36eee54240bfc3c54081be785c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:26.205147 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861377f8-42bf-4b15-a057-02899df006df None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:26.205443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861377f8-42bf-4b15-a057-02899df006df None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:26.205727 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861377f8-42bf-4b15-a057-02899df006df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:26.224120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-861377f8-42bf-4b15-a057-02899df006df None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:26.225611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-861377f8-42bf-4b15-a057-02899df006df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:26.284926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1041/2122] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:26.294019 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bdc11-e9ee-4ba0-8b0b-819f0a67298b None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:26.294386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bdc11-e9ee-4ba0-8b0b-819f0a67298b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:26.294641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bdc11-e9ee-4ba0-8b0b-819f0a67298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:26.313388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-8d4bdc11-e9ee-4ba0-8b0b-819f0a67298b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:26.314639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8d4bdc11-e9ee-4ba0-8b0b-819f0a67298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:26.328213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1082/2123] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:26.333242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861377f8-42bf-4b15-a057-02899df006df None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:26.343245 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bdc11-e9ee-4ba0-8b0b-819f0a67298b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:26.344627 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8d4bdc11-e9ee-4ba0-8b0b-819f0a67298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:26.345624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861377f8-42bf-4b15-a057-02899df006df None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:26.351573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fd094-2b8f-4148-9bb6-a252fb517bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:26.352697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fd094-2b8f-4148-9bb6-a252fb517bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:26.353811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fd094-2b8f-4148-9bb6-a252fb517bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:26.353811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fd094-2b8f-4148-9bb6-a252fb517bb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:26.354681 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fd094-2b8f-4148-9bb6-a252fb517bb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:34:26.355409 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fd094-2b8f-4148-9bb6-a252fb517bb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:26.357303 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bdc11-e9ee-4ba0-8b0b-819f0a67298b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:26.357811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fd094-2b8f-4148-9bb6-a252fb517bb3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:26.362522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a7e1f-9812-4b18-852c-421565e81b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:26.363453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a7e1f-9812-4b18-852c-421565e81b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:26.368946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a7e1f-9812-4b18-852c-421565e81b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:26.368946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a7e1f-9812-4b18-852c-421565e81b61 admin admin] PATH_INFO: `/v3/users/53f30aba23c741079da8a8c224d39256` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:26.368946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a7e1f-9812-4b18-852c-421565e81b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f30aba23c741079da8a8c224d39256)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:26.368946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a7e1f-9812-4b18-852c-421565e81b61 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:26.371683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1042/2124] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:34:26.380033 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fd094-2b8f-4148-9bb6-a252fb517bb3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:26.391337 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fd094-2b8f-4148-9bb6-a252fb517bb3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:26.400350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9471bf-baf0-4ef9-934f-1ac7330b7e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:26.406602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9471bf-baf0-4ef9-934f-1ac7330b7e58 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:26.406602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9471bf-baf0-4ef9-934f-1ac7330b7e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:26.406602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9471bf-baf0-4ef9-934f-1ac7330b7e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:26.406602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9471bf-baf0-4ef9-934f-1ac7330b7e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:26.406602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9471bf-baf0-4ef9-934f-1ac7330b7e58 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:26.538002 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1043/2125] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:34:26 2022] POST /identity/v3/projects => generated 397 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:26.542956 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9471bf-baf0-4ef9-934f-1ac7330b7e58 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:26.634639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d23a7e1f-9812-4b18-852c-421565e81b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f30aba23c741079da8a8c224d39256'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:26.637547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9471bf-baf0-4ef9-934f-1ac7330b7e58 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:26.650787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d23a7e1f-9812-4b18-852c-421565e81b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f30aba23c741079da8a8c224d39256'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:26.656684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3241e7e-862d-4762-aee7-5b50cbb65574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:26.657659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3241e7e-862d-4762-aee7-5b50cbb65574 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:26.657775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3241e7e-862d-4762-aee7-5b50cbb65574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:26.657975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3241e7e-862d-4762-aee7-5b50cbb65574 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:26.659005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3241e7e-862d-4762-aee7-5b50cbb65574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:26.662123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3241e7e-862d-4762-aee7-5b50cbb65574 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:26.726168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d23a7e1f-9812-4b18-852c-421565e81b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f30aba23c741079da8a8c224d39256'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:26.726828 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d23a7e1f-9812-4b18-852c-421565e81b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f30aba23c741079da8a8c224d39256'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:26.739274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d23a7e1f-9812-4b18-852c-421565e81b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f30aba23c741079da8a8c224d39256'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:26.746271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1083/2126] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:34:26 2022] DELETE /identity/v3/users/53f30aba23c741079da8a8c224d39256 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:34:26.752122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0f4b0-fbdb-46be-8aa7-3dcf8c8b9f89 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:26.752557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0f4b0-fbdb-46be-8aa7-3dcf8c8b9f89 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:26.753101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0f4b0-fbdb-46be-8aa7-3dcf8c8b9f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:26.774987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-cac0f4b0-fbdb-46be-8aa7-3dcf8c8b9f89 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:26.776337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-cac0f4b0-fbdb-46be-8aa7-3dcf8c8b9f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:26.792962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1044/2127] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:34:26 2022] POST /identity/v3/users => generated 299 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:34:26.796714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3241e7e-862d-4762-aee7-5b50cbb65574 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:26.800660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a3241e7e-862d-4762-aee7-5b50cbb65574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:26.817808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3241e7e-862d-4762-aee7-5b50cbb65574 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:26.863569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1084/2128] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:26.875979 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0f4b0-fbdb-46be-8aa7-3dcf8c8b9f89 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:26.877517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-cac0f4b0-fbdb-46be-8aa7-3dcf8c8b9f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:26.912636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932ec8-8cec-4ce1-a677-c17b4f84240c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:26.913942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932ec8-8cec-4ce1-a677-c17b4f84240c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:26.914458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932ec8-8cec-4ce1-a677-c17b4f84240c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:26.914860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932ec8-8cec-4ce1-a677-c17b4f84240c admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:26.915900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c932ec8-8cec-4ce1-a677-c17b4f84240c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:26.918098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c932ec8-8cec-4ce1-a677-c17b4f84240c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:26.931795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1045/2129] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:34:26.935699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932ec8-8cec-4ce1-a677-c17b4f84240c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:26.944043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0f4b0-fbdb-46be-8aa7-3dcf8c8b9f89 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:26.946390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932ec8-8cec-4ce1-a677-c17b4f84240c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:26.950124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e182b-a52a-4a06-9a05-fa49eba9825e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:26.951243 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e182b-a52a-4a06-9a05-fa49eba9825e service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:26.951637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e182b-a52a-4a06-9a05-fa49eba9825e service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:26.951991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e182b-a52a-4a06-9a05-fa49eba9825e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:26.952172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc53289-352c-4efd-a236-982fef81512a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:26.953014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc53289-352c-4efd-a236-982fef81512a admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:26.953541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc53289-352c-4efd-a236-982fef81512a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:26.954340 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc53289-352c-4efd-a236-982fef81512a admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:26.962471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc53289-352c-4efd-a236-982fef81512a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:26.962471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc53289-352c-4efd-a236-982fef81512a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:26.963845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e182b-a52a-4a06-9a05-fa49eba9825e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:26.965761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e182b-a52a-4a06-9a05-fa49eba9825e service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:26.969769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1046/2130] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:26.973936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc53289-352c-4efd-a236-982fef81512a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:26.980393 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1085/2131] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:26.998168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc53289-352c-4efd-a236-982fef81512a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:27.004496 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565d5ef-de23-4856-9f1d-1adbde008739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:27.005795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565d5ef-de23-4856-9f1d-1adbde008739 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:27.006177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565d5ef-de23-4856-9f1d-1adbde008739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:27.006610 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565d5ef-de23-4856-9f1d-1adbde008739 admin admin] PATH_INFO: `/v3/projects/1264f59e53344e5e8c4a5ea8b6133b3e/users/5089394ed5c3460f8770bb1f1210a338/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:27.031371 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565d5ef-de23-4856-9f1d-1adbde008739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1264f59e53344e5e8c4a5ea8b6133b3e, user_id=5089394ed5c3460f8770bb1f1210a338, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:27.034566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565d5ef-de23-4856-9f1d-1adbde008739 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:27.125362 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1047/2132] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:34:26 2022] PUT /identity/v3/projects/1264f59e53344e5e8c4a5ea8b6133b3e/users/5089394ed5c3460f8770bb1f1210a338/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:34:27.136446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f06ef-ebc5-4ae3-9ffb-7e813c50c8d4 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:27.136734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f06ef-ebc5-4ae3-9ffb-7e813c50c8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:27.137032 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f06ef-ebc5-4ae3-9ffb-7e813c50c8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:27.198522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-1d1f06ef-ebc5-4ae3-9ffb-7e813c50c8d4 None None] MFA Rules not processed for user `5089394ed5c3460f8770bb1f1210a338`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:27.199741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1d1f06ef-ebc5-4ae3-9ffb-7e813c50c8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:27.291713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1086/2133] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:27.304568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565d5ef-de23-4856-9f1d-1adbde008739 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:27.307165 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b565d5ef-de23-4856-9f1d-1adbde008739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:27.407842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565d5ef-de23-4856-9f1d-1adbde008739 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:27.412302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd238d-015a-4d64-a194-1b9a86b991ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:27.414336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd238d-015a-4d64-a194-1b9a86b991ab service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:27.414700 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd238d-015a-4d64-a194-1b9a86b991ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:27.415036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd238d-015a-4d64-a194-1b9a86b991ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:27.424333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd238d-015a-4d64-a194-1b9a86b991ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:27.425836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd238d-015a-4d64-a194-1b9a86b991ab service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:27.447042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1048/2134] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:27.721786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f06ef-ebc5-4ae3-9ffb-7e813c50c8d4 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:27.731408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1d1f06ef-ebc5-4ae3-9ffb-7e813c50c8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:27.802431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f06ef-ebc5-4ae3-9ffb-7e813c50c8d4 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:27.807900 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:27.808770 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:27.809050 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:27.809323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] PATH_INFO: `/v3/projects/191bc87fc7b842068a0ce3331b9934e4` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:27.810537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=191bc87fc7b842068a0ce3331b9934e4)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:27.812453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:27.947615 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '191bc87fc7b842068a0ce3331b9934e4', 'request_id': 'req-71538113-41d6-47d5-92e3-48edb2945829'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:27.953808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '191bc87fc7b842068a0ce3331b9934e4', 'request_id': 'req-71538113-41d6-47d5-92e3-48edb2945829'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:28.028966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '191bc87fc7b842068a0ce3331b9934e4', 'request_id': 'req-71538113-41d6-47d5-92e3-48edb2945829'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:28.040129 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] The token cache is being invalidate because project 191bc87fc7b842068a0ce3331b9934e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:34:28.040420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:28.041038 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:28.042668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1087/2135] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:34:27 2022] DELETE /identity/v3/projects/191bc87fc7b842068a0ce3331b9934e4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:28.046717 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd238d-015a-4d64-a194-1b9a86b991ab service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:28.057824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd238d-015a-4d64-a194-1b9a86b991ab service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:28.119219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7242e-78ac-4c1e-990a-5b8d3c94c068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:28.120109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7242e-78ac-4c1e-990a-5b8d3c94c068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:28.120395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7242e-78ac-4c1e-990a-5b8d3c94c068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:28.120674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7242e-78ac-4c1e-990a-5b8d3c94c068 admin admin] PATH_INFO: `/v3/users/17414b5c70664e1e9aa4c5d026317fce` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:28.121891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7242e-78ac-4c1e-990a-5b8d3c94c068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17414b5c70664e1e9aa4c5d026317fce)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:28.123856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7242e-78ac-4c1e-990a-5b8d3c94c068 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:28.353680 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-21c7242e-78ac-4c1e-990a-5b8d3c94c068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17414b5c70664e1e9aa4c5d026317fce'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:28.362374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-21c7242e-78ac-4c1e-990a-5b8d3c94c068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17414b5c70664e1e9aa4c5d026317fce'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:28.363363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-21c7242e-78ac-4c1e-990a-5b8d3c94c068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17414b5c70664e1e9aa4c5d026317fce'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:28.364036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-21c7242e-78ac-4c1e-990a-5b8d3c94c068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17414b5c70664e1e9aa4c5d026317fce'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:28.376403 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-21c7242e-78ac-4c1e-990a-5b8d3c94c068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17414b5c70664e1e9aa4c5d026317fce'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:28.458206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1049/2136] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:34:28 2022] DELETE /identity/v3/users/17414b5c70664e1e9aa4c5d026317fce => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:29.045254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:29.045254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:29.057881 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71538113-41d6-47d5-92e3-48edb2945829 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:29.125528 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd5b86-21f2-48b1-b7b5-70344af708bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:29.126440 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd5b86-21f2-48b1-b7b5-70344af708bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:29.126726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd5b86-21f2-48b1-b7b5-70344af708bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:29.131550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd5b86-21f2-48b1-b7b5-70344af708bc admin admin] PATH_INFO: `/v3/projects/1800cea007974af7a1f7004bafa80644` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:29.131550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd5b86-21f2-48b1-b7b5-70344af708bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1800cea007974af7a1f7004bafa80644)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:29.131550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd5b86-21f2-48b1-b7b5-70344af708bc admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:29.246872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-51dd5b86-21f2-48b1-b7b5-70344af708bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1800cea007974af7a1f7004bafa80644', 'request_id': 'req-51dd5b86-21f2-48b1-b7b5-70344af708bc'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:29.253613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-51dd5b86-21f2-48b1-b7b5-70344af708bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1800cea007974af7a1f7004bafa80644', 'request_id': 'req-51dd5b86-21f2-48b1-b7b5-70344af708bc'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:29.323779 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-51dd5b86-21f2-48b1-b7b5-70344af708bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1800cea007974af7a1f7004bafa80644', 'request_id': 'req-51dd5b86-21f2-48b1-b7b5-70344af708bc'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:29.334144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-51dd5b86-21f2-48b1-b7b5-70344af708bc admin admin] The token cache is being invalidate because project 1800cea007974af7a1f7004bafa80644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:34:29.334469 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-51dd5b86-21f2-48b1-b7b5-70344af708bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:29.335087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-51dd5b86-21f2-48b1-b7b5-70344af708bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:29.336699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1088/2137] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:34:29 2022] DELETE /identity/v3/projects/1800cea007974af7a1f7004bafa80644 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:29.341490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400404-18f4-490f-9386-d77d07cf9ed9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:29.341956 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400404-18f4-490f-9386-d77d07cf9ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:29.342041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400404-18f4-490f-9386-d77d07cf9ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:29.360486 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d1400404-18f4-490f-9386-d77d07cf9ed9 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:29.361692 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d1400404-18f4-490f-9386-d77d07cf9ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:29.419933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1050/2138] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:29.427901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480a8c6-59f5-4e32-9ea2-2a8bb44f3ce6 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:29.428188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480a8c6-59f5-4e32-9ea2-2a8bb44f3ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:29.428468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480a8c6-59f5-4e32-9ea2-2a8bb44f3ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:29.447129 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-c480a8c6-59f5-4e32-9ea2-2a8bb44f3ce6 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:29.448359 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c480a8c6-59f5-4e32-9ea2-2a8bb44f3ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:29.456763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1089/2139] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:29.460847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1400404-18f4-490f-9386-d77d07cf9ed9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:29.470571 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1400404-18f4-490f-9386-d77d07cf9ed9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:29.475104 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb4fe5-e88b-45e1-abeb-b6a31b0333b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:29.476278 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb4fe5-e88b-45e1-abeb-b6a31b0333b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:29.476558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb4fe5-e88b-45e1-abeb-b6a31b0333b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:29.476871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb4fe5-e88b-45e1-abeb-b6a31b0333b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:29.477627 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb4fe5-e88b-45e1-abeb-b6a31b0333b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:34:29.477931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb4fe5-e88b-45e1-abeb-b6a31b0333b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:29.479560 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb4fe5-e88b-45e1-abeb-b6a31b0333b1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:29.492190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1051/2140] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:34:29.496609 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480a8c6-59f5-4e32-9ea2-2a8bb44f3ce6 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:29.505866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480a8c6-59f5-4e32-9ea2-2a8bb44f3ce6 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:29.510700 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1f512-8394-4c30-92bd-679380a28468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:29.511357 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1f512-8394-4c30-92bd-679380a28468 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:29.511641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1f512-8394-4c30-92bd-679380a28468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:29.511916 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1f512-8394-4c30-92bd-679380a28468 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:29.512615 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1f512-8394-4c30-92bd-679380a28468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:29.514526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1f512-8394-4c30-92bd-679380a28468 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:29.633552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1090/2141] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:34:29 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:34:29.634758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb4fe5-e88b-45e1-abeb-b6a31b0333b1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:29.644604 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb4fe5-e88b-45e1-abeb-b6a31b0333b1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:29.711196 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced025c-0105-45a3-9132-abdbbc25b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:29.711720 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced025c-0105-45a3-9132-abdbbc25b520 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:29.711998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced025c-0105-45a3-9132-abdbbc25b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:29.712275 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced025c-0105-45a3-9132-abdbbc25b520 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:29.712958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced025c-0105-45a3-9132-abdbbc25b520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:29.714903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced025c-0105-45a3-9132-abdbbc25b520 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:29.829610 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1052/2142] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:34:29 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:29.833640 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1f512-8394-4c30-92bd-679380a28468 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:29.843755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1f512-8394-4c30-92bd-679380a28468 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:29.848291 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c589f-b4d8-46b9-8fac-795c038d167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:29.848943 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c589f-b4d8-46b9-8fac-795c038d167b admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:29.849226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c589f-b4d8-46b9-8fac-795c038d167b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:29.849500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c589f-b4d8-46b9-8fac-795c038d167b admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:29.850350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c589f-b4d8-46b9-8fac-795c038d167b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:29.851897 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c589f-b4d8-46b9-8fac-795c038d167b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:29.862018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1091/2143] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:29.865822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced025c-0105-45a3-9132-abdbbc25b520 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:29.876259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced025c-0105-45a3-9132-abdbbc25b520 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:29.880795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156d682-152d-4078-ba5b-cc35bc3bd272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:29.881666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156d682-152d-4078-ba5b-cc35bc3bd272 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:29.882828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156d682-152d-4078-ba5b-cc35bc3bd272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:29.883108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156d682-152d-4078-ba5b-cc35bc3bd272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:29.883825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156d682-152d-4078-ba5b-cc35bc3bd272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:29.885399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156d682-152d-4078-ba5b-cc35bc3bd272 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:29.895052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1053/2144] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:34:29.899154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c589f-b4d8-46b9-8fac-795c038d167b admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:29.908607 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c589f-b4d8-46b9-8fac-795c038d167b admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:29.913034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aabed2-da7c-4725-bd56-ade02d40c49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:29.915068 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aabed2-da7c-4725-bd56-ade02d40c49e admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:29.915353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aabed2-da7c-4725-bd56-ade02d40c49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:29.915630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aabed2-da7c-4725-bd56-ade02d40c49e admin admin] PATH_INFO: `/v3/projects/32c5810e83664bd1aab7220e7cf4175c/users/1b66751304f248f4bb49384eee6b3177/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:29.930509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aabed2-da7c-4725-bd56-ade02d40c49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c5810e83664bd1aab7220e7cf4175c, user_id=1b66751304f248f4bb49384eee6b3177, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:29.933134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aabed2-da7c-4725-bd56-ade02d40c49e admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:30.012071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1092/2145] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:34:29 2022] PUT /identity/v3/projects/32c5810e83664bd1aab7220e7cf4175c/users/1b66751304f248f4bb49384eee6b3177/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:30.023861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd31cf-d036-4526-811b-cbe30d8f53ed None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:30.024153 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd31cf-d036-4526-811b-cbe30d8f53ed None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:30.024428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd31cf-d036-4526-811b-cbe30d8f53ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:30.050563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d2fd31cf-d036-4526-811b-cbe30d8f53ed None None] MFA Rules not processed for user `1b66751304f248f4bb49384eee6b3177`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:30.051752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d2fd31cf-d036-4526-811b-cbe30d8f53ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:30.115651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1054/2146] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:30.119975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aabed2-da7c-4725-bd56-ade02d40c49e admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:30.181760 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aabed2-da7c-4725-bd56-ade02d40c49e admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:30.186568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92670ac0-f6ed-41fd-9292-52a56b31ffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:30.187231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92670ac0-f6ed-41fd-9292-52a56b31ffdd admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:30.187517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92670ac0-f6ed-41fd-9292-52a56b31ffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:30.187800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92670ac0-f6ed-41fd-9292-52a56b31ffdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:30.188486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92670ac0-f6ed-41fd-9292-52a56b31ffdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:30.190741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92670ac0-f6ed-41fd-9292-52a56b31ffdd admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:30.313740 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1093/2147] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:34:30 2022] POST /identity/v3/projects => generated 367 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:30.317762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd31cf-d036-4526-811b-cbe30d8f53ed None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:30.329204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd31cf-d036-4526-811b-cbe30d8f53ed None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:30.383003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc44f8-7609-4f82-a978-149c89edb91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:30.383657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc44f8-7609-4f82-a978-149c89edb91c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:30.383944 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc44f8-7609-4f82-a978-149c89edb91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:30.384216 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc44f8-7609-4f82-a978-149c89edb91c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:30.384932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc44f8-7609-4f82-a978-149c89edb91c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:30.386857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc44f8-7609-4f82-a978-149c89edb91c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:30.516951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1055/2148] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:34:30 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:30.521363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92670ac0-f6ed-41fd-9292-52a56b31ffdd admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:30.530314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92670ac0-f6ed-41fd-9292-52a56b31ffdd admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:30.534911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f20ff4-1b73-4974-8924-26e03640cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:30.535583 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f20ff4-1b73-4974-8924-26e03640cc4f admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:30.535869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f20ff4-1b73-4974-8924-26e03640cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:30.536147 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f20ff4-1b73-4974-8924-26e03640cc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:30.536870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f20ff4-1b73-4974-8924-26e03640cc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:30.538938 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f20ff4-1b73-4974-8924-26e03640cc4f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:30.553410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1094/2149] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:30.554653 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc44f8-7609-4f82-a978-149c89edb91c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:30.564687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc44f8-7609-4f82-a978-149c89edb91c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:30.570194 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e637a8-584c-4e7a-baab-d41d0d1da84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:30.571281 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e637a8-584c-4e7a-baab-d41d0d1da84a admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:30.571567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e637a8-584c-4e7a-baab-d41d0d1da84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:30.571849 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e637a8-584c-4e7a-baab-d41d0d1da84a admin admin] PATH_INFO: `/v3/projects/1479cd9679d44398a92b2202f32c6267/users/83b517bb7d8a4ad09f8de1871cced2e1/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:30.587118 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e637a8-584c-4e7a-baab-d41d0d1da84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1479cd9679d44398a92b2202f32c6267, user_id=83b517bb7d8a4ad09f8de1871cced2e1, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:30.589762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e637a8-584c-4e7a-baab-d41d0d1da84a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:30.672114 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1056/2150] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:34:30 2022] PUT /identity/v3/projects/1479cd9679d44398a92b2202f32c6267/users/83b517bb7d8a4ad09f8de1871cced2e1/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:30.675968 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f20ff4-1b73-4974-8924-26e03640cc4f admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:30.686765 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f20ff4-1b73-4974-8924-26e03640cc4f admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:30.742857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8436374-065a-4151-9e49-145c8b21e066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:30.743521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8436374-065a-4151-9e49-145c8b21e066 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:30.743807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8436374-065a-4151-9e49-145c8b21e066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:30.744108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8436374-065a-4151-9e49-145c8b21e066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:30.744835 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8436374-065a-4151-9e49-145c8b21e066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:30.746482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8436374-065a-4151-9e49-145c8b21e066 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:30.756101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1095/2151] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:30.761232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e637a8-584c-4e7a-baab-d41d0d1da84a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:30.771827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e637a8-584c-4e7a-baab-d41d0d1da84a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:30.777794 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41616d9e-a4a9-404c-bee7-b77d7f8e4d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:30.778692 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41616d9e-a4a9-404c-bee7-b77d7f8e4d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:30.778974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41616d9e-a4a9-404c-bee7-b77d7f8e4d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:30.779253 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41616d9e-a4a9-404c-bee7-b77d7f8e4d53 admin admin] PATH_INFO: `/v3/projects/1479cd9679d44398a92b2202f32c6267/users/83b517bb7d8a4ad09f8de1871cced2e1/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:30.781252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41616d9e-a4a9-404c-bee7-b77d7f8e4d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1479cd9679d44398a92b2202f32c6267, user_id=83b517bb7d8a4ad09f8de1871cced2e1, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:30.783973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41616d9e-a4a9-404c-bee7-b77d7f8e4d53 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:30.794813 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1057/2152] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:34:30 2022] PUT /identity/v3/projects/1479cd9679d44398a92b2202f32c6267/users/83b517bb7d8a4ad09f8de1871cced2e1/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:30.805740 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b8d9f-1f63-42db-a293-f89dfcf87019 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:30.806035 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b8d9f-1f63-42db-a293-f89dfcf87019 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:30.806347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b8d9f-1f63-42db-a293-f89dfcf87019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:30.834697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e22b8d9f-1f63-42db-a293-f89dfcf87019 None None] MFA Rules not processed for user `83b517bb7d8a4ad09f8de1871cced2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:30.836718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e22b8d9f-1f63-42db-a293-f89dfcf87019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:30.907075 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1096/2153] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:30.919306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41616d9e-a4a9-404c-bee7-b77d7f8e4d53 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:30.921146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-41616d9e-a4a9-404c-bee7-b77d7f8e4d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:30.976726 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41616d9e-a4a9-404c-bee7-b77d7f8e4d53 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:30.980249 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93882c3e-74ed-4ac1-bad1-03ac53bf161d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:30.980881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93882c3e-74ed-4ac1-bad1-03ac53bf161d service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:30.981158 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93882c3e-74ed-4ac1-bad1-03ac53bf161d service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:30.981433 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93882c3e-74ed-4ac1-bad1-03ac53bf161d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:30.990032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93882c3e-74ed-4ac1-bad1-03ac53bf161d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:30.992341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93882c3e-74ed-4ac1-bad1-03ac53bf161d service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:31.001461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1058/2154] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:31.129265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b8d9f-1f63-42db-a293-f89dfcf87019 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:31.130701 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e22b8d9f-1f63-42db-a293-f89dfcf87019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:31.143392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b8d9f-1f63-42db-a293-f89dfcf87019 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:31.146958 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cccd09-59f6-4aa0-92dd-d5562e22e158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:31.147624 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cccd09-59f6-4aa0-92dd-d5562e22e158 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:31.147908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cccd09-59f6-4aa0-92dd-d5562e22e158 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:31.148178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cccd09-59f6-4aa0-92dd-d5562e22e158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:31.204264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cccd09-59f6-4aa0-92dd-d5562e22e158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:31.205686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cccd09-59f6-4aa0-92dd-d5562e22e158 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:31.214361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1097/2155] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:36.360285 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93882c3e-74ed-4ac1-bad1-03ac53bf161d service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:36.457526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93882c3e-74ed-4ac1-bad1-03ac53bf161d service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:36.463816 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:36.464682 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:36.464964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:36.465236 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] PATH_INFO: `/v3/users/1b66751304f248f4bb49384eee6b3177` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:36.466490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b66751304f248f4bb49384eee6b3177)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:36.468491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:36.737523 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b66751304f248f4bb49384eee6b3177'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:36.744964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b66751304f248f4bb49384eee6b3177'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:36.745654 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b66751304f248f4bb49384eee6b3177'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:36.746401 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b66751304f248f4bb49384eee6b3177'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:36.767732 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b66751304f248f4bb49384eee6b3177'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:36.857966 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1059/2156] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:34:36 2022] DELETE /identity/v3/users/1b66751304f248f4bb49384eee6b3177 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:36.862561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c442dc7-5258-43e3-9710-9928bdb10cbb None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:36.863077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c442dc7-5258-43e3-9710-9928bdb10cbb None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:36.863170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c442dc7-5258-43e3-9710-9928bdb10cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:36.901871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-4c442dc7-5258-43e3-9710-9928bdb10cbb None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:36.903099 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4c442dc7-5258-43e3-9710-9928bdb10cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:36.958997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1098/2157] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:36.969101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:36.970529 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:37.062423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9a3ba-8746-45f2-b264-22c1327de124 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:37.066144 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ead00-ad34-40ff-aacd-c6f74476f888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:37.066842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ead00-ad34-40ff-aacd-c6f74476f888 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:37.067125 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ead00-ad34-40ff-aacd-c6f74476f888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:37.067417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ead00-ad34-40ff-aacd-c6f74476f888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:37.076780 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ead00-ad34-40ff-aacd-c6f74476f888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:37.078233 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ead00-ad34-40ff-aacd-c6f74476f888 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:37.088159 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1060/2158] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:34:37.574136 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c442dc7-5258-43e3-9710-9928bdb10cbb None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:37.575671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4c442dc7-5258-43e3-9710-9928bdb10cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:37.588785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c442dc7-5258-43e3-9710-9928bdb10cbb None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:37.593552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:37.594981 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:37.595450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:37.595740 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] PATH_INFO: `/v3/projects/32c5810e83664bd1aab7220e7cf4175c` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:37.596959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c5810e83664bd1aab7220e7cf4175c)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:37.598910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:37.709233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c5810e83664bd1aab7220e7cf4175c', 'request_id': 'req-6b5f64e3-b052-4f6d-9c04-64830db3883b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:37.716069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c5810e83664bd1aab7220e7cf4175c', 'request_id': 'req-6b5f64e3-b052-4f6d-9c04-64830db3883b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:37.789198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c5810e83664bd1aab7220e7cf4175c', 'request_id': 'req-6b5f64e3-b052-4f6d-9c04-64830db3883b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:37.800337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] The token cache is being invalidate because project 32c5810e83664bd1aab7220e7cf4175c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:34:37.800624 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:37.801254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:37.803073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1099/2159] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:34:37 2022] DELETE /identity/v3/projects/32c5810e83664bd1aab7220e7cf4175c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:34:37.807714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ead00-ad34-40ff-aacd-c6f74476f888 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:37.817478 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ead00-ad34-40ff-aacd-c6f74476f888 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:37.875523 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f151f8-853a-4134-a23d-34fd222a7a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:37.876428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f151f8-853a-4134-a23d-34fd222a7a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:37.876719 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f151f8-853a-4134-a23d-34fd222a7a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:37.877027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f151f8-853a-4134-a23d-34fd222a7a12 admin admin] PATH_INFO: `/v3/users/83b517bb7d8a4ad09f8de1871cced2e1` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:37.878237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f151f8-853a-4134-a23d-34fd222a7a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b517bb7d8a4ad09f8de1871cced2e1)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:37.880218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f151f8-853a-4134-a23d-34fd222a7a12 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:38.061180 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-02f151f8-853a-4134-a23d-34fd222a7a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b517bb7d8a4ad09f8de1871cced2e1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:38.068109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-02f151f8-853a-4134-a23d-34fd222a7a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b517bb7d8a4ad09f8de1871cced2e1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:38.068767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-02f151f8-853a-4134-a23d-34fd222a7a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b517bb7d8a4ad09f8de1871cced2e1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:38.069416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-02f151f8-853a-4134-a23d-34fd222a7a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b517bb7d8a4ad09f8de1871cced2e1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:38.080932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-02f151f8-853a-4134-a23d-34fd222a7a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b517bb7d8a4ad09f8de1871cced2e1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:38.159941 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1061/2160] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:34:37 2022] DELETE /identity/v3/users/83b517bb7d8a4ad09f8de1871cced2e1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:38.602669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:38.608387 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:38.618242 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f64e3-b052-4f6d-9c04-64830db3883b admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:38.681794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9915b-4568-4915-a4b4-1282806d2dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:38.682787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9915b-4568-4915-a4b4-1282806d2dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:38.683098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9915b-4568-4915-a4b4-1282806d2dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:38.683373 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9915b-4568-4915-a4b4-1282806d2dcf admin admin] PATH_INFO: `/v3/projects/1479cd9679d44398a92b2202f32c6267` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:38.684555 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9915b-4568-4915-a4b4-1282806d2dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1479cd9679d44398a92b2202f32c6267)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:38.686542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9915b-4568-4915-a4b4-1282806d2dcf admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:38.804333 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3aa9915b-4568-4915-a4b4-1282806d2dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1479cd9679d44398a92b2202f32c6267', 'request_id': 'req-3aa9915b-4568-4915-a4b4-1282806d2dcf'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:38.810657 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3aa9915b-4568-4915-a4b4-1282806d2dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1479cd9679d44398a92b2202f32c6267', 'request_id': 'req-3aa9915b-4568-4915-a4b4-1282806d2dcf'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:38.866119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3aa9915b-4568-4915-a4b4-1282806d2dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1479cd9679d44398a92b2202f32c6267', 'request_id': 'req-3aa9915b-4568-4915-a4b4-1282806d2dcf'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:38.876840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3aa9915b-4568-4915-a4b4-1282806d2dcf admin admin] The token cache is being invalidate because project 1479cd9679d44398a92b2202f32c6267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:34:38.877128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3aa9915b-4568-4915-a4b4-1282806d2dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:38.877759 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-3aa9915b-4568-4915-a4b4-1282806d2dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:38.879375 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1100/2161] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:34:38 2022] DELETE /identity/v3/projects/1479cd9679d44398a92b2202f32c6267 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:34:38.885540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85483-1a81-4f22-aefd-11ede4ab669e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:38.886142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85483-1a81-4f22-aefd-11ede4ab669e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:38.886142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85483-1a81-4f22-aefd-11ede4ab669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:38.932162 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0cd85483-1a81-4f22-aefd-11ede4ab669e None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:38.933394 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0cd85483-1a81-4f22-aefd-11ede4ab669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:39.017014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1062/2162] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:39.025873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711a6ce-7bae-44db-ae2d-9354b96d40cf None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:39.026166 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711a6ce-7bae-44db-ae2d-9354b96d40cf None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:39.026488 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711a6ce-7bae-44db-ae2d-9354b96d40cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:39.044768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-7711a6ce-7bae-44db-ae2d-9354b96d40cf None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:39.046144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7711a6ce-7bae-44db-ae2d-9354b96d40cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:39.056250 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1101/2163] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:39.059305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd85483-1a81-4f22-aefd-11ede4ab669e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:39.069865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd85483-1a81-4f22-aefd-11ede4ab669e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:39.075401 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e030806-8f7b-47f7-82cf-ff12dcd94a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:39.076177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e030806-8f7b-47f7-82cf-ff12dcd94a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:39.076571 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e030806-8f7b-47f7-82cf-ff12dcd94a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:39.076954 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e030806-8f7b-47f7-82cf-ff12dcd94a06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:39.077682 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e030806-8f7b-47f7-82cf-ff12dcd94a06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:34:39.077992 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e030806-8f7b-47f7-82cf-ff12dcd94a06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:39.079651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e030806-8f7b-47f7-82cf-ff12dcd94a06 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:39.094315 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1063/2164] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:34:39.097666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711a6ce-7bae-44db-ae2d-9354b96d40cf None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:39.107495 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711a6ce-7bae-44db-ae2d-9354b96d40cf None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:39.113336 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9b909-690e-48da-9aef-cb8715655a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:39.114000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9b909-690e-48da-9aef-cb8715655a98 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:39.114329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9b909-690e-48da-9aef-cb8715655a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:39.114694 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9b909-690e-48da-9aef-cb8715655a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:39.115396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9b909-690e-48da-9aef-cb8715655a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:39.118137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9b909-690e-48da-9aef-cb8715655a98 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:39.256714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1102/2165] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:34:39 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:39.261626 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e030806-8f7b-47f7-82cf-ff12dcd94a06 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:39.272044 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e030806-8f7b-47f7-82cf-ff12dcd94a06 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:39.329086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78766cc0-ede2-4b96-84a6-35ea64781fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:39.329757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78766cc0-ede2-4b96-84a6-35ea64781fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:39.330038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78766cc0-ede2-4b96-84a6-35ea64781fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:39.330348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78766cc0-ede2-4b96-84a6-35ea64781fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:39.331027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78766cc0-ede2-4b96-84a6-35ea64781fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:39.333048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78766cc0-ede2-4b96-84a6-35ea64781fa1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:39.477214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1064/2166] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:34:39 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:39.478517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9b909-690e-48da-9aef-cb8715655a98 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:39.488607 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9b909-690e-48da-9aef-cb8715655a98 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:39.494182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dd18c-3253-4a95-8b42-2cc6d50d3b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:39.494895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dd18c-3253-4a95-8b42-2cc6d50d3b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:39.495234 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dd18c-3253-4a95-8b42-2cc6d50d3b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:39.495528 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dd18c-3253-4a95-8b42-2cc6d50d3b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:39.496273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dd18c-3253-4a95-8b42-2cc6d50d3b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:39.497904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dd18c-3253-4a95-8b42-2cc6d50d3b53 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:39.511641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1103/2167] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:39.513336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78766cc0-ede2-4b96-84a6-35ea64781fa1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:39.523313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78766cc0-ede2-4b96-84a6-35ea64781fa1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:39.528278 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dceb9-ef18-4241-beda-72233d859dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:39.529025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dceb9-ef18-4241-beda-72233d859dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:39.529877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dceb9-ef18-4241-beda-72233d859dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:39.529877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dceb9-ef18-4241-beda-72233d859dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:39.530571 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dceb9-ef18-4241-beda-72233d859dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:39.532391 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dceb9-ef18-4241-beda-72233d859dfd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:39.546382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1065/2168] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:39.550235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dd18c-3253-4a95-8b42-2cc6d50d3b53 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:39.561505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dd18c-3253-4a95-8b42-2cc6d50d3b53 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:39.566552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8491f-7d21-423a-a315-6155ebc562b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:39.567440 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8491f-7d21-423a-a315-6155ebc562b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:39.567722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8491f-7d21-423a-a315-6155ebc562b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:39.567997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8491f-7d21-423a-a315-6155ebc562b7 admin admin] PATH_INFO: `/v3/projects/06a3bdfff1654e54bf58e12052ecb7ce/users/fbaebac59fd5443abf5ba0c3196604d6/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:39.588437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8491f-7d21-423a-a315-6155ebc562b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a3bdfff1654e54bf58e12052ecb7ce, user_id=fbaebac59fd5443abf5ba0c3196604d6, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:39.591115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8491f-7d21-423a-a315-6155ebc562b7 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:39.730206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1104/2169] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:34:39 2022] PUT /identity/v3/projects/06a3bdfff1654e54bf58e12052ecb7ce/users/fbaebac59fd5443abf5ba0c3196604d6/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:34:39.743384 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c10c5-184d-419a-a89f-08f96969d2a9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:39.743672 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c10c5-184d-419a-a89f-08f96969d2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:39.743947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c10c5-184d-419a-a89f-08f96969d2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:39.770783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-947c10c5-184d-419a-a89f-08f96969d2a9 None None] MFA Rules not processed for user `fbaebac59fd5443abf5ba0c3196604d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:39.771997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-947c10c5-184d-419a-a89f-08f96969d2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:39.833594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1066/2170] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:39.845146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8491f-7d21-423a-a315-6155ebc562b7 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:39.846874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4dd8491f-7d21-423a-a315-6155ebc562b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:39.901713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8491f-7d21-423a-a315-6155ebc562b7 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:39.905301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93799202-b7d5-457f-ac35-fd1e105510ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:39.905937 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799202-b7d5-457f-ac35-fd1e105510ef service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:39.906232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799202-b7d5-457f-ac35-fd1e105510ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:39.906525 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799202-b7d5-457f-ac35-fd1e105510ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:39.915287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93799202-b7d5-457f-ac35-fd1e105510ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:39.916703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93799202-b7d5-457f-ac35-fd1e105510ef service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:39.925162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1105/2171] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:39.944631 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c10c5-184d-419a-a89f-08f96969d2a9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:40.005090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c10c5-184d-419a-a89f-08f96969d2a9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:40.009865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:40.010753 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:40.011040 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:40.011326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] PATH_INFO: `/v3/users/fbaebac59fd5443abf5ba0c3196604d6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:40.012516 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbaebac59fd5443abf5ba0c3196604d6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:40.014661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:40.238724 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbaebac59fd5443abf5ba0c3196604d6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:40.247034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbaebac59fd5443abf5ba0c3196604d6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:40.247875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbaebac59fd5443abf5ba0c3196604d6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:40.248970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbaebac59fd5443abf5ba0c3196604d6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:40.263635 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbaebac59fd5443abf5ba0c3196604d6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:40.354093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1067/2172] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:34:39 2022] DELETE /identity/v3/users/fbaebac59fd5443abf5ba0c3196604d6 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:40.358693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01753578-257a-4e65-9930-13aa0ee45e68 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:40.358987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01753578-257a-4e65-9930-13aa0ee45e68 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:40.359266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01753578-257a-4e65-9930-13aa0ee45e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:40.377039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-01753578-257a-4e65-9930-13aa0ee45e68 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:40.378234 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-01753578-257a-4e65-9930-13aa0ee45e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:40.434872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1106/2173] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:40.444935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:40.446397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:40.503912 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a011-a7be-422a-a44e-e13b6686d45e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:40.508289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc853836-8a5d-4261-8c5a-0236c3a9f14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:40.508862 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc853836-8a5d-4261-8c5a-0236c3a9f14f service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:40.509142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc853836-8a5d-4261-8c5a-0236c3a9f14f service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:40.509417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc853836-8a5d-4261-8c5a-0236c3a9f14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:40.518245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc853836-8a5d-4261-8c5a-0236c3a9f14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:40.519687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc853836-8a5d-4261-8c5a-0236c3a9f14f service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:40.529594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1068/2174] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:41.001737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01753578-257a-4e65-9930-13aa0ee45e68 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:41.003533 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-01753578-257a-4e65-9930-13aa0ee45e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:41.015698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01753578-257a-4e65-9930-13aa0ee45e68 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:41.020160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eea6a-d250-4751-8b4e-fc349ae94741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:41.021025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eea6a-d250-4751-8b4e-fc349ae94741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:41.021306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eea6a-d250-4751-8b4e-fc349ae94741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:41.021578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eea6a-d250-4751-8b4e-fc349ae94741 admin admin] PATH_INFO: `/v3/projects/06a3bdfff1654e54bf58e12052ecb7ce` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:41.023128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eea6a-d250-4751-8b4e-fc349ae94741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a3bdfff1654e54bf58e12052ecb7ce)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:41.025146 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eea6a-d250-4751-8b4e-fc349ae94741 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:41.146727 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-df9eea6a-d250-4751-8b4e-fc349ae94741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a3bdfff1654e54bf58e12052ecb7ce', 'request_id': 'req-df9eea6a-d250-4751-8b4e-fc349ae94741'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:41.153280 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-df9eea6a-d250-4751-8b4e-fc349ae94741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a3bdfff1654e54bf58e12052ecb7ce', 'request_id': 'req-df9eea6a-d250-4751-8b4e-fc349ae94741'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:41.234324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-df9eea6a-d250-4751-8b4e-fc349ae94741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a3bdfff1654e54bf58e12052ecb7ce', 'request_id': 'req-df9eea6a-d250-4751-8b4e-fc349ae94741'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:41.245247 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-df9eea6a-d250-4751-8b4e-fc349ae94741 admin admin] The token cache is being invalidate because project 06a3bdfff1654e54bf58e12052ecb7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:34:41.245532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-df9eea6a-d250-4751-8b4e-fc349ae94741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:41.246213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-df9eea6a-d250-4751-8b4e-fc349ae94741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:41.247877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1107/2175] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:34:41 2022] DELETE /identity/v3/projects/06a3bdfff1654e54bf58e12052ecb7ce => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:41.252783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cb950-cf8f-4977-96dd-1c525bfaa78d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:41.253255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cb950-cf8f-4977-96dd-1c525bfaa78d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:41.253349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cb950-cf8f-4977-96dd-1c525bfaa78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:41.272679 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e98cb950-cf8f-4977-96dd-1c525bfaa78d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:41.272679 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e98cb950-cf8f-4977-96dd-1c525bfaa78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:41.341960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1069/2176] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:41.347649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00212c97-9c97-440a-8374-f16eaa33da9f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:41.351927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00212c97-9c97-440a-8374-f16eaa33da9f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:41.351927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00212c97-9c97-440a-8374-f16eaa33da9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:41.367867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-00212c97-9c97-440a-8374-f16eaa33da9f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:41.369070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-00212c97-9c97-440a-8374-f16eaa33da9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:41.377168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1108/2177] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:41.381335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cb950-cf8f-4977-96dd-1c525bfaa78d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:41.391280 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cb950-cf8f-4977-96dd-1c525bfaa78d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:41.395774 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe5dff-58ad-48de-ac28-87c6bde89b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:41.399432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe5dff-58ad-48de-ac28-87c6bde89b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:41.399432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe5dff-58ad-48de-ac28-87c6bde89b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:41.399432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe5dff-58ad-48de-ac28-87c6bde89b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:41.399432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe5dff-58ad-48de-ac28-87c6bde89b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:34:41.399432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe5dff-58ad-48de-ac28-87c6bde89b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:41.400628 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe5dff-58ad-48de-ac28-87c6bde89b7c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:41.413234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1070/2178] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:34:41.417859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00212c97-9c97-440a-8374-f16eaa33da9f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:41.427071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00212c97-9c97-440a-8374-f16eaa33da9f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:41.433064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e4f39-4c7a-4c57-a6e0-7f5482bc80b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:41.433756 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e4f39-4c7a-4c57-a6e0-7f5482bc80b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:41.434044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e4f39-4c7a-4c57-a6e0-7f5482bc80b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:41.434355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e4f39-4c7a-4c57-a6e0-7f5482bc80b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:41.435055 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e4f39-4c7a-4c57-a6e0-7f5482bc80b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:41.437010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e4f39-4c7a-4c57-a6e0-7f5482bc80b0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:41.531498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1109/2179] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:34:41 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:41.534438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe5dff-58ad-48de-ac28-87c6bde89b7c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:41.544666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe5dff-58ad-48de-ac28-87c6bde89b7c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:41.605575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d8251-3300-4fe5-9763-ce21f98ff7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:41.606252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d8251-3300-4fe5-9763-ce21f98ff7fa admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:41.606580 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d8251-3300-4fe5-9763-ce21f98ff7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:41.606852 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d8251-3300-4fe5-9763-ce21f98ff7fa admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:41.607538 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d8251-3300-4fe5-9763-ce21f98ff7fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:41.609504 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d8251-3300-4fe5-9763-ce21f98ff7fa admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:41.718590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1071/2180] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:34:41 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:41.722666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e4f39-4c7a-4c57-a6e0-7f5482bc80b0 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:41.733373 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e4f39-4c7a-4c57-a6e0-7f5482bc80b0 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:41.738204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f15a3a-db5e-4312-a27f-4ed121259556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:41.738894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f15a3a-db5e-4312-a27f-4ed121259556 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:41.739178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f15a3a-db5e-4312-a27f-4ed121259556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:41.739517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f15a3a-db5e-4312-a27f-4ed121259556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:41.740157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f15a3a-db5e-4312-a27f-4ed121259556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:41.742438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f15a3a-db5e-4312-a27f-4ed121259556 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:41.752812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1110/2181] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:41.760336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d8251-3300-4fe5-9763-ce21f98ff7fa admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:41.770441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d8251-3300-4fe5-9763-ce21f98ff7fa admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:41.775833 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36bd11-e54c-437f-8091-5c1656fc0d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:41.776452 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36bd11-e54c-437f-8091-5c1656fc0d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:41.776744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36bd11-e54c-437f-8091-5c1656fc0d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:41.777020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36bd11-e54c-437f-8091-5c1656fc0d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:41.777740 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36bd11-e54c-437f-8091-5c1656fc0d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:41.782470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36bd11-e54c-437f-8091-5c1656fc0d55 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:41.791220 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1072/2182] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:41.795439 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f15a3a-db5e-4312-a27f-4ed121259556 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:41.807353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f15a3a-db5e-4312-a27f-4ed121259556 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:41.813205 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d4e91-d589-408c-9f44-6d3b52ca9d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:41.813205 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4e91-d589-408c-9f44-6d3b52ca9d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:41.813205 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4e91-d589-408c-9f44-6d3b52ca9d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:41.813729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4e91-d589-408c-9f44-6d3b52ca9d28 admin admin] PATH_INFO: `/v3/projects/c5d7c7142a7e46dead5a87518c074060/users/74ac3a6655814635ad3706d12ee2d19b/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:41.829999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d4e91-d589-408c-9f44-6d3b52ca9d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d7c7142a7e46dead5a87518c074060, user_id=74ac3a6655814635ad3706d12ee2d19b, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:41.832607 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d4e91-d589-408c-9f44-6d3b52ca9d28 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:41.901482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1111/2183] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:34:41 2022] PUT /identity/v3/projects/c5d7c7142a7e46dead5a87518c074060/users/74ac3a6655814635ad3706d12ee2d19b/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:41.911616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa89b3-302e-41f0-9bc0-d815fc2e6e69 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:41.911911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa89b3-302e-41f0-9bc0-d815fc2e6e69 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:41.912197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa89b3-302e-41f0-9bc0-d815fc2e6e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:41.941326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8bfa89b3-302e-41f0-9bc0-d815fc2e6e69 None None] MFA Rules not processed for user `74ac3a6655814635ad3706d12ee2d19b`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:41.942701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8bfa89b3-302e-41f0-9bc0-d815fc2e6e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:42.006405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1073/2184] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:42.017284 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d4e91-d589-408c-9f44-6d3b52ca9d28 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:42.019000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-714d4e91-d589-408c-9f44-6d3b52ca9d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:42.074056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d4e91-d589-408c-9f44-6d3b52ca9d28 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:42.077680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de018a-64f5-4f16-bbcb-1077f9518888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:42.078357 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de018a-64f5-4f16-bbcb-1077f9518888 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:42.078640 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de018a-64f5-4f16-bbcb-1077f9518888 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:42.078914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de018a-64f5-4f16-bbcb-1077f9518888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:42.087701 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de018a-64f5-4f16-bbcb-1077f9518888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:42.089107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de018a-64f5-4f16-bbcb-1077f9518888 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:42.097792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1112/2185] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:44.242949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa89b3-302e-41f0-9bc0-d815fc2e6e69 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:44.244471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8bfa89b3-302e-41f0-9bc0-d815fc2e6e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:44.323425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa89b3-302e-41f0-9bc0-d815fc2e6e69 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:44.328004 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:44.329059 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:44.329343 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:44.329619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] PATH_INFO: `/v3/users/5089394ed5c3460f8770bb1f1210a338` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:44.331435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5089394ed5c3460f8770bb1f1210a338)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:44.333843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:44.605459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5089394ed5c3460f8770bb1f1210a338'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:44.612688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5089394ed5c3460f8770bb1f1210a338'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:44.613483 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5089394ed5c3460f8770bb1f1210a338'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:44.614202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5089394ed5c3460f8770bb1f1210a338'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:44.629837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5089394ed5c3460f8770bb1f1210a338'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:44.718077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1074/2186] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:34:44 2022] DELETE /identity/v3/users/5089394ed5c3460f8770bb1f1210a338 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:44.724371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5618cb-6d8f-4dd5-83a8-77e2284f251a None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:44.724839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5618cb-6d8f-4dd5-83a8-77e2284f251a None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:44.724920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5618cb-6d8f-4dd5-83a8-77e2284f251a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:44.743429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-9c5618cb-6d8f-4dd5-83a8-77e2284f251a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:44.745925 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9c5618cb-6d8f-4dd5-83a8-77e2284f251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:44.826319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1113/2187] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:44.838691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:44.838691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:44.901386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fdd11-1eb3-4bfc-9810-a390ceff2322 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:44.905470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa8c05-93b8-492a-943e-896d20554a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:44.906175 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa8c05-93b8-492a-943e-896d20554a2f service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:44.906502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa8c05-93b8-492a-943e-896d20554a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:44.906809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa8c05-93b8-492a-943e-896d20554a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:44.916615 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa8c05-93b8-492a-943e-896d20554a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:44.918052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa8c05-93b8-492a-943e-896d20554a2f service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:44.935822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1075/2188] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:45.435581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5618cb-6d8f-4dd5-83a8-77e2284f251a None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:45.437872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9c5618cb-6d8f-4dd5-83a8-77e2284f251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:45.455718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5618cb-6d8f-4dd5-83a8-77e2284f251a None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:45.473662 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c462c0b-391a-4770-b727-7048fecfb570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:45.486855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c462c0b-391a-4770-b727-7048fecfb570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:45.487155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c462c0b-391a-4770-b727-7048fecfb570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:45.487506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c462c0b-391a-4770-b727-7048fecfb570 admin admin] PATH_INFO: `/v3/projects/1264f59e53344e5e8c4a5ea8b6133b3e` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:45.488818 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c462c0b-391a-4770-b727-7048fecfb570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1264f59e53344e5e8c4a5ea8b6133b3e)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:45.490911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c462c0b-391a-4770-b727-7048fecfb570 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:45.630555 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2c462c0b-391a-4770-b727-7048fecfb570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1264f59e53344e5e8c4a5ea8b6133b3e', 'request_id': 'req-2c462c0b-391a-4770-b727-7048fecfb570'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:45.637716 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2c462c0b-391a-4770-b727-7048fecfb570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1264f59e53344e5e8c4a5ea8b6133b3e', 'request_id': 'req-2c462c0b-391a-4770-b727-7048fecfb570'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:45.732017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2c462c0b-391a-4770-b727-7048fecfb570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1264f59e53344e5e8c4a5ea8b6133b3e', 'request_id': 'req-2c462c0b-391a-4770-b727-7048fecfb570'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:45.744396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2c462c0b-391a-4770-b727-7048fecfb570 admin admin] The token cache is being invalidate because project 1264f59e53344e5e8c4a5ea8b6133b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:34:45.744698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2c462c0b-391a-4770-b727-7048fecfb570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:45.745420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2c462c0b-391a-4770-b727-7048fecfb570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:45.747037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1114/2189] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:34:45 2022] DELETE /identity/v3/projects/1264f59e53344e5e8c4a5ea8b6133b3e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:45.752231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561c023-9400-4026-bb3c-c311234a330a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:45.752788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561c023-9400-4026-bb3c-c311234a330a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:45.752908 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561c023-9400-4026-bb3c-c311234a330a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:45.775262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1561c023-9400-4026-bb3c-c311234a330a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:45.776604 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1561c023-9400-4026-bb3c-c311234a330a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:45.845169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1076/2190] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:45.854037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7899-5fdd-406c-a37f-af93b0bc1cdd None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:45.854355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7899-5fdd-406c-a37f-af93b0bc1cdd None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:45.854725 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7899-5fdd-406c-a37f-af93b0bc1cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:45.878782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-923a7899-5fdd-406c-a37f-af93b0bc1cdd None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:45.880438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-923a7899-5fdd-406c-a37f-af93b0bc1cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:45.901540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1115/2191] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:45.912217 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561c023-9400-4026-bb3c-c311234a330a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:45.921259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561c023-9400-4026-bb3c-c311234a330a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:45.924187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb6c4c-2d11-46c8-84aa-7ccc13172edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:45.925051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb6c4c-2d11-46c8-84aa-7ccc13172edc admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:45.925536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb6c4c-2d11-46c8-84aa-7ccc13172edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:45.925816 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb6c4c-2d11-46c8-84aa-7ccc13172edc admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:45.926575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb6c4c-2d11-46c8-84aa-7ccc13172edc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:34:45.926883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb6c4c-2d11-46c8-84aa-7ccc13172edc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:45.929794 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb6c4c-2d11-46c8-84aa-7ccc13172edc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:45.944109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1077/2192] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:34:45.948236 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7899-5fdd-406c-a37f-af93b0bc1cdd None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:45.960827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7899-5fdd-406c-a37f-af93b0bc1cdd None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:45.967969 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a46af3-5b3b-4e82-abc7-d82fa5474fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:45.968635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a46af3-5b3b-4e82-abc7-d82fa5474fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:45.969026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a46af3-5b3b-4e82-abc7-d82fa5474fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:45.969442 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a46af3-5b3b-4e82-abc7-d82fa5474fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:45.970314 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a46af3-5b3b-4e82-abc7-d82fa5474fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:45.973839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a46af3-5b3b-4e82-abc7-d82fa5474fcb admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:46.092467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1116/2193] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:34:45 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:46.097118 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb6c4c-2d11-46c8-84aa-7ccc13172edc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:46.117878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb6c4c-2d11-46c8-84aa-7ccc13172edc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:46.213975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b59e32-aea1-43ca-9651-5d9182c76d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:46.215474 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b59e32-aea1-43ca-9651-5d9182c76d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:46.216150 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b59e32-aea1-43ca-9651-5d9182c76d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:46.216473 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b59e32-aea1-43ca-9651-5d9182c76d74 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:46.217579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b59e32-aea1-43ca-9651-5d9182c76d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:46.220121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b59e32-aea1-43ca-9651-5d9182c76d74 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:46.318906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1078/2194] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:34:46 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:34:46.323460 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a46af3-5b3b-4e82-abc7-d82fa5474fcb admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:46.339143 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a46af3-5b3b-4e82-abc7-d82fa5474fcb admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:46.349093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfbdb8-b911-4604-b9a6-965cbcfd74a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:46.350172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfbdb8-b911-4604-b9a6-965cbcfd74a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:46.351254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfbdb8-b911-4604-b9a6-965cbcfd74a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:46.351877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfbdb8-b911-4604-b9a6-965cbcfd74a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:46.353181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfbdb8-b911-4604-b9a6-965cbcfd74a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:46.357397 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfbdb8-b911-4604-b9a6-965cbcfd74a0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:46.377707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1117/2195] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:34:46.379116 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b59e32-aea1-43ca-9651-5d9182c76d74 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:46.419110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b59e32-aea1-43ca-9651-5d9182c76d74 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:46.447165 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476000c-615a-489e-97a0-71109fbd9ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:46.447934 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476000c-615a-489e-97a0-71109fbd9ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:46.448224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476000c-615a-489e-97a0-71109fbd9ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:46.448553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476000c-615a-489e-97a0-71109fbd9ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:46.449275 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476000c-615a-489e-97a0-71109fbd9ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:46.450973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476000c-615a-489e-97a0-71109fbd9ad0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:46.466803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1079/2196] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:46.468005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfbdb8-b911-4604-b9a6-965cbcfd74a0 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:46.480161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfbdb8-b911-4604-b9a6-965cbcfd74a0 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:46.485658 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9cd08-e777-4f29-a115-8b8a135b2899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:46.486937 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9cd08-e777-4f29-a115-8b8a135b2899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:46.487213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9cd08-e777-4f29-a115-8b8a135b2899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:46.487493 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9cd08-e777-4f29-a115-8b8a135b2899 admin admin] PATH_INFO: `/v3/projects/b44f40cfaa094be5a9eb5c9b8ace76e6/users/50ab73740c294e54bf93aa6a8dc206bb/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:46.529703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9cd08-e777-4f29-a115-8b8a135b2899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44f40cfaa094be5a9eb5c9b8ace76e6, user_id=50ab73740c294e54bf93aa6a8dc206bb, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:46.532498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9cd08-e777-4f29-a115-8b8a135b2899 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:46.700444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1118/2197] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:34:46 2022] PUT /identity/v3/projects/b44f40cfaa094be5a9eb5c9b8ace76e6/users/50ab73740c294e54bf93aa6a8dc206bb/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:34:46.705573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6a993-bb9b-4850-9ecc-2a154a0a445b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:46.705940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6a993-bb9b-4850-9ecc-2a154a0a445b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:46.706329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6a993-bb9b-4850-9ecc-2a154a0a445b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:46.730656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-80e6a993-bb9b-4850-9ecc-2a154a0a445b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:46.732332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-80e6a993-bb9b-4850-9ecc-2a154a0a445b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:46.807945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1080/2198] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:34:46.821935 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9cd08-e777-4f29-a115-8b8a135b2899 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:46.824130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d8b9cd08-e777-4f29-a115-8b8a135b2899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:46.893633 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9cd08-e777-4f29-a115-8b8a135b2899 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:46.900656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc85c4-20e7-4b18-9ca3-74b64e114121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:46.901441 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc85c4-20e7-4b18-9ca3-74b64e114121 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:46.901786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc85c4-20e7-4b18-9ca3-74b64e114121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:46.902128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc85c4-20e7-4b18-9ca3-74b64e114121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:46.916240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc85c4-20e7-4b18-9ca3-74b64e114121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:46.917838 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc85c4-20e7-4b18-9ca3-74b64e114121 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:46.931089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1119/2199] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:47.271586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6a993-bb9b-4850-9ecc-2a154a0a445b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:47.273615 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-80e6a993-bb9b-4850-9ecc-2a154a0a445b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:47.285279 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6a993-bb9b-4850-9ecc-2a154a0a445b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:47.290166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:47.291137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:47.291423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:47.291704 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] PATH_INFO: `/v3/users/1991dac63aab41c5a1889a2735edb3c2` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:47.292892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1991dac63aab41c5a1889a2735edb3c2)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:47.294870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:47.688556 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1991dac63aab41c5a1889a2735edb3c2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:47.697126 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1991dac63aab41c5a1889a2735edb3c2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:47.697923 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1991dac63aab41c5a1889a2735edb3c2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:47.698876 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1991dac63aab41c5a1889a2735edb3c2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:47.713970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1991dac63aab41c5a1889a2735edb3c2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:47.840834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1081/2200] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:34:47 2022] DELETE /identity/v3/users/1991dac63aab41c5a1889a2735edb3c2 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:47.845406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9388d-6fc3-4bdf-8bc2-b5106557c4fd None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:47.845854 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9388d-6fc3-4bdf-8bc2-b5106557c4fd None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:47.845972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9388d-6fc3-4bdf-8bc2-b5106557c4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:47.868866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-4fb9388d-6fc3-4bdf-8bc2-b5106557c4fd None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:47.870686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4fb9388d-6fc3-4bdf-8bc2-b5106557c4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:47.944877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1120/2201] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:47.957727 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:47.959737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:48.023555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce9d2b-2317-42ba-aa1a-595672a77a6f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:48.027793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df7cc2-4d45-43f0-ac40-f73e00f3098d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:48.028682 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df7cc2-4d45-43f0-ac40-f73e00f3098d service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:48.029492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df7cc2-4d45-43f0-ac40-f73e00f3098d service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:48.030253 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df7cc2-4d45-43f0-ac40-f73e00f3098d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:48.043190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df7cc2-4d45-43f0-ac40-f73e00f3098d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:48.044663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df7cc2-4d45-43f0-ac40-f73e00f3098d service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:48.055709 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1082/2202] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:48.567643 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9388d-6fc3-4bdf-8bc2-b5106557c4fd None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:48.569079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4fb9388d-6fc3-4bdf-8bc2-b5106557c4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:48.582015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9388d-6fc3-4bdf-8bc2-b5106557c4fd None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:48.587128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:48.587999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:48.588279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:48.588551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] PATH_INFO: `/v3/projects/3dc95aa59f3b4ea1b0b8ba25a30ff48c` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:48.589860 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc95aa59f3b4ea1b0b8ba25a30ff48c)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:48.591852 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:48.789180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc95aa59f3b4ea1b0b8ba25a30ff48c', 'request_id': 'req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:48.802903 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc95aa59f3b4ea1b0b8ba25a30ff48c', 'request_id': 'req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:48.865799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc95aa59f3b4ea1b0b8ba25a30ff48c', 'request_id': 'req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:48.887028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] The token cache is being invalidate because project 3dc95aa59f3b4ea1b0b8ba25a30ff48c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:34:48.887028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:48.887226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:48.889079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1121/2203] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:34:48 2022] DELETE /identity/v3/projects/3dc95aa59f3b4ea1b0b8ba25a30ff48c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:48.893008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df7cc2-4d45-43f0-ac40-f73e00f3098d service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:48.904644 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df7cc2-4d45-43f0-ac40-f73e00f3098d service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:48.963332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71936b2-54f5-4134-8428-d1bbe5a8a792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:48.963891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71936b2-54f5-4134-8428-d1bbe5a8a792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:48.964391 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71936b2-54f5-4134-8428-d1bbe5a8a792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:48.964757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71936b2-54f5-4134-8428-d1bbe5a8a792 admin admin] PATH_INFO: `/v3/users/57041b4a76d147258fcfa23e9e9298d4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:48.967453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71936b2-54f5-4134-8428-d1bbe5a8a792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57041b4a76d147258fcfa23e9e9298d4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:48.969407 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71936b2-54f5-4134-8428-d1bbe5a8a792 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:49.302760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d71936b2-54f5-4134-8428-d1bbe5a8a792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57041b4a76d147258fcfa23e9e9298d4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:49.309971 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d71936b2-54f5-4134-8428-d1bbe5a8a792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57041b4a76d147258fcfa23e9e9298d4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:49.310682 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d71936b2-54f5-4134-8428-d1bbe5a8a792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57041b4a76d147258fcfa23e9e9298d4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:49.311316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d71936b2-54f5-4134-8428-d1bbe5a8a792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57041b4a76d147258fcfa23e9e9298d4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:49.323464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d71936b2-54f5-4134-8428-d1bbe5a8a792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57041b4a76d147258fcfa23e9e9298d4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:49.412497 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1083/2204] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:34:48 2022] DELETE /identity/v3/users/57041b4a76d147258fcfa23e9e9298d4 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:34:50.098516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:50.102225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:50.127309 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56b400-fa3e-4cd7-b4fb-d55b48680d1d admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:50.233764 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb12c8-cf64-44a7-891b-01008877dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:50.238836 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb12c8-cf64-44a7-891b-01008877dd28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:50.239476 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb12c8-cf64-44a7-891b-01008877dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:50.239960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb12c8-cf64-44a7-891b-01008877dd28 admin admin] PATH_INFO: `/v3/projects/69d6f2ce81b34ee49e2d7898e052ab17` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:50.242383 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb12c8-cf64-44a7-891b-01008877dd28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d6f2ce81b34ee49e2d7898e052ab17)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:50.244654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb12c8-cf64-44a7-891b-01008877dd28 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:50.408944 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8cfb12c8-cf64-44a7-891b-01008877dd28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d6f2ce81b34ee49e2d7898e052ab17', 'request_id': 'req-8cfb12c8-cf64-44a7-891b-01008877dd28'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:50.425589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8cfb12c8-cf64-44a7-891b-01008877dd28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d6f2ce81b34ee49e2d7898e052ab17', 'request_id': 'req-8cfb12c8-cf64-44a7-891b-01008877dd28'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:50.507223 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8cfb12c8-cf64-44a7-891b-01008877dd28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d6f2ce81b34ee49e2d7898e052ab17', 'request_id': 'req-8cfb12c8-cf64-44a7-891b-01008877dd28'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:50.523186 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8cfb12c8-cf64-44a7-891b-01008877dd28 admin admin] The token cache is being invalidate because project 69d6f2ce81b34ee49e2d7898e052ab17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:34:50.523742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8cfb12c8-cf64-44a7-891b-01008877dd28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:50.524619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8cfb12c8-cf64-44a7-891b-01008877dd28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:50.526575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1122/2205] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:34:50 2022] DELETE /identity/v3/projects/69d6f2ce81b34ee49e2d7898e052ab17 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:50.531823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ced61-68db-4634-a042-5da92c4c041e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:50.532398 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ced61-68db-4634-a042-5da92c4c041e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:50.532398 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ced61-68db-4634-a042-5da92c4c041e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:50.556394 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-002ced61-68db-4634-a042-5da92c4c041e None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:50.559355 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-002ced61-68db-4634-a042-5da92c4c041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:50.649299 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1084/2206] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:50.657143 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e27df5-a2c6-4846-8379-860ee2d6febc None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:50.657790 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e27df5-a2c6-4846-8379-860ee2d6febc None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:50.658302 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e27df5-a2c6-4846-8379-860ee2d6febc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:50.704480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-36e27df5-a2c6-4846-8379-860ee2d6febc None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:50.706676 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-36e27df5-a2c6-4846-8379-860ee2d6febc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:50.724513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1123/2207] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:34:50.737053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ced61-68db-4634-a042-5da92c4c041e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:50.748975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ced61-68db-4634-a042-5da92c4c041e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:50.759359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56d1f9-4d31-4d58-aab5-31f84b07a90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:50.760658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56d1f9-4d31-4d58-aab5-31f84b07a90b admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:50.761120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56d1f9-4d31-4d58-aab5-31f84b07a90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:50.761733 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56d1f9-4d31-4d58-aab5-31f84b07a90b admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:50.764739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56d1f9-4d31-4d58-aab5-31f84b07a90b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:34:50.765574 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56d1f9-4d31-4d58-aab5-31f84b07a90b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:50.767531 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56d1f9-4d31-4d58-aab5-31f84b07a90b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:50.784301 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1085/2208] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:34:50.791158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e27df5-a2c6-4846-8379-860ee2d6febc None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:50.806766 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e27df5-a2c6-4846-8379-860ee2d6febc None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:50.829855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d3208-b914-43f3-8c17-957f8c286ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:50.831355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d3208-b914-43f3-8c17-957f8c286ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:50.832039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d3208-b914-43f3-8c17-957f8c286ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:50.832384 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d3208-b914-43f3-8c17-957f8c286ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:50.833230 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d3208-b914-43f3-8c17-957f8c286ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:50.837334 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d3208-b914-43f3-8c17-957f8c286ad6 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:50.941469 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1124/2209] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:34:50 2022] POST /identity/v3/projects => generated 363 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:50.945861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56d1f9-4d31-4d58-aab5-31f84b07a90b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:50.971448 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56d1f9-4d31-4d58-aab5-31f84b07a90b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:51.062640 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a4eea-78af-4dca-af8e-7880b893163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:51.063603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a4eea-78af-4dca-af8e-7880b893163f admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.064101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a4eea-78af-4dca-af8e-7880b893163f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.064590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a4eea-78af-4dca-af8e-7880b893163f admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.065495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a4eea-78af-4dca-af8e-7880b893163f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:51.067815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a4eea-78af-4dca-af8e-7880b893163f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:51.197777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1086/2210] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:34:50 2022] POST /identity/v3/users => generated 282 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:51.201952 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d3208-b914-43f3-8c17-957f8c286ad6 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:51.217895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d3208-b914-43f3-8c17-957f8c286ad6 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:51.229050 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51ec08-53d7-4b51-8140-af33d635b85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:51.229793 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51ec08-53d7-4b51-8140-af33d635b85f admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.230430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51ec08-53d7-4b51-8140-af33d635b85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.230525 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51ec08-53d7-4b51-8140-af33d635b85f admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.231198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51ec08-53d7-4b51-8140-af33d635b85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:51.233087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51ec08-53d7-4b51-8140-af33d635b85f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:51.257857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1125/2211] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:51.261911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a4eea-78af-4dca-af8e-7880b893163f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:51.272005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a4eea-78af-4dca-af8e-7880b893163f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:51.280552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4b964-23b3-4053-8980-b3d2a14903f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:51.281470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4b964-23b3-4053-8980-b3d2a14903f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.281935 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4b964-23b3-4053-8980-b3d2a14903f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.282416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4b964-23b3-4053-8980-b3d2a14903f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.283545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4b964-23b3-4053-8980-b3d2a14903f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:51.285347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4b964-23b3-4053-8980-b3d2a14903f3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:51.297111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1087/2212] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:51.308578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51ec08-53d7-4b51-8140-af33d635b85f admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:51.342990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51ec08-53d7-4b51-8140-af33d635b85f admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:51.347868 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbe1e2-6ca9-46c9-abab-b069ef43fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:51.348760 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbe1e2-6ca9-46c9-abab-b069ef43fdc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.349065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbe1e2-6ca9-46c9-abab-b069ef43fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.349345 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbe1e2-6ca9-46c9-abab-b069ef43fdc8 admin admin] PATH_INFO: `/v3/projects/52bce0981dea4c01a956e3b80223a92c/users/65e1a14acc60433eb2a902dd37f3078d/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.369750 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbe1e2-6ca9-46c9-abab-b069ef43fdc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bce0981dea4c01a956e3b80223a92c, user_id=65e1a14acc60433eb2a902dd37f3078d, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:51.372513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbe1e2-6ca9-46c9-abab-b069ef43fdc8 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:51.472940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1126/2213] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:34:51 2022] PUT /identity/v3/projects/52bce0981dea4c01a956e3b80223a92c/users/65e1a14acc60433eb2a902dd37f3078d/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:51.483755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b00ab4-73d7-4d55-bb85-8c18cc5fec61 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.484049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b00ab4-73d7-4d55-bb85-8c18cc5fec61 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.484352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b00ab4-73d7-4d55-bb85-8c18cc5fec61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.511453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-44b00ab4-73d7-4d55-bb85-8c18cc5fec61 None None] MFA Rules not processed for user `65e1a14acc60433eb2a902dd37f3078d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:51.512675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-44b00ab4-73d7-4d55-bb85-8c18cc5fec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:51.580131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1088/2214] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:51.584605 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbe1e2-6ca9-46c9-abab-b069ef43fdc8 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:51.656332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbe1e2-6ca9-46c9-abab-b069ef43fdc8 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:51.661741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fe641-5933-4902-a4d1-b80685f0634a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:51.662949 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fe641-5933-4902-a4d1-b80685f0634a admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.663424 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fe641-5933-4902-a4d1-b80685f0634a admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.664087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fe641-5933-4902-a4d1-b80685f0634a admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.665026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fe641-5933-4902-a4d1-b80685f0634a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:51.667266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fe641-5933-4902-a4d1-b80685f0634a admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:51.779091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1127/2215] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:34:51 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:51.785145 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b00ab4-73d7-4d55-bb85-8c18cc5fec61 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:51.796765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b00ab4-73d7-4d55-bb85-8c18cc5fec61 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:51.935533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d1c3-adca-4e1e-ad75-7db5f69cf0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:51.936381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d1c3-adca-4e1e-ad75-7db5f69cf0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.936660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d1c3-adca-4e1e-ad75-7db5f69cf0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.936955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d1c3-adca-4e1e-ad75-7db5f69cf0d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.939767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53d1c3-adca-4e1e-ad75-7db5f69cf0d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:51.941729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53d1c3-adca-4e1e-ad75-7db5f69cf0d1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:52.067405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1089/2216] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:34:51 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:52.072479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fe641-5933-4902-a4d1-b80685f0634a admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:52.083207 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fe641-5933-4902-a4d1-b80685f0634a admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:52.094208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc2638-d503-420d-bb39-ab9d0dbc2c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:52.097308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc2638-d503-420d-bb39-ab9d0dbc2c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:52.097308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc2638-d503-420d-bb39-ab9d0dbc2c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:52.097308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc2638-d503-420d-bb39-ab9d0dbc2c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:52.097308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc2638-d503-420d-bb39-ab9d0dbc2c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:52.098599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc2638-d503-420d-bb39-ab9d0dbc2c57 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:52.127892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1128/2217] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:52.133506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d1c3-adca-4e1e-ad75-7db5f69cf0d1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:52.146760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d1c3-adca-4e1e-ad75-7db5f69cf0d1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:52.153282 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5f44-f5ab-4e2e-8d66-e9e482fd4744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:52.154440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5f44-f5ab-4e2e-8d66-e9e482fd4744 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:52.155877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5f44-f5ab-4e2e-8d66-e9e482fd4744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:52.156950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5f44-f5ab-4e2e-8d66-e9e482fd4744 admin admin] PATH_INFO: `/v3/projects/9a6790b86e8c4bc0953bf02bce7d64d4/users/72ba98c2722d4e78a67a8c2a3e84badc/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:52.189366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd5f44-f5ab-4e2e-8d66-e9e482fd4744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6790b86e8c4bc0953bf02bce7d64d4, user_id=72ba98c2722d4e78a67a8c2a3e84badc, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:52.193737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd5f44-f5ab-4e2e-8d66-e9e482fd4744 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:52.296848 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1090/2218] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:34:52 2022] PUT /identity/v3/projects/9a6790b86e8c4bc0953bf02bce7d64d4/users/72ba98c2722d4e78a67a8c2a3e84badc/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:34:52.300588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc2638-d503-420d-bb39-ab9d0dbc2c57 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:52.312498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc2638-d503-420d-bb39-ab9d0dbc2c57 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:52.390028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df85f0-2b38-4eee-90b3-2a8e175641f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:52.390820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df85f0-2b38-4eee-90b3-2a8e175641f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:52.391114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df85f0-2b38-4eee-90b3-2a8e175641f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:52.391397 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df85f0-2b38-4eee-90b3-2a8e175641f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:52.400951 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df85f0-2b38-4eee-90b3-2a8e175641f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:52.402656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df85f0-2b38-4eee-90b3-2a8e175641f7 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:52.424119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1129/2219] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:52.430533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5f44-f5ab-4e2e-8d66-e9e482fd4744 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:52.437474 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5f44-f5ab-4e2e-8d66-e9e482fd4744 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:52.443120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ae6ac-1be6-4c66-93ef-325786a19a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:52.443676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ae6ac-1be6-4c66-93ef-325786a19a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:52.444055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ae6ac-1be6-4c66-93ef-325786a19a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:52.445099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ae6ac-1be6-4c66-93ef-325786a19a90 admin admin] PATH_INFO: `/v3/projects/9a6790b86e8c4bc0953bf02bce7d64d4/users/72ba98c2722d4e78a67a8c2a3e84badc/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:52.447415 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ae6ac-1be6-4c66-93ef-325786a19a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6790b86e8c4bc0953bf02bce7d64d4, user_id=72ba98c2722d4e78a67a8c2a3e84badc, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:52.450694 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ae6ac-1be6-4c66-93ef-325786a19a90 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:52.463217 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1091/2220] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:34:52 2022] PUT /identity/v3/projects/9a6790b86e8c4bc0953bf02bce7d64d4/users/72ba98c2722d4e78a67a8c2a3e84badc/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:52.473558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902e304-dced-43ab-ae15-a2ed2045b92f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:52.473852 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902e304-dced-43ab-ae15-a2ed2045b92f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:52.474130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902e304-dced-43ab-ae15-a2ed2045b92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:52.525201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-1902e304-dced-43ab-ae15-a2ed2045b92f None None] MFA Rules not processed for user `72ba98c2722d4e78a67a8c2a3e84badc`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:52.526941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1902e304-dced-43ab-ae15-a2ed2045b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:52.641527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1130/2221] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:52.654025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ae6ac-1be6-4c66-93ef-325786a19a90 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:52.655951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e66ae6ac-1be6-4c66-93ef-325786a19a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:52.721107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ae6ac-1be6-4c66-93ef-325786a19a90 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:52.724731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb6ef1-6785-4629-a2d8-1ec5e3f8907c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:52.725372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb6ef1-6785-4629-a2d8-1ec5e3f8907c service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:52.726394 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb6ef1-6785-4629-a2d8-1ec5e3f8907c service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:52.726759 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb6ef1-6785-4629-a2d8-1ec5e3f8907c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:52.736166 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb6ef1-6785-4629-a2d8-1ec5e3f8907c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:52.737601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb6ef1-6785-4629-a2d8-1ec5e3f8907c service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:52.747723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1092/2222] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:53.034985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902e304-dced-43ab-ae15-a2ed2045b92f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:53.047100 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902e304-dced-43ab-ae15-a2ed2045b92f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:53.050930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703cb6c-c878-4685-8ee5-25fa7b437315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:53.051589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703cb6c-c878-4685-8ee5-25fa7b437315 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:53.051880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703cb6c-c878-4685-8ee5-25fa7b437315 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:53.052164 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703cb6c-c878-4685-8ee5-25fa7b437315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:53.114276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703cb6c-c878-4685-8ee5-25fa7b437315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:53.116601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703cb6c-c878-4685-8ee5-25fa7b437315 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:53.129753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1131/2223] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:53 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:54.315993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2e01-1139-4861-b803-f51e1561cb1b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:54.315993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2e01-1139-4861-b803-f51e1561cb1b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:54.315993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2e01-1139-4861-b803-f51e1561cb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:54.349416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fe6e2e01-1139-4861-b803-f51e1561cb1b None None] MFA Rules not processed for user `50ab73740c294e54bf93aa6a8dc206bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:54.350710 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fe6e2e01-1139-4861-b803-f51e1561cb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:54.417658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1093/2224] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:54.422262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703cb6c-c878-4685-8ee5-25fa7b437315 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:54.423777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4703cb6c-c878-4685-8ee5-25fa7b437315 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:54.500161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703cb6c-c878-4685-8ee5-25fa7b437315 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:54.504850 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4a3c8-a99d-4a86-897b-195f39ba456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:54.505639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4a3c8-a99d-4a86-897b-195f39ba456c admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:54.505929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4a3c8-a99d-4a86-897b-195f39ba456c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:54.506209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4a3c8-a99d-4a86-897b-195f39ba456c admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:54.507514 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4a3c8-a99d-4a86-897b-195f39ba456c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:54.509436 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4a3c8-a99d-4a86-897b-195f39ba456c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:54.612844 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1132/2225] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:34:54 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:34:54.613172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e2e01-1139-4861-b803-f51e1561cb1b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:54.613172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e2e01-1139-4861-b803-f51e1561cb1b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:54.674752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d1c00-01d8-47fd-bf3e-d0c98f967c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:54.675898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d1c00-01d8-47fd-bf3e-d0c98f967c7a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:54.676177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d1c00-01d8-47fd-bf3e-d0c98f967c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:54.676805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d1c00-01d8-47fd-bf3e-d0c98f967c7a admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:54.678203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d1c00-01d8-47fd-bf3e-d0c98f967c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:54.680760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d1c00-01d8-47fd-bf3e-d0c98f967c7a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:54.785586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1094/2226] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:34:54 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:34:54.792081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4a3c8-a99d-4a86-897b-195f39ba456c admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:54.823493 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4a3c8-a99d-4a86-897b-195f39ba456c admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:54.837699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed2650-b632-4816-8726-e40d6c869ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:54.838479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed2650-b632-4816-8726-e40d6c869ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:54.838762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed2650-b632-4816-8726-e40d6c869ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:54.839096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed2650-b632-4816-8726-e40d6c869ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:54.840077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed2650-b632-4816-8726-e40d6c869ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:54.842383 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed2650-b632-4816-8726-e40d6c869ec4 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:54.876823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1133/2227] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:34:54.877322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d1c00-01d8-47fd-bf3e-d0c98f967c7a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:54.890170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d1c00-01d8-47fd-bf3e-d0c98f967c7a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:54.895758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2069e5-b35d-43cc-ab9e-848253790474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:54.897264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2069e5-b35d-43cc-ab9e-848253790474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:54.898592 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2069e5-b35d-43cc-ab9e-848253790474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:54.899126 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2069e5-b35d-43cc-ab9e-848253790474 admin admin] PATH_INFO: `/v3/projects/fe64406f10a640fd8fb7413d3f431a11/users/dbd9eb4255764402a5306895dd1f2dde/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:54.920533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2069e5-b35d-43cc-ab9e-848253790474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe64406f10a640fd8fb7413d3f431a11, user_id=dbd9eb4255764402a5306895dd1f2dde, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:54.923443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2069e5-b35d-43cc-ab9e-848253790474 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:54.957126 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7afba9-908d-4dc7-9f84-e79f51564864 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:54.957649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7afba9-908d-4dc7-9f84-e79f51564864 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:54.958009 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7afba9-908d-4dc7-9f84-e79f51564864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:55.012105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ca7afba9-908d-4dc7-9f84-e79f51564864 None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:55.016106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ca7afba9-908d-4dc7-9f84-e79f51564864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:55.039425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1095/2228] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:34:54 2022] PUT /identity/v3/projects/fe64406f10a640fd8fb7413d3f431a11/users/dbd9eb4255764402a5306895dd1f2dde/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:55.040349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2069e5-b35d-43cc-ab9e-848253790474 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:55.147128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2069e5-b35d-43cc-ab9e-848253790474 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:55.166515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f31330-7665-4f6c-95c1-0d0ee4e5aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:55.167214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f31330-7665-4f6c-95c1-0d0ee4e5aadf admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:55.167504 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f31330-7665-4f6c-95c1-0d0ee4e5aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:55.167836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f31330-7665-4f6c-95c1-0d0ee4e5aadf admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:55.168588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f31330-7665-4f6c-95c1-0d0ee4e5aadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:55.170945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f31330-7665-4f6c-95c1-0d0ee4e5aadf admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:55.198229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1134/2229] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:34:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:55.221438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7afba9-908d-4dc7-9f84-e79f51564864 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:55.223255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1096/2230] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:34:55.258559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f31330-7665-4f6c-95c1-0d0ee4e5aadf admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:55.260713 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-08f31330-7665-4f6c-95c1-0d0ee4e5aadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:55.261929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7afba9-908d-4dc7-9f84-e79f51564864 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:55.290805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b7760-4ba6-4e01-b622-b07a1d6e7365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:55.291793 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b7760-4ba6-4e01-b622-b07a1d6e7365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:55.292137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b7760-4ba6-4e01-b622-b07a1d6e7365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:55.292417 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b7760-4ba6-4e01-b622-b07a1d6e7365 admin admin] PATH_INFO: `/v3/projects/fe64406f10a640fd8fb7413d3f431a11/users/dbd9eb4255764402a5306895dd1f2dde/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:55.302001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b7760-4ba6-4e01-b622-b07a1d6e7365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe64406f10a640fd8fb7413d3f431a11, user_id=dbd9eb4255764402a5306895dd1f2dde, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:55.308655 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b7760-4ba6-4e01-b622-b07a1d6e7365 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:55.337187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1135/2231] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:34:55 2022] PUT /identity/v3/projects/fe64406f10a640fd8fb7413d3f431a11/users/dbd9eb4255764402a5306895dd1f2dde/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:34:55.394573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f31330-7665-4f6c-95c1-0d0ee4e5aadf admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:55.487822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac489-6408-4947-bc12-e0529a71cdfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:55.488796 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac489-6408-4947-bc12-e0529a71cdfb service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:55.489288 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac489-6408-4947-bc12-e0529a71cdfb service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:55.489637 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac489-6408-4947-bc12-e0529a71cdfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:55.557402 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cac489-6408-4947-bc12-e0529a71cdfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:55.559082 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cac489-6408-4947-bc12-e0529a71cdfb service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:55.568697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1097/2232] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:34:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:34:57.793051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b7760-4ba6-4e01-b622-b07a1d6e7365 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:57.990031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b7760-4ba6-4e01-b622-b07a1d6e7365 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:58.002319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:58.003680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:58.004131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:58.004561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] PATH_INFO: `/v3/users/65e1a14acc60433eb2a902dd37f3078d` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:58.006345 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e1a14acc60433eb2a902dd37f3078d)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:58.010007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:58.313906 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e1a14acc60433eb2a902dd37f3078d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:58.387124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e1a14acc60433eb2a902dd37f3078d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:58.524295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e1a14acc60433eb2a902dd37f3078d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:58.524947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e1a14acc60433eb2a902dd37f3078d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:58.555023 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e1a14acc60433eb2a902dd37f3078d'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:34:58.574578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1136/2233] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:34:57 2022] DELETE /identity/v3/users/65e1a14acc60433eb2a902dd37f3078d => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:34:58.577173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea01060-bc9e-48e8-9d15-79577a370fe8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:58.577701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea01060-bc9e-48e8-9d15-79577a370fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:58.577925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea01060-bc9e-48e8-9d15-79577a370fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:58.614969 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bea01060-bc9e-48e8-9d15-79577a370fe8 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:58.617990 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bea01060-bc9e-48e8-9d15-79577a370fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:58.736701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1098/2234] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:58.745826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:58.747735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:58.876953 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f01a82-5cbb-4ede-b70e-20339683a3fd admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:58.886395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b3da2-37a7-4a51-9b4a-37ba548da40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:58.887078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b3da2-37a7-4a51-9b4a-37ba548da40c service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:58.887362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b3da2-37a7-4a51-9b4a-37ba548da40c service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:58.887748 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b3da2-37a7-4a51-9b4a-37ba548da40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:58.901063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b3da2-37a7-4a51-9b4a-37ba548da40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:58.902647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b3da2-37a7-4a51-9b4a-37ba548da40c service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:58.917722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1137/2235] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:59.775803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea01060-bc9e-48e8-9d15-79577a370fe8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:59.778809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bea01060-bc9e-48e8-9d15-79577a370fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:59.801760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea01060-bc9e-48e8-9d15-79577a370fe8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:59.822622 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:59.824021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:59.824458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:59.824894 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] PATH_INFO: `/v3/projects/52bce0981dea4c01a956e3b80223a92c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:59.826435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=52bce0981dea4c01a956e3b80223a92c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:59.828726 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:59.990689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52bce0981dea4c01a956e3b80223a92c', 'request_id': 'req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:00.008028 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52bce0981dea4c01a956e3b80223a92c', 'request_id': 'req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:00.129749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52bce0981dea4c01a956e3b80223a92c', 'request_id': 'req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:00.151230 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] The token cache is being invalidate because project 52bce0981dea4c01a956e3b80223a92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:00.151638 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:00.152293 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:00.159170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1099/2236] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:34:59 2022] DELETE /identity/v3/projects/52bce0981dea4c01a956e3b80223a92c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:00.165930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b3da2-37a7-4a51-9b4a-37ba548da40c service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:00.200533 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b3da2-37a7-4a51-9b4a-37ba548da40c service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:00.295806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:00.296763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:00.297196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:00.297644 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] PATH_INFO: `/v3/users/72ba98c2722d4e78a67a8c2a3e84badc` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:00.299133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ba98c2722d4e78a67a8c2a3e84badc)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:00.305783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:00.591535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ba98c2722d4e78a67a8c2a3e84badc'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:00.640813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ba98c2722d4e78a67a8c2a3e84badc'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:00.737042 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ba98c2722d4e78a67a8c2a3e84badc'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:00.737815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ba98c2722d4e78a67a8c2a3e84badc'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:00.778465 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ba98c2722d4e78a67a8c2a3e84badc'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:00.810339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1138/2237] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:35:00 2022] DELETE /identity/v3/users/72ba98c2722d4e78a67a8c2a3e84badc => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:01.532309 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:01.533863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:01.556115 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566933e6-eac8-4ea8-92cf-75cbf97a1fcd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:01.714517 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443e71e-e733-4eda-8c2b-f3d0b26118c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:01.715468 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443e71e-e733-4eda-8c2b-f3d0b26118c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:01.715926 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443e71e-e733-4eda-8c2b-f3d0b26118c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:01.716217 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443e71e-e733-4eda-8c2b-f3d0b26118c6 admin admin] PATH_INFO: `/v3/users/1aa74f42c9b346ec943b21feaaa572b9` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:01.717457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443e71e-e733-4eda-8c2b-f3d0b26118c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa74f42c9b346ec943b21feaaa572b9)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:01.719563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443e71e-e733-4eda-8c2b-f3d0b26118c6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:01.789618 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:01.791696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:01.835626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc056b28-5c1f-4199-9ba3-001cf93a48b9 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:01.854564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7df23-8bf2-4919-ae6f-7f219300e31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:01.855402 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7df23-8bf2-4919-ae6f-7f219300e31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:01.855726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7df23-8bf2-4919-ae6f-7f219300e31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:01.859927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7df23-8bf2-4919-ae6f-7f219300e31c admin admin] PATH_INFO: `/v3/projects/9a6790b86e8c4bc0953bf02bce7d64d4` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:01.866712 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7df23-8bf2-4919-ae6f-7f219300e31c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6790b86e8c4bc0953bf02bce7d64d4)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:01.868826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7df23-8bf2-4919-ae6f-7f219300e31c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:02.026981 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1eb7df23-8bf2-4919-ae6f-7f219300e31c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6790b86e8c4bc0953bf02bce7d64d4', 'request_id': 'req-1eb7df23-8bf2-4919-ae6f-7f219300e31c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:02.039244 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1eb7df23-8bf2-4919-ae6f-7f219300e31c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6790b86e8c4bc0953bf02bce7d64d4', 'request_id': 'req-1eb7df23-8bf2-4919-ae6f-7f219300e31c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:02.058076 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6443e71e-e733-4eda-8c2b-f3d0b26118c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa74f42c9b346ec943b21feaaa572b9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:02.083824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6443e71e-e733-4eda-8c2b-f3d0b26118c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa74f42c9b346ec943b21feaaa572b9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:02.092289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6443e71e-e733-4eda-8c2b-f3d0b26118c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa74f42c9b346ec943b21feaaa572b9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:02.095932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6443e71e-e733-4eda-8c2b-f3d0b26118c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa74f42c9b346ec943b21feaaa572b9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:02.106817 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1eb7df23-8bf2-4919-ae6f-7f219300e31c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6790b86e8c4bc0953bf02bce7d64d4', 'request_id': 'req-1eb7df23-8bf2-4919-ae6f-7f219300e31c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:02.123899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1eb7df23-8bf2-4919-ae6f-7f219300e31c admin admin] The token cache is being invalidate because project 9a6790b86e8c4bc0953bf02bce7d64d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:02.128520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1eb7df23-8bf2-4919-ae6f-7f219300e31c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:02.130249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1eb7df23-8bf2-4919-ae6f-7f219300e31c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:02.134860 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1139/2238] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:35:01 2022] DELETE /identity/v3/projects/9a6790b86e8c4bc0953bf02bce7d64d4 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:02.144575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6106151-5742-442f-91f4-6fc6c8c5eefa None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:02.144870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6106151-5742-442f-91f4-6fc6c8c5eefa None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:02.145016 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6443e71e-e733-4eda-8c2b-f3d0b26118c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa74f42c9b346ec943b21feaaa572b9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:02.153460 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6106151-5742-442f-91f4-6fc6c8c5eefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:02.266565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1100/2239] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:35:01 2022] DELETE /identity/v3/users/1aa74f42c9b346ec943b21feaaa572b9 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:02.273489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399baf75-f329-4077-878a-3655fcf5787e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:02.274011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399baf75-f329-4077-878a-3655fcf5787e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:02.274998 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399baf75-f329-4077-878a-3655fcf5787e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:02.275481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-f6106151-5742-442f-91f4-6fc6c8c5eefa None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:02.279527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-f6106151-5742-442f-91f4-6fc6c8c5eefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:02.340073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-399baf75-f329-4077-878a-3655fcf5787e None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:02.342207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-399baf75-f329-4077-878a-3655fcf5787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:02.468690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1140/2240] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:02.477357 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d59837-d8e2-49b5-962f-e4eba5517c5c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:02.478478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d59837-d8e2-49b5-962f-e4eba5517c5c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:02.478976 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d59837-d8e2-49b5-962f-e4eba5517c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:02.528595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-26d59837-d8e2-49b5-962f-e4eba5517c5c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:02.530675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-26d59837-d8e2-49b5-962f-e4eba5517c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:02.549960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1141/2241] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:02.553071 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1101/2242] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:02.554648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d59837-d8e2-49b5-962f-e4eba5517c5c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:02.568201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399baf75-f329-4077-878a-3655fcf5787e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:02.569965 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-399baf75-f329-4077-878a-3655fcf5787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:02.578775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d59837-d8e2-49b5-962f-e4eba5517c5c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:02.606012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f3274-3f4c-47fe-b7b6-169eedf7e004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:02.606012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f3274-3f4c-47fe-b7b6-169eedf7e004 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:02.606012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f3274-3f4c-47fe-b7b6-169eedf7e004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:02.606012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f3274-3f4c-47fe-b7b6-169eedf7e004 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:02.606671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f3274-3f4c-47fe-b7b6-169eedf7e004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:35:02.606671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f3274-3f4c-47fe-b7b6-169eedf7e004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:02.608172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f3274-3f4c-47fe-b7b6-169eedf7e004 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:02.634254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1142/2243] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:35:02.636200 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f3274-3f4c-47fe-b7b6-169eedf7e004 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:02.656858 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f3274-3f4c-47fe-b7b6-169eedf7e004 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:02.662341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffff388-5f0d-4d10-849d-bac4761e9473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:02.663176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffff388-5f0d-4d10-849d-bac4761e9473 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:02.664388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffff388-5f0d-4d10-849d-bac4761e9473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:02.664769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffff388-5f0d-4d10-849d-bac4761e9473 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:02.665548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffff388-5f0d-4d10-849d-bac4761e9473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:02.667783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffff388-5f0d-4d10-849d-bac4761e9473 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:02.684027 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399baf75-f329-4077-878a-3655fcf5787e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:02.695431 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e43895-4ee2-4a12-a7c1-71d4ca96c261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:02.697093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43895-4ee2-4a12-a7c1-71d4ca96c261 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:02.697535 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43895-4ee2-4a12-a7c1-71d4ca96c261 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:02.697968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43895-4ee2-4a12-a7c1-71d4ca96c261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:02.711787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e43895-4ee2-4a12-a7c1-71d4ca96c261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:02.713769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e43895-4ee2-4a12-a7c1-71d4ca96c261 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:02.728268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1102/2244] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:02.771563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1143/2245] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:02 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:02.773266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e43895-4ee2-4a12-a7c1-71d4ca96c261 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:02.803888 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e43895-4ee2-4a12-a7c1-71d4ca96c261 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:02.968277 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13a39c-f7c5-41fe-81f8-1bbd54da623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:02.968988 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13a39c-f7c5-41fe-81f8-1bbd54da623c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:02.969108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13a39c-f7c5-41fe-81f8-1bbd54da623c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:02.969297 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13a39c-f7c5-41fe-81f8-1bbd54da623c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:02.970000 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13a39c-f7c5-41fe-81f8-1bbd54da623c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:02.972131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13a39c-f7c5-41fe-81f8-1bbd54da623c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:03.115593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1103/2246] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:02 2022] POST /identity/v3/users => generated 285 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:03.121456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffff388-5f0d-4d10-849d-bac4761e9473 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:03.140724 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffff388-5f0d-4d10-849d-bac4761e9473 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:03.154622 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098a36b-846b-45e5-9137-a05f366d7122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:03.155602 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098a36b-846b-45e5-9137-a05f366d7122 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:03.157204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098a36b-846b-45e5-9137-a05f366d7122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:03.157726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098a36b-846b-45e5-9137-a05f366d7122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:03.158757 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098a36b-846b-45e5-9137-a05f366d7122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:03.168037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098a36b-846b-45e5-9137-a05f366d7122 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:03.199269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1144/2247] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:03.202964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13a39c-f7c5-41fe-81f8-1bbd54da623c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:03.225158 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13a39c-f7c5-41fe-81f8-1bbd54da623c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:03.242411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f4db5-bab7-49eb-96c4-fcf6586339d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:03.243753 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f4db5-bab7-49eb-96c4-fcf6586339d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:03.244012 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f4db5-bab7-49eb-96c4-fcf6586339d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:03.244291 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f4db5-bab7-49eb-96c4-fcf6586339d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:03.245030 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f4db5-bab7-49eb-96c4-fcf6586339d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:03.246722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f4db5-bab7-49eb-96c4-fcf6586339d5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:03.294516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098a36b-846b-45e5-9137-a05f366d7122 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:03.294825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1104/2248] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:03.312814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098a36b-846b-45e5-9137-a05f366d7122 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:03.343970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bfbee-2686-481d-b02d-91f0c18ff2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:03.344893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bfbee-2686-481d-b02d-91f0c18ff2de admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:03.345180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bfbee-2686-481d-b02d-91f0c18ff2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:03.345461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bfbee-2686-481d-b02d-91f0c18ff2de admin admin] PATH_INFO: `/v3/projects/50147971488c4a44a092cc7b3010f9c6/users/4ed0f3a5fe6d468692ac7eff90f47745/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:03.378069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bfbee-2686-481d-b02d-91f0c18ff2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=50147971488c4a44a092cc7b3010f9c6, user_id=4ed0f3a5fe6d468692ac7eff90f47745, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:03.380886 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bfbee-2686-481d-b02d-91f0c18ff2de admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:03.478633 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1145/2249] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:03 2022] PUT /identity/v3/projects/50147971488c4a44a092cc7b3010f9c6/users/4ed0f3a5fe6d468692ac7eff90f47745/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:35:03.482053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7848248-ca43-4b08-8d93-bcd94b399c9e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:03.482380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7848248-ca43-4b08-8d93-bcd94b399c9e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:03.482669 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7848248-ca43-4b08-8d93-bcd94b399c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:03.540944 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b7848248-ca43-4b08-8d93-bcd94b399c9e None None] MFA Rules not processed for user `4ed0f3a5fe6d468692ac7eff90f47745`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:03.550173 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b7848248-ca43-4b08-8d93-bcd94b399c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:03.607810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bfbee-2686-481d-b02d-91f0c18ff2de admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:03.609936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-916bfbee-2686-481d-b02d-91f0c18ff2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:03.706096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1105/2250] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:03.711535 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7848248-ca43-4b08-8d93-bcd94b399c9e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:03.817863 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bfbee-2686-481d-b02d-91f0c18ff2de admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:03.831714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b388e8-4025-4e09-95ea-8aa5b2080173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:03.836081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b388e8-4025-4e09-95ea-8aa5b2080173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:03.836763 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b388e8-4025-4e09-95ea-8aa5b2080173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:03.838299 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b388e8-4025-4e09-95ea-8aa5b2080173 admin admin] PATH_INFO: `/v3/projects/032afd73aa714944b269a63a6018b247` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:03.845622 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b388e8-4025-4e09-95ea-8aa5b2080173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=032afd73aa714944b269a63a6018b247)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:03.849769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7848248-ca43-4b08-8d93-bcd94b399c9e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:03.856676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a969df-7bdc-4c9a-83c0-43905f3f1423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:03.860707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a969df-7bdc-4c9a-83c0-43905f3f1423 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:03.861094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a969df-7bdc-4c9a-83c0-43905f3f1423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:03.861528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a969df-7bdc-4c9a-83c0-43905f3f1423 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:03.862512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a969df-7bdc-4c9a-83c0-43905f3f1423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:03.864231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b388e8-4025-4e09-95ea-8aa5b2080173 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:03.865350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a969df-7bdc-4c9a-83c0-43905f3f1423 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:04.000452 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1106/2251] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:03 2022] POST /identity/v3/projects => generated 369 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:04.001757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a969df-7bdc-4c9a-83c0-43905f3f1423 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:04.084516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-e4b388e8-4025-4e09-95ea-8aa5b2080173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032afd73aa714944b269a63a6018b247', 'request_id': 'req-e4b388e8-4025-4e09-95ea-8aa5b2080173'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:04.109057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-e4b388e8-4025-4e09-95ea-8aa5b2080173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032afd73aa714944b269a63a6018b247', 'request_id': 'req-e4b388e8-4025-4e09-95ea-8aa5b2080173'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:04.142317 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a969df-7bdc-4c9a-83c0-43905f3f1423 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:04.186769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-e4b388e8-4025-4e09-95ea-8aa5b2080173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032afd73aa714944b269a63a6018b247', 'request_id': 'req-e4b388e8-4025-4e09-95ea-8aa5b2080173'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:04.221886 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-e4b388e8-4025-4e09-95ea-8aa5b2080173 admin admin] The token cache is being invalidate because project 032afd73aa714944b269a63a6018b247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:04.223033 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-e4b388e8-4025-4e09-95ea-8aa5b2080173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:04.224437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-e4b388e8-4025-4e09-95ea-8aa5b2080173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:04.232758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1146/2252] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:35:03 2022] DELETE /identity/v3/projects/032afd73aa714944b269a63a6018b247 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:04.239282 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d30e6-6eef-446a-b5f3-98e433dac71f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:04.239780 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d30e6-6eef-446a-b5f3-98e433dac71f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:04.240232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d30e6-6eef-446a-b5f3-98e433dac71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:04.293688 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-767d30e6-6eef-446a-b5f3-98e433dac71f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:04.296119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-767d30e6-6eef-446a-b5f3-98e433dac71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:04.315645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b61b0-9ea7-46af-a203-4026ca853ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:04.316767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b61b0-9ea7-46af-a203-4026ca853ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:04.322675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b61b0-9ea7-46af-a203-4026ca853ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:04.323567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b61b0-9ea7-46af-a203-4026ca853ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:04.324352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b61b0-9ea7-46af-a203-4026ca853ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:04.326857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b61b0-9ea7-46af-a203-4026ca853ab4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:04.394751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1147/2253] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:04.404464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c87945-da35-4482-9e19-5b4c8ea493dd None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:04.434700 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c87945-da35-4482-9e19-5b4c8ea493dd None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:04.436857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c87945-da35-4482-9e19-5b4c8ea493dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:04.448794 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1107/2254] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:04 2022] POST /identity/v3/users => generated 291 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:35:04.450769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b61b0-9ea7-46af-a203-4026ca853ab4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:04.456230 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5a5b61b0-9ea7-46af-a203-4026ca853ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:04.473692 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b6c87945-da35-4482-9e19-5b4c8ea493dd None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:04.477783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b6c87945-da35-4482-9e19-5b4c8ea493dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:04.504368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1148/2255] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:04.509078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c87945-da35-4482-9e19-5b4c8ea493dd None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:04.509287 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b61b0-9ea7-46af-a203-4026ca853ab4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:04.523463 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c87945-da35-4482-9e19-5b4c8ea493dd None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:04.531514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead0a0d-e713-4cb0-ad0c-0a9e5bd6a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:04.531772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0a0d-e713-4cb0-ad0c-0a9e5bd6a73a admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:04.533451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0a0d-e713-4cb0-ad0c-0a9e5bd6a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:04.533792 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0a0d-e713-4cb0-ad0c-0a9e5bd6a73a admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:04.534758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead0a0d-e713-4cb0-ad0c-0a9e5bd6a73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:04.538945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead0a0d-e713-4cb0-ad0c-0a9e5bd6a73a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:04.545394 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1fe54-ab49-4a04-be18-3d80b3bcb2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:04.545895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1fe54-ab49-4a04-be18-3d80b3bcb2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:04.546276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1fe54-ab49-4a04-be18-3d80b3bcb2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:04.551430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1108/2256] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:04.557016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1fe54-ab49-4a04-be18-3d80b3bcb2f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:04.558130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1fe54-ab49-4a04-be18-3d80b3bcb2f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:35:04.558486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1fe54-ab49-4a04-be18-3d80b3bcb2f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:04.559241 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead0a0d-e713-4cb0-ad0c-0a9e5bd6a73a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:04.560136 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1fe54-ab49-4a04-be18-3d80b3bcb2f9 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:04.576025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead0a0d-e713-4cb0-ad0c-0a9e5bd6a73a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:04.590255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401e0e0-4da5-468a-8ae5-be7b9a201ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:04.592990 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401e0e0-4da5-468a-8ae5-be7b9a201ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:04.593524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401e0e0-4da5-468a-8ae5-be7b9a201ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:04.593915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401e0e0-4da5-468a-8ae5-be7b9a201ca1 admin admin] PATH_INFO: `/v3/projects/df62f4c6e60942a1a33aa04f8342b664/users/cde29b067998456aa3ebb0f0c5f19011/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:04.594877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1149/2257] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:35:04.599392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1fe54-ab49-4a04-be18-3d80b3bcb2f9 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:04.620752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401e0e0-4da5-468a-8ae5-be7b9a201ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df62f4c6e60942a1a33aa04f8342b664, user_id=cde29b067998456aa3ebb0f0c5f19011, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:04.621456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1fe54-ab49-4a04-be18-3d80b3bcb2f9 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:04.624418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401e0e0-4da5-468a-8ae5-be7b9a201ca1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:04.637464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb80e4-c578-40a8-8c52-af2a22d51288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:04.641024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb80e4-c578-40a8-8c52-af2a22d51288 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:04.641024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb80e4-c578-40a8-8c52-af2a22d51288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:04.641024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb80e4-c578-40a8-8c52-af2a22d51288 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:04.641024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb80e4-c578-40a8-8c52-af2a22d51288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:04.642450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb80e4-c578-40a8-8c52-af2a22d51288 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:04.717989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1109/2258] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:04 2022] PUT /identity/v3/projects/df62f4c6e60942a1a33aa04f8342b664/users/cde29b067998456aa3ebb0f0c5f19011/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:04.722231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401e0e0-4da5-468a-8ae5-be7b9a201ca1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:04.786742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1150/2259] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:04 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:35:04.788017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb80e4-c578-40a8-8c52-af2a22d51288 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:04.889103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401e0e0-4da5-468a-8ae5-be7b9a201ca1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:04.916725 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb80e4-c578-40a8-8c52-af2a22d51288 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:04.930747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a8f5e-25ff-420b-8b82-2381b8ce3231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:04.931857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a8f5e-25ff-420b-8b82-2381b8ce3231 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:04.932113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a8f5e-25ff-420b-8b82-2381b8ce3231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:04.932932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a8f5e-25ff-420b-8b82-2381b8ce3231 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:04.934030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a8f5e-25ff-420b-8b82-2381b8ce3231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:04.936664 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a8f5e-25ff-420b-8b82-2381b8ce3231 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:04.978826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fbb96-3412-417c-809b-5839b1e23da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:04.980171 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fbb96-3412-417c-809b-5839b1e23da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:04.980769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fbb96-3412-417c-809b-5839b1e23da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:04.981158 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fbb96-3412-417c-809b-5839b1e23da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:04.982321 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55fbb96-3412-417c-809b-5839b1e23da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:04.984326 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55fbb96-3412-417c-809b-5839b1e23da2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:05.012378 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1110/2260] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:05.018676 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1151/2261] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:04 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:05.027539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a8f5e-25ff-420b-8b82-2381b8ce3231 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:05.034087 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fbb96-3412-417c-809b-5839b1e23da2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:05.048429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a8f5e-25ff-420b-8b82-2381b8ce3231 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:05.059680 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fbb96-3412-417c-809b-5839b1e23da2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:05.062506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfc4a8-e18c-402b-adf1-cb53586956e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:05.063276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc4a8-e18c-402b-adf1-cb53586956e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:05.063682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc4a8-e18c-402b-adf1-cb53586956e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:05.064067 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc4a8-e18c-402b-adf1-cb53586956e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:05.064919 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfc4a8-e18c-402b-adf1-cb53586956e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:05.070859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfc4a8-e18c-402b-adf1-cb53586956e1 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:05.071090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9f386-e4fe-4a85-9c3c-72dd562c116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:05.071746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9f386-e4fe-4a85-9c3c-72dd562c116c admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:05.071746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9f386-e4fe-4a85-9c3c-72dd562c116c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:05.072190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9f386-e4fe-4a85-9c3c-72dd562c116c admin admin] PATH_INFO: `/v3/projects/df62f4c6e60942a1a33aa04f8342b664/users/cde29b067998456aa3ebb0f0c5f19011/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:05.077208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9f386-e4fe-4a85-9c3c-72dd562c116c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df62f4c6e60942a1a33aa04f8342b664, user_id=cde29b067998456aa3ebb0f0c5f19011, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:05.079974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9f386-e4fe-4a85-9c3c-72dd562c116c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:05.089847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1152/2262] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:05.093983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfc4a8-e18c-402b-adf1-cb53586956e1 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:05.111848 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1111/2263] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:05 2022] PUT /identity/v3/projects/df62f4c6e60942a1a33aa04f8342b664/users/cde29b067998456aa3ebb0f0c5f19011/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:05.113402 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085d4a6-3165-4a40-b56b-6870a45c585c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:05.113694 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085d4a6-3165-4a40-b56b-6870a45c585c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:05.113977 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085d4a6-3165-4a40-b56b-6870a45c585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:05.120207 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfc4a8-e18c-402b-adf1-cb53586956e1 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:05.161859 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7085d4a6-3165-4a40-b56b-6870a45c585c None None] MFA Rules not processed for user `cde29b067998456aa3ebb0f0c5f19011`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:05.163412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7085d4a6-3165-4a40-b56b-6870a45c585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:05.294012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32ec48-9d10-4499-a851-8e0f68adf64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:05.294742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32ec48-9d10-4499-a851-8e0f68adf64a admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:05.295034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32ec48-9d10-4499-a851-8e0f68adf64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:05.295316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32ec48-9d10-4499-a851-8e0f68adf64a admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:05.297545 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32ec48-9d10-4499-a851-8e0f68adf64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:05.299305 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32ec48-9d10-4499-a851-8e0f68adf64a admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:05.326563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1153/2264] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:05.340243 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32ec48-9d10-4499-a851-8e0f68adf64a admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:05.362030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32ec48-9d10-4499-a851-8e0f68adf64a admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:05.369083 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56909ce-bf67-4d2f-9d83-995c47585250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:05.369984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56909ce-bf67-4d2f-9d83-995c47585250 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:05.370273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56909ce-bf67-4d2f-9d83-995c47585250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:05.370630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56909ce-bf67-4d2f-9d83-995c47585250 admin admin] PATH_INFO: `/v3/projects/8e8182f6ec984d44a18e4507d529dbcf/users/82f20db37c864fb6805c62d63365c29e/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:05.397871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56909ce-bf67-4d2f-9d83-995c47585250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8182f6ec984d44a18e4507d529dbcf, user_id=82f20db37c864fb6805c62d63365c29e, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:05.399346 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1112/2265] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:05.402024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56909ce-bf67-4d2f-9d83-995c47585250 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:05.409938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085d4a6-3165-4a40-b56b-6870a45c585c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:05.411481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7085d4a6-3165-4a40-b56b-6870a45c585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:05.486748 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1154/2266] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:05 2022] PUT /identity/v3/projects/8e8182f6ec984d44a18e4507d529dbcf/users/82f20db37c864fb6805c62d63365c29e/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:05.498156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f1ac0-5d87-489a-a8e8-0c9a23d1b4b1 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:05.498414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f1ac0-5d87-489a-a8e8-0c9a23d1b4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:05.498696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f1ac0-5d87-489a-a8e8-0c9a23d1b4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:05.513121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085d4a6-3165-4a40-b56b-6870a45c585c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:05.552425 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-558f1ac0-5d87-489a-a8e8-0c9a23d1b4b1 None None] MFA Rules not processed for user `82f20db37c864fb6805c62d63365c29e`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:05.554690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-558f1ac0-5d87-489a-a8e8-0c9a23d1b4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:05.602987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5826-5d36-42b3-9e1f-6930983ae053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:05.604036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5826-5d36-42b3-9e1f-6930983ae053 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:05.604522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5826-5d36-42b3-9e1f-6930983ae053 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:05.605172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5826-5d36-42b3-9e1f-6930983ae053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:05.684298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1155/2267] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:05.702309 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f1ac0-5d87-489a-a8e8-0c9a23d1b4b1 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:05.703953 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-558f1ac0-5d87-489a-a8e8-0c9a23d1b4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:05.717465 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f5826-5d36-42b3-9e1f-6930983ae053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:05.719418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f5826-5d36-42b3-9e1f-6930983ae053 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:05.733137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f1ac0-5d87-489a-a8e8-0c9a23d1b4b1 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:05.744597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745f670-9334-4a03-9310-5d141090db5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:05.745644 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745f670-9334-4a03-9310-5d141090db5b service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:05.746323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745f670-9334-4a03-9310-5d141090db5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:05.746949 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745f670-9334-4a03-9310-5d141090db5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:05.764556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745f670-9334-4a03-9310-5d141090db5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:05.769537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745f670-9334-4a03-9310-5d141090db5b service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:05.787464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1156/2268] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:05.807867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1113/2269] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:06.455506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b614e-5c0b-4e53-b83d-0874d190dbcb None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:06.456287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b614e-5c0b-4e53-b83d-0874d190dbcb None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:06.456287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b614e-5c0b-4e53-b83d-0874d190dbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:06.565713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-023b614e-5c0b-4e53-b83d-0874d190dbcb None None] MFA Rules not processed for user `dbd9eb4255764402a5306895dd1f2dde`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:06.565713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-023b614e-5c0b-4e53-b83d-0874d190dbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:06.783634 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1157/2270] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:06.797167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5826-5d36-42b3-9e1f-6930983ae053 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:06.798607 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ed5f5826-5d36-42b3-9e1f-6930983ae053 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:07.071349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5826-5d36-42b3-9e1f-6930983ae053 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:07.082232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997272f-d414-4110-a538-8ae64da12a4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:07.082931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997272f-d414-4110-a538-8ae64da12a4f service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:07.083387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997272f-d414-4110-a538-8ae64da12a4f service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:07.083823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997272f-d414-4110-a538-8ae64da12a4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:07.086145 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2997272f-d414-4110-a538-8ae64da12a4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:07.291149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997272f-d414-4110-a538-8ae64da12a4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:07.292775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997272f-d414-4110-a538-8ae64da12a4f service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:07.320929 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1114/2271] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:09.562151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b614e-5c0b-4e53-b83d-0874d190dbcb None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:09.701961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b614e-5c0b-4e53-b83d-0874d190dbcb None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:09.711535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:09.712995 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:09.713461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:09.713893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] PATH_INFO: `/v3/users/82f20db37c864fb6805c62d63365c29e` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:09.715487 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f20db37c864fb6805c62d63365c29e)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:09.718270 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:10.030742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f20db37c864fb6805c62d63365c29e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:10.057387 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f20db37c864fb6805c62d63365c29e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:10.150818 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f20db37c864fb6805c62d63365c29e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:10.153182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f20db37c864fb6805c62d63365c29e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:10.187637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f20db37c864fb6805c62d63365c29e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:10.238722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1158/2272] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:35:09 2022] DELETE /identity/v3/users/82f20db37c864fb6805c62d63365c29e => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:10.240939 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb5c7f-9347-4c5a-9a9d-ca359a91de44 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:10.242809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb5c7f-9347-4c5a-9a9d-ca359a91de44 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:10.243380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb5c7f-9347-4c5a-9a9d-ca359a91de44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:10.271495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-87fb5c7f-9347-4c5a-9a9d-ca359a91de44 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:10.275502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-87fb5c7f-9347-4c5a-9a9d-ca359a91de44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:10.416818 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1115/2273] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:10.429487 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:10.431172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:10.571504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e6b06-88ff-43e9-8f1a-6ba2ba65f0c1 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:10.583097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b9e95-ed97-4fad-a953-ff6406bae40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:10.586020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b9e95-ed97-4fad-a953-ff6406bae40c service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:10.588880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b9e95-ed97-4fad-a953-ff6406bae40c service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:10.589057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b9e95-ed97-4fad-a953-ff6406bae40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:10.628467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b9e95-ed97-4fad-a953-ff6406bae40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:10.629621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b9e95-ed97-4fad-a953-ff6406bae40c service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:10.642355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1159/2274] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:10.734563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb5c7f-9347-4c5a-9a9d-ca359a91de44 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:10.736424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-87fb5c7f-9347-4c5a-9a9d-ca359a91de44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:10.760522 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb5c7f-9347-4c5a-9a9d-ca359a91de44 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:10.786033 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:10.789283 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:10.792375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:10.792675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] PATH_INFO: `/v3/users/4ed0f3a5fe6d468692ac7eff90f47745` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:10.799312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed0f3a5fe6d468692ac7eff90f47745)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:10.801386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:11.060729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed0f3a5fe6d468692ac7eff90f47745'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:11.079703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed0f3a5fe6d468692ac7eff90f47745'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:11.085587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed0f3a5fe6d468692ac7eff90f47745'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:11.086631 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed0f3a5fe6d468692ac7eff90f47745'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:11.115858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed0f3a5fe6d468692ac7eff90f47745'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:11.202604 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1116/2275] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:35:10 2022] DELETE /identity/v3/users/4ed0f3a5fe6d468692ac7eff90f47745 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:11.206454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46542-737f-4a1a-a041-e8731a42559a None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:11.206752 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46542-737f-4a1a-a041-e8731a42559a None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:11.207348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46542-737f-4a1a-a041-e8731a42559a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:11.270259 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a1d46542-737f-4a1a-a041-e8731a42559a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:11.271575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a1d46542-737f-4a1a-a041-e8731a42559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:11.594680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1160/2276] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:11.612442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:11.615231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:11.820141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc354a3-8534-4db1-a8cd-11f77d6825ec admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:11.827343 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0eadf-e392-499c-831e-f13ca1eef510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:11.828329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0eadf-e392-499c-831e-f13ca1eef510 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:11.828688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0eadf-e392-499c-831e-f13ca1eef510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:11.829082 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0eadf-e392-499c-831e-f13ca1eef510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:11.843364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0eadf-e392-499c-831e-f13ca1eef510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:11.845036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0eadf-e392-499c-831e-f13ca1eef510 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:11.857358 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1117/2277] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:11.925282 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d46542-737f-4a1a-a041-e8731a42559a None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:11.927161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a1d46542-737f-4a1a-a041-e8731a42559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:11.951349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d46542-737f-4a1a-a041-e8731a42559a None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:11.956548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:11.957880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:11.958410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:11.958910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] PATH_INFO: `/v3/projects/8e8182f6ec984d44a18e4507d529dbcf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:11.964760 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8182f6ec984d44a18e4507d529dbcf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:11.967438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:12.226672 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8182f6ec984d44a18e4507d529dbcf', 'request_id': 'req-05259e43-599f-4ac8-821b-713ad3125f8f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:12.240646 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8182f6ec984d44a18e4507d529dbcf', 'request_id': 'req-05259e43-599f-4ac8-821b-713ad3125f8f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:12.324035 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8182f6ec984d44a18e4507d529dbcf', 'request_id': 'req-05259e43-599f-4ac8-821b-713ad3125f8f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:12.355958 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] The token cache is being invalidate because project 8e8182f6ec984d44a18e4507d529dbcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:12.356442 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:12.357472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:12.364425 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1161/2278] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:35:11 2022] DELETE /identity/v3/projects/8e8182f6ec984d44a18e4507d529dbcf => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:12.365828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4275c-09d5-4d5a-997d-c2ec3d846804 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:12.366853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4275c-09d5-4d5a-997d-c2ec3d846804 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:12.367462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4275c-09d5-4d5a-997d-c2ec3d846804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:12.405049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f0e4275c-09d5-4d5a-997d-c2ec3d846804 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:12.406661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f0e4275c-09d5-4d5a-997d-c2ec3d846804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:12.529516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:12.532064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:12.533318 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1118/2279] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:12.541661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34c455-6ecf-4e06-bcdc-35ca077418d0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:12.549495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34c455-6ecf-4e06-bcdc-35ca077418d0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:12.549495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34c455-6ecf-4e06-bcdc-35ca077418d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:12.562603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2c34c455-6ecf-4e06-bcdc-35ca077418d0 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:12.564015 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2c34c455-6ecf-4e06-bcdc-35ca077418d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:12.574454 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1119/2280] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:12.578093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34c455-6ecf-4e06-bcdc-35ca077418d0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:12.585225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05259e43-599f-4ac8-821b-713ad3125f8f admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:12.615327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:12.617129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34c455-6ecf-4e06-bcdc-35ca077418d0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:12.620613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:12.622123 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:12.622539 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe80382-bba1-4627-9e95-7fc6deefe0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:12.622916 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] PATH_INFO: `/v3/projects/50147971488c4a44a092cc7b3010f9c6` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:12.623244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe80382-bba1-4627-9e95-7fc6deefe0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:12.623537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe80382-bba1-4627-9e95-7fc6deefe0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:12.623850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe80382-bba1-4627-9e95-7fc6deefe0b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:12.624631 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe80382-bba1-4627-9e95-7fc6deefe0b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:35:12.624895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe80382-bba1-4627-9e95-7fc6deefe0b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:12.626884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50147971488c4a44a092cc7b3010f9c6)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:12.628364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe80382-bba1-4627-9e95-7fc6deefe0b6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:12.641683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:12.650630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1120/2281] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:35:12.651512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe80382-bba1-4627-9e95-7fc6deefe0b6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:12.662982 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe80382-bba1-4627-9e95-7fc6deefe0b6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:12.669102 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81074404-4bc7-4771-ac52-aad1733fb6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:12.669837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81074404-4bc7-4771-ac52-aad1733fb6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:12.670127 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81074404-4bc7-4771-ac52-aad1733fb6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:12.670479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81074404-4bc7-4771-ac52-aad1733fb6a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:12.671400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81074404-4bc7-4771-ac52-aad1733fb6a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:12.673432 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81074404-4bc7-4771-ac52-aad1733fb6a5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:12.810546 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1121/2282] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:12 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:12.811930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b902d-a5db-459f-8113-be284dd1cdd7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:12.812218 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b902d-a5db-459f-8113-be284dd1cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:12.812533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b902d-a5db-459f-8113-be284dd1cdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:12.823301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50147971488c4a44a092cc7b3010f9c6', 'request_id': 'req-d779c036-6828-4a17-830a-3484005afea7'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:12.833506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50147971488c4a44a092cc7b3010f9c6', 'request_id': 'req-d779c036-6828-4a17-830a-3484005afea7'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:12.846400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-326b902d-a5db-459f-8113-be284dd1cdd7 None None] MFA Rules not processed for user `50ab73740c294e54bf93aa6a8dc206bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:12.851993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-326b902d-a5db-459f-8113-be284dd1cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:12.920537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50147971488c4a44a092cc7b3010f9c6', 'request_id': 'req-d779c036-6828-4a17-830a-3484005afea7'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:12.933437 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1122/2283] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:12.934944 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b902d-a5db-459f-8113-be284dd1cdd7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:12.945028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] The token cache is being invalidate because project 50147971488c4a44a092cc7b3010f9c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:12.945551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:12.947092 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:12.952376 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1162/2284] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:35:12 2022] DELETE /identity/v3/projects/50147971488c4a44a092cc7b3010f9c6 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:12.956761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:12.959865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:13.042709 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b902d-a5db-459f-8113-be284dd1cdd7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:13.048626 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174765b-4ea6-49ba-9260-7145a82a3afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:13.049461 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174765b-4ea6-49ba-9260-7145a82a3afc admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:13.049908 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174765b-4ea6-49ba-9260-7145a82a3afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:13.050313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174765b-4ea6-49ba-9260-7145a82a3afc admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:13.051193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174765b-4ea6-49ba-9260-7145a82a3afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:13.053785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174765b-4ea6-49ba-9260-7145a82a3afc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:13.113798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779c036-6828-4a17-830a-3484005afea7 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:13.122827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:13.123929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:13.125263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:13.125659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] PATH_INFO: `/v3/users/cde29b067998456aa3ebb0f0c5f19011` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:13.127916 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde29b067998456aa3ebb0f0c5f19011)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:13.133184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:13.165339 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1123/2285] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:12 2022] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:13.166688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174765b-4ea6-49ba-9260-7145a82a3afc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:13.169513 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f174765b-4ea6-49ba-9260-7145a82a3afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:13.211615 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174765b-4ea6-49ba-9260-7145a82a3afc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:13.224367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abea528-ffdc-4bb1-a978-807635181f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:13.225231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abea528-ffdc-4bb1-a978-807635181f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:13.227039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abea528-ffdc-4bb1-a978-807635181f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:13.227039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abea528-ffdc-4bb1-a978-807635181f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:13.227039 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abea528-ffdc-4bb1-a978-807635181f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:13.230919 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abea528-ffdc-4bb1-a978-807635181f2f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:13.256721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1124/2286] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:13.265947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abea528-ffdc-4bb1-a978-807635181f2f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:13.279407 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abea528-ffdc-4bb1-a978-807635181f2f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:13.285515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbb202-ad5a-41fd-b060-5a124ae0d53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:13.286184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbb202-ad5a-41fd-b060-5a124ae0d53a admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:13.286504 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbb202-ad5a-41fd-b060-5a124ae0d53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:13.286847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbb202-ad5a-41fd-b060-5a124ae0d53a admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:13.287742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbb202-ad5a-41fd-b060-5a124ae0d53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:13.290094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbb202-ad5a-41fd-b060-5a124ae0d53a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:13.311739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1125/2287] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:13.312903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbb202-ad5a-41fd-b060-5a124ae0d53a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:13.329451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbb202-ad5a-41fd-b060-5a124ae0d53a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:13.336048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81104f-1a2b-4087-b0bc-01096484560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:13.337149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81104f-1a2b-4087-b0bc-01096484560f admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:13.337415 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81104f-1a2b-4087-b0bc-01096484560f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:13.337699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81104f-1a2b-4087-b0bc-01096484560f admin admin] PATH_INFO: `/v3/projects/b07f5ca99c4f46ba970c65116bd5e142/users/a34f747d1898493799d7e42c9a300db1/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:13.355946 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81104f-1a2b-4087-b0bc-01096484560f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07f5ca99c4f46ba970c65116bd5e142, user_id=a34f747d1898493799d7e42c9a300db1, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:13.359126 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81104f-1a2b-4087-b0bc-01096484560f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:13.438658 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde29b067998456aa3ebb0f0c5f19011'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:13.463366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde29b067998456aa3ebb0f0c5f19011'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:13.474512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1126/2288] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:13 2022] PUT /identity/v3/projects/b07f5ca99c4f46ba970c65116bd5e142/users/a34f747d1898493799d7e42c9a300db1/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:13.478255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f98fd-d59a-45e5-906c-77cb874da8c0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:13.478752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f98fd-d59a-45e5-906c-77cb874da8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:13.479318 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f98fd-d59a-45e5-906c-77cb874da8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:13.577952 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde29b067998456aa3ebb0f0c5f19011'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:13.578470 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde29b067998456aa3ebb0f0c5f19011'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:13.613321 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f51f98fd-d59a-45e5-906c-77cb874da8c0 None None] MFA Rules not processed for user `a34f747d1898493799d7e42c9a300db1`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:13.613321 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f51f98fd-d59a-45e5-906c-77cb874da8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:13.641829 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde29b067998456aa3ebb0f0c5f19011'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:13.674418 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1163/2289] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:35:12 2022] DELETE /identity/v3/users/cde29b067998456aa3ebb0f0c5f19011 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:35:13.736642 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1127/2290] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:13.767390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:13.769316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:13.900814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8ff6b-684b-41b9-8596-cf3283b5d259 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:13.905758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6ddc7-16e8-4cf9-920e-b8511da787b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:13.906722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6ddc7-16e8-4cf9-920e-b8511da787b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:13.907247 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6ddc7-16e8-4cf9-920e-b8511da787b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:13.907836 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6ddc7-16e8-4cf9-920e-b8511da787b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:14.032851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6ddc7-16e8-4cf9-920e-b8511da787b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:14.034604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6ddc7-16e8-4cf9-920e-b8511da787b2 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:14.047298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1164/2291] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:14.083426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f98fd-d59a-45e5-906c-77cb874da8c0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:14.085648 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f51f98fd-d59a-45e5-906c-77cb874da8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:14.183410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f98fd-d59a-45e5-906c-77cb874da8c0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:14.288546 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be671fe5-807c-40c4-9887-4502f1f8ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:14.289880 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be671fe5-807c-40c4-9887-4502f1f8ab16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:14.290410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be671fe5-807c-40c4-9887-4502f1f8ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:14.290884 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be671fe5-807c-40c4-9887-4502f1f8ab16 admin admin] PATH_INFO: `/v3/users/a34f747d1898493799d7e42c9a300db1` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:14.292564 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be671fe5-807c-40c4-9887-4502f1f8ab16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34f747d1898493799d7e42c9a300db1)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:14.300828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be671fe5-807c-40c4-9887-4502f1f8ab16 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:14.520132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-be671fe5-807c-40c4-9887-4502f1f8ab16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34f747d1898493799d7e42c9a300db1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:14.530051 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-be671fe5-807c-40c4-9887-4502f1f8ab16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34f747d1898493799d7e42c9a300db1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:14.530878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-be671fe5-807c-40c4-9887-4502f1f8ab16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34f747d1898493799d7e42c9a300db1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:14.534545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-be671fe5-807c-40c4-9887-4502f1f8ab16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34f747d1898493799d7e42c9a300db1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:14.549867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6ddc7-16e8-4cf9-920e-b8511da787b2 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:14.551770 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-fca6ddc7-16e8-4cf9-920e-b8511da787b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:14.557199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-be671fe5-807c-40c4-9887-4502f1f8ab16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34f747d1898493799d7e42c9a300db1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:14.573981 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6ddc7-16e8-4cf9-920e-b8511da787b2 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:14.579936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b771e-eeed-4690-ab5f-f15f36dde909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:14.586201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b771e-eeed-4690-ab5f-f15f36dde909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:14.586201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b771e-eeed-4690-ab5f-f15f36dde909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:14.586201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b771e-eeed-4690-ab5f-f15f36dde909 admin admin] PATH_INFO: `/v3/projects/df62f4c6e60942a1a33aa04f8342b664` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:14.586201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b771e-eeed-4690-ab5f-f15f36dde909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df62f4c6e60942a1a33aa04f8342b664)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:14.587041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b771e-eeed-4690-ab5f-f15f36dde909 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:14.656706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1128/2292] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:35:14 2022] DELETE /identity/v3/users/a34f747d1898493799d7e42c9a300db1 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:14.661580 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6451f-c091-4527-ad1f-7d7973fec531 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:14.662257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6451f-c091-4527-ad1f-7d7973fec531 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:14.663568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6451f-c091-4527-ad1f-7d7973fec531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:14.732907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-43a6451f-c091-4527-ad1f-7d7973fec531 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:14.734696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-43a6451f-c091-4527-ad1f-7d7973fec531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:14.794021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5d3b771e-eeed-4690-ab5f-f15f36dde909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df62f4c6e60942a1a33aa04f8342b664', 'request_id': 'req-5d3b771e-eeed-4690-ab5f-f15f36dde909'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:14.810444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5d3b771e-eeed-4690-ab5f-f15f36dde909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df62f4c6e60942a1a33aa04f8342b664', 'request_id': 'req-5d3b771e-eeed-4690-ab5f-f15f36dde909'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:14.872191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5d3b771e-eeed-4690-ab5f-f15f36dde909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df62f4c6e60942a1a33aa04f8342b664', 'request_id': 'req-5d3b771e-eeed-4690-ab5f-f15f36dde909'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:14.889776 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5d3b771e-eeed-4690-ab5f-f15f36dde909 admin admin] The token cache is being invalidate because project df62f4c6e60942a1a33aa04f8342b664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:14.890504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5d3b771e-eeed-4690-ab5f-f15f36dde909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:14.891771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5d3b771e-eeed-4690-ab5f-f15f36dde909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:14.900781 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1165/2293] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:35:14 2022] DELETE /identity/v3/projects/df62f4c6e60942a1a33aa04f8342b664 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:14.902604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e7b9d-9745-4814-befb-c760797106f6 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:14.903105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e7b9d-9745-4814-befb-c760797106f6 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:14.903215 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1129/2294] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:14.903659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e7b9d-9745-4814-befb-c760797106f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:14.917796 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6451f-c091-4527-ad1f-7d7973fec531 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:14.919481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-43a6451f-c091-4527-ad1f-7d7973fec531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:14.962445 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-dd7e7b9d-9745-4814-befb-c760797106f6 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:14.967617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-dd7e7b9d-9745-4814-befb-c760797106f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:14.997746 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1166/2295] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:15.000027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06213a9-926f-4495-a2e7-1aec33151452 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:15.000941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06213a9-926f-4495-a2e7-1aec33151452 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:15.001231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06213a9-926f-4495-a2e7-1aec33151452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:15.032417 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-f06213a9-926f-4495-a2e7-1aec33151452 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:15.033650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-f06213a9-926f-4495-a2e7-1aec33151452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:15.057335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1167/2296] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:15.061095 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06213a9-926f-4495-a2e7-1aec33151452 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:15.065067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6451f-c091-4527-ad1f-7d7973fec531 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:15.081088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aed277-45d1-4dca-9c87-197a642f0a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:15.081876 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aed277-45d1-4dca-9c87-197a642f0a64 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:15.082155 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aed277-45d1-4dca-9c87-197a642f0a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:15.083202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aed277-45d1-4dca-9c87-197a642f0a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:15.087286 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06213a9-926f-4495-a2e7-1aec33151452 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:15.092790 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c7aed277-45d1-4dca-9c87-197a642f0a64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:15.094771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e4394-a68d-40a2-8753-896f40e4d2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:15.095711 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e4394-a68d-40a2-8753-896f40e4d2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:15.096770 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e4394-a68d-40a2-8753-896f40e4d2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:15.096770 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e4394-a68d-40a2-8753-896f40e4d2d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:15.097695 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e4394-a68d-40a2-8753-896f40e4d2d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:35:15.098078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e4394-a68d-40a2-8753-896f40e4d2d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:15.100173 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e4394-a68d-40a2-8753-896f40e4d2d9 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:15.120061 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1168/2297] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:35:15.134642 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e4394-a68d-40a2-8753-896f40e4d2d9 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:15.146837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aed277-45d1-4dca-9c87-197a642f0a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:15.149128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aed277-45d1-4dca-9c87-197a642f0a64 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:15.153455 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e4394-a68d-40a2-8753-896f40e4d2d9 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:15.163520 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1130/2298] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:35:15.167779 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d217890-91bd-402a-9182-b9f3dddfa6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:15.168414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d217890-91bd-402a-9182-b9f3dddfa6ea admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:15.168709 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d217890-91bd-402a-9182-b9f3dddfa6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:15.169019 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d217890-91bd-402a-9182-b9f3dddfa6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:15.169712 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d217890-91bd-402a-9182-b9f3dddfa6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:15.171766 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d217890-91bd-402a-9182-b9f3dddfa6ea admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:15.293390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1169/2299] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:15 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:15.296699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aed277-45d1-4dca-9c87-197a642f0a64 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:15.313042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aed277-45d1-4dca-9c87-197a642f0a64 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:15.390636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19835163-c20c-4256-969c-1eb8eb0a42d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:15.391427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19835163-c20c-4256-969c-1eb8eb0a42d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:15.391804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19835163-c20c-4256-969c-1eb8eb0a42d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:15.392111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19835163-c20c-4256-969c-1eb8eb0a42d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:15.392689 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19835163-c20c-4256-969c-1eb8eb0a42d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:15.395109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19835163-c20c-4256-969c-1eb8eb0a42d7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:15.502208 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1131/2300] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:15 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:15.506489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d217890-91bd-402a-9182-b9f3dddfa6ea admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:15.519157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d217890-91bd-402a-9182-b9f3dddfa6ea admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:15.525764 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1bbe9-26a1-4005-b26d-120a8c6d6950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:15.526566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1bbe9-26a1-4005-b26d-120a8c6d6950 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:15.527148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1bbe9-26a1-4005-b26d-120a8c6d6950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:15.527536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1bbe9-26a1-4005-b26d-120a8c6d6950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:15.528560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1bbe9-26a1-4005-b26d-120a8c6d6950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:15.531069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1bbe9-26a1-4005-b26d-120a8c6d6950 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:15.546405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1170/2301] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:15.550126 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19835163-c20c-4256-969c-1eb8eb0a42d7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:15.563379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19835163-c20c-4256-969c-1eb8eb0a42d7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:15.573673 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b75aa0-e5ac-4ca1-aaea-4823def94939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:15.574668 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b75aa0-e5ac-4ca1-aaea-4823def94939 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:15.575188 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b75aa0-e5ac-4ca1-aaea-4823def94939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:15.580964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b75aa0-e5ac-4ca1-aaea-4823def94939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:15.580964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b75aa0-e5ac-4ca1-aaea-4823def94939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:15.586009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b75aa0-e5ac-4ca1-aaea-4823def94939 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:15.615053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1132/2302] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:15.621081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1bbe9-26a1-4005-b26d-120a8c6d6950 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:15.645414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1bbe9-26a1-4005-b26d-120a8c6d6950 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:15.665130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f160ac8-ecf8-440a-a1ab-393561762288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:15.667552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f160ac8-ecf8-440a-a1ab-393561762288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:15.670096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f160ac8-ecf8-440a-a1ab-393561762288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:15.670785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f160ac8-ecf8-440a-a1ab-393561762288 admin admin] PATH_INFO: `/v3/projects/6cc11e70b59c4427bc16b63064b2ecc6/users/6de9260af9284b939847aeb74c467fd0/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:15.726931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f160ac8-ecf8-440a-a1ab-393561762288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc11e70b59c4427bc16b63064b2ecc6, user_id=6de9260af9284b939847aeb74c467fd0, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:15.729999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f160ac8-ecf8-440a-a1ab-393561762288 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:15.817446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1171/2303] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:15 2022] PUT /identity/v3/projects/6cc11e70b59c4427bc16b63064b2ecc6/users/6de9260af9284b939847aeb74c467fd0/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:15.831860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1387dfc-a044-4849-9472-e6b2f8c0bbf2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:15.832212 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1387dfc-a044-4849-9472-e6b2f8c0bbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:15.832454 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1387dfc-a044-4849-9472-e6b2f8c0bbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:15.905351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e1387dfc-a044-4849-9472-e6b2f8c0bbf2 None None] MFA Rules not processed for user `6de9260af9284b939847aeb74c467fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:15.910476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e1387dfc-a044-4849-9472-e6b2f8c0bbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:15.985190 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f160ac8-ecf8-440a-a1ab-393561762288 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:15.987107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-3f160ac8-ecf8-440a-a1ab-393561762288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:16.046562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1133/2304] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:16.051197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1387dfc-a044-4849-9472-e6b2f8c0bbf2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:16.076327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f160ac8-ecf8-440a-a1ab-393561762288 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:16.081677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8c8ef-ff95-4e82-b220-8ec7390979b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:16.082585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8c8ef-ff95-4e82-b220-8ec7390979b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:16.082867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8c8ef-ff95-4e82-b220-8ec7390979b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:16.083142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8c8ef-ff95-4e82-b220-8ec7390979b8 admin admin] PATH_INFO: `/v3/projects/b07f5ca99c4f46ba970c65116bd5e142` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:16.084330 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8c8ef-ff95-4e82-b220-8ec7390979b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07f5ca99c4f46ba970c65116bd5e142)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:16.087105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8c8ef-ff95-4e82-b220-8ec7390979b8 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:16.122403 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1387dfc-a044-4849-9472-e6b2f8c0bbf2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:16.128552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06f690-8727-4827-9c8b-944abf0da6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:16.129648 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06f690-8727-4827-9c8b-944abf0da6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:16.130009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06f690-8727-4827-9c8b-944abf0da6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:16.130418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06f690-8727-4827-9c8b-944abf0da6c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:16.131195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06f690-8727-4827-9c8b-944abf0da6c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:16.134165 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06f690-8727-4827-9c8b-944abf0da6c7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:16.227596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6af8c8ef-ff95-4e82-b220-8ec7390979b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07f5ca99c4f46ba970c65116bd5e142', 'request_id': 'req-6af8c8ef-ff95-4e82-b220-8ec7390979b8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:16.233704 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1134/2305] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:16 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:16.239451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06f690-8727-4827-9c8b-944abf0da6c7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:16.245416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6af8c8ef-ff95-4e82-b220-8ec7390979b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07f5ca99c4f46ba970c65116bd5e142', 'request_id': 'req-6af8c8ef-ff95-4e82-b220-8ec7390979b8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:16.335231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6af8c8ef-ff95-4e82-b220-8ec7390979b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07f5ca99c4f46ba970c65116bd5e142', 'request_id': 'req-6af8c8ef-ff95-4e82-b220-8ec7390979b8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:16.361913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06f690-8727-4827-9c8b-944abf0da6c7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:16.364905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6af8c8ef-ff95-4e82-b220-8ec7390979b8 admin admin] The token cache is being invalidate because project b07f5ca99c4f46ba970c65116bd5e142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:16.366885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6af8c8ef-ff95-4e82-b220-8ec7390979b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:16.368291 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-6af8c8ef-ff95-4e82-b220-8ec7390979b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:16.371884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1172/2306] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:35:15 2022] DELETE /identity/v3/projects/b07f5ca99c4f46ba970c65116bd5e142 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:16.381322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813154b5-fdf9-40ce-8c61-60d5ea0aabf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:16.382482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813154b5-fdf9-40ce-8c61-60d5ea0aabf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:16.382876 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813154b5-fdf9-40ce-8c61-60d5ea0aabf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:16.383286 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813154b5-fdf9-40ce-8c61-60d5ea0aabf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:16.384548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813154b5-fdf9-40ce-8c61-60d5ea0aabf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:16.385619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0fa67-0a0b-4fac-9676-b403b772933f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:16.385866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0fa67-0a0b-4fac-9676-b403b772933f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:16.386907 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0fa67-0a0b-4fac-9676-b403b772933f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:16.389343 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813154b5-fdf9-40ce-8c61-60d5ea0aabf5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:16.415080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a8f0fa67-0a0b-4fac-9676-b403b772933f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:16.417931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a8f0fa67-0a0b-4fac-9676-b403b772933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:16.432812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1173/2307] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:16.440902 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064567e0-efec-488b-8587-c9d3e86b52dd None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:16.441223 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064567e0-efec-488b-8587-c9d3e86b52dd None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:16.441458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064567e0-efec-488b-8587-c9d3e86b52dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:16.467737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-064567e0-efec-488b-8587-c9d3e86b52dd None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:16.469848 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-064567e0-efec-488b-8587-c9d3e86b52dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:16.494589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1135/2308] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:16 2022] POST /identity/v3/users => generated 299 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:16.499434 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813154b5-fdf9-40ce-8c61-60d5ea0aabf5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:16.503349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1174/2309] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:16.508568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064567e0-efec-488b-8587-c9d3e86b52dd None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:16.511100 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-813154b5-fdf9-40ce-8c61-60d5ea0aabf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:16.521568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064567e0-efec-488b-8587-c9d3e86b52dd None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:16.529406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb3969-1310-409a-8fd4-cbf82d49e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:16.533309 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb3969-1310-409a-8fd4-cbf82d49e5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:16.533639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb3969-1310-409a-8fd4-cbf82d49e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:16.534208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb3969-1310-409a-8fd4-cbf82d49e5e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:16.534340 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813154b5-fdf9-40ce-8c61-60d5ea0aabf5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:16.535349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb3969-1310-409a-8fd4-cbf82d49e5e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:35:16.535670 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb3969-1310-409a-8fd4-cbf82d49e5e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:16.538682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb3969-1310-409a-8fd4-cbf82d49e5e8 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:16.540263 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916f5e4-f910-4afa-a3c1-939753d70b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:16.541193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916f5e4-f910-4afa-a3c1-939753d70b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:16.541555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916f5e4-f910-4afa-a3c1-939753d70b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:16.541916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916f5e4-f910-4afa-a3c1-939753d70b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:16.543174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916f5e4-f910-4afa-a3c1-939753d70b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:16.545667 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916f5e4-f910-4afa-a3c1-939753d70b36 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:16.557756 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1175/2310] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:35:16.561814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1136/2311] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:16.563402 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb3969-1310-409a-8fd4-cbf82d49e5e8 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:16.575776 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb3969-1310-409a-8fd4-cbf82d49e5e8 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:16.577481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916f5e4-f910-4afa-a3c1-939753d70b36 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:16.581312 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024afcb-2bf3-4e1e-aab7-1b1c6f85cb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:16.582216 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024afcb-2bf3-4e1e-aab7-1b1c6f85cb17 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:16.582686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024afcb-2bf3-4e1e-aab7-1b1c6f85cb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:16.583168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024afcb-2bf3-4e1e-aab7-1b1c6f85cb17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:16.584035 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024afcb-2bf3-4e1e-aab7-1b1c6f85cb17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:16.590582 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916f5e4-f910-4afa-a3c1-939753d70b36 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:16.594832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024afcb-2bf3-4e1e-aab7-1b1c6f85cb17 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:16.597526 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d8a5a-610a-4361-8a89-fc39e90869e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:16.611659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d8a5a-610a-4361-8a89-fc39e90869e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:16.613515 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d8a5a-610a-4361-8a89-fc39e90869e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:16.614596 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d8a5a-610a-4361-8a89-fc39e90869e1 admin admin] PATH_INFO: `/v3/projects/52a9ef270bdc43459f9ec8b1e57783c8/users/2173c4028b914899aa4582a867d001ae/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:16.637279 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d8a5a-610a-4361-8a89-fc39e90869e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a9ef270bdc43459f9ec8b1e57783c8, user_id=2173c4028b914899aa4582a867d001ae, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:16.640356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d8a5a-610a-4361-8a89-fc39e90869e1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:16.731091 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1137/2312] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:16 2022] PUT /identity/v3/projects/52a9ef270bdc43459f9ec8b1e57783c8/users/2173c4028b914899aa4582a867d001ae/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:35:16.735200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d8a5a-610a-4361-8a89-fc39e90869e1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:16.739722 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1176/2313] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:16 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:16.747241 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024afcb-2bf3-4e1e-aab7-1b1c6f85cb17 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:16.831110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d8a5a-610a-4361-8a89-fc39e90869e1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:16.844073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024afcb-2bf3-4e1e-aab7-1b1c6f85cb17 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:16.849463 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e6785-0711-4481-b448-0c5d12203e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:16.850160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e6785-0711-4481-b448-0c5d12203e24 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:16.851118 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e6785-0711-4481-b448-0c5d12203e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:16.851329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e6785-0711-4481-b448-0c5d12203e24 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:16.852037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e6785-0711-4481-b448-0c5d12203e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:16.854157 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e6785-0711-4481-b448-0c5d12203e24 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:16.903060 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaf289-e893-4f2b-9e1b-5b70bf5d3595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:16.903739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaf289-e893-4f2b-9e1b-5b70bf5d3595 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:16.904013 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaf289-e893-4f2b-9e1b-5b70bf5d3595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:16.904288 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaf289-e893-4f2b-9e1b-5b70bf5d3595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:16.905005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaf289-e893-4f2b-9e1b-5b70bf5d3595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:16.906621 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaf289-e893-4f2b-9e1b-5b70bf5d3595 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:16.920591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1138/2314] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:16.921607 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaf289-e893-4f2b-9e1b-5b70bf5d3595 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:16.932566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaf289-e893-4f2b-9e1b-5b70bf5d3595 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:16.938265 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005b626-4868-461b-8b98-c118511ceecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:16.939264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005b626-4868-461b-8b98-c118511ceecc admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:16.939619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005b626-4868-461b-8b98-c118511ceecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:16.940049 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005b626-4868-461b-8b98-c118511ceecc admin admin] PATH_INFO: `/v3/projects/52a9ef270bdc43459f9ec8b1e57783c8/users/2173c4028b914899aa4582a867d001ae/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:16.940768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1177/2315] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:16 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:16.941911 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e6785-0711-4481-b448-0c5d12203e24 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:16.942862 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005b626-4868-461b-8b98-c118511ceecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a9ef270bdc43459f9ec8b1e57783c8, user_id=2173c4028b914899aa4582a867d001ae, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:16.946868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005b626-4868-461b-8b98-c118511ceecc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:16.957410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e6785-0711-4481-b448-0c5d12203e24 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:16.966332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1139/2316] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:16 2022] PUT /identity/v3/projects/52a9ef270bdc43459f9ec8b1e57783c8/users/2173c4028b914899aa4582a867d001ae/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:35:16.973611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01ba7c-9a7b-4afd-a1c8-862fb3a5f4dc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:16.975617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01ba7c-9a7b-4afd-a1c8-862fb3a5f4dc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:16.976975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01ba7c-9a7b-4afd-a1c8-862fb3a5f4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:17.010408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ce01ba7c-9a7b-4afd-a1c8-862fb3a5f4dc None None] MFA Rules not processed for user `2173c4028b914899aa4582a867d001ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:17.011870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ce01ba7c-9a7b-4afd-a1c8-862fb3a5f4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:17.041362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061ba9b-c1ab-4d56-8ff7-86ddd4460a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:17.042136 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061ba9b-c1ab-4d56-8ff7-86ddd4460a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:17.042668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061ba9b-c1ab-4d56-8ff7-86ddd4460a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:17.042980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061ba9b-c1ab-4d56-8ff7-86ddd4460a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:17.043885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061ba9b-c1ab-4d56-8ff7-86ddd4460a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:17.045733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061ba9b-c1ab-4d56-8ff7-86ddd4460a88 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:17.059951 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1178/2317] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:17.064011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061ba9b-c1ab-4d56-8ff7-86ddd4460a88 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:17.077744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061ba9b-c1ab-4d56-8ff7-86ddd4460a88 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:17.084311 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c8a4e-c95f-4f4a-9ca7-53b25ddf1f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:17.085028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8a4e-c95f-4f4a-9ca7-53b25ddf1f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:17.085312 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8a4e-c95f-4f4a-9ca7-53b25ddf1f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:17.085590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8a4e-c95f-4f4a-9ca7-53b25ddf1f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:17.086337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c8a4e-c95f-4f4a-9ca7-53b25ddf1f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:17.088077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c8a4e-c95f-4f4a-9ca7-53b25ddf1f3a admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:17.102167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1179/2318] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:17.104020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c8a4e-c95f-4f4a-9ca7-53b25ddf1f3a admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:17.107746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1140/2319] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:17.119711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01ba7c-9a7b-4afd-a1c8-862fb3a5f4dc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:17.121293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c8a4e-c95f-4f4a-9ca7-53b25ddf1f3a admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:17.121652 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ce01ba7c-9a7b-4afd-a1c8-862fb3a5f4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:17.128947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a64591-5687-4316-9ac5-a502ccae7ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:17.130071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a64591-5687-4316-9ac5-a502ccae7ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:17.130221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a64591-5687-4316-9ac5-a502ccae7ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:17.130414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a64591-5687-4316-9ac5-a502ccae7ff7 admin admin] PATH_INFO: `/v3/projects/9e3d8f068e6b41d385d3fdc46ac8b06c/users/986c778234494f8cbbed7e7ff9537f19/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:17.148570 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a64591-5687-4316-9ac5-a502ccae7ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3d8f068e6b41d385d3fdc46ac8b06c, user_id=986c778234494f8cbbed7e7ff9537f19, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:17.151323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a64591-5687-4316-9ac5-a502ccae7ff7 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:17.196820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01ba7c-9a7b-4afd-a1c8-862fb3a5f4dc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:17.201236 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b4ed1-efc5-404d-ac69-a28ca7d06891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:17.202210 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b4ed1-efc5-404d-ac69-a28ca7d06891 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:17.202369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b4ed1-efc5-404d-ac69-a28ca7d06891 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:17.202624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b4ed1-efc5-404d-ac69-a28ca7d06891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:17.216379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b4ed1-efc5-404d-ac69-a28ca7d06891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:17.218012 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b4ed1-efc5-404d-ac69-a28ca7d06891 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:17.228862 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1141/2320] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:35:17.244130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1180/2321] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:17 2022] PUT /identity/v3/projects/9e3d8f068e6b41d385d3fdc46ac8b06c/users/986c778234494f8cbbed7e7ff9537f19/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:35:17.261472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e67d4-909b-40f1-8118-112ffb1a1583 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:17.262876 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e67d4-909b-40f1-8118-112ffb1a1583 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:17.262876 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e67d4-909b-40f1-8118-112ffb1a1583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:17.264575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a64591-5687-4316-9ac5-a502ccae7ff7 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:17.295025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-096e67d4-909b-40f1-8118-112ffb1a1583 None None] MFA Rules not processed for user `986c778234494f8cbbed7e7ff9537f19`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:17.296553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-096e67d4-909b-40f1-8118-112ffb1a1583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:17.351255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a64591-5687-4316-9ac5-a502ccae7ff7 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:17.357787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:17.359129 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:17.359457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:17.359775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] PATH_INFO: `/v3/users/6de9260af9284b939847aeb74c467fd0` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:17.361002 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de9260af9284b939847aeb74c467fd0)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:17.363011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:17.385222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1142/2322] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:17.393295 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e67d4-909b-40f1-8118-112ffb1a1583 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:17.479142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e67d4-909b-40f1-8118-112ffb1a1583 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:17.483423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fce8a2-e00a-447b-8abb-c1a309970bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:17.484257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fce8a2-e00a-447b-8abb-c1a309970bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:17.484684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fce8a2-e00a-447b-8abb-c1a309970bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:17.485036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fce8a2-e00a-447b-8abb-c1a309970bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:17.496350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fce8a2-e00a-447b-8abb-c1a309970bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:17.498063 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fce8a2-e00a-447b-8abb-c1a309970bf0 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:17.504644 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de9260af9284b939847aeb74c467fd0'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:17.510513 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1143/2323] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:17.526961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de9260af9284b939847aeb74c467fd0'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:17.639556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de9260af9284b939847aeb74c467fd0'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:17.643229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de9260af9284b939847aeb74c467fd0'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:17.668989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de9260af9284b939847aeb74c467fd0'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:17.680458 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1181/2324] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:35:17 2022] DELETE /identity/v3/users/6de9260af9284b939847aeb74c467fd0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:17.685062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971d525-170d-4b91-86ad-dfe780aef429 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:17.685596 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971d525-170d-4b91-86ad-dfe780aef429 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:17.685955 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971d525-170d-4b91-86ad-dfe780aef429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:17.708422 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5971d525-170d-4b91-86ad-dfe780aef429 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:17.709641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5971d525-170d-4b91-86ad-dfe780aef429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:17.814137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1144/2325] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:17.824442 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:17.825839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:17.911165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630adbe9-7638-47c4-8eee-cb055106eec1 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:17.916292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5727e93-ce3a-4a21-9ea1-237216cfabf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:17.917339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5727e93-ce3a-4a21-9ea1-237216cfabf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:17.918214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5727e93-ce3a-4a21-9ea1-237216cfabf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:17.923147 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5727e93-ce3a-4a21-9ea1-237216cfabf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:17.943666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5727e93-ce3a-4a21-9ea1-237216cfabf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:17.945309 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5727e93-ce3a-4a21-9ea1-237216cfabf4 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:17.967580 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1182/2326] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:18.517284 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971d525-170d-4b91-86ad-dfe780aef429 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:18.519483 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5971d525-170d-4b91-86ad-dfe780aef429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:18.553970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971d525-170d-4b91-86ad-dfe780aef429 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:18.561903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:18.563298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:18.565817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:18.565817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba admin admin] PATH_INFO: `/v3/projects/6cc11e70b59c4427bc16b63064b2ecc6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:18.565817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc11e70b59c4427bc16b63064b2ecc6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:18.567078 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:18.690601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc11e70b59c4427bc16b63064b2ecc6', 'request_id': 'req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:18.697847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc11e70b59c4427bc16b63064b2ecc6', 'request_id': 'req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:18.787404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc11e70b59c4427bc16b63064b2ecc6', 'request_id': 'req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:18.804775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba admin admin] The token cache is being invalidate because project 6cc11e70b59c4427bc16b63064b2ecc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:18.807819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:18.809464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8a3d5994-7a0d-4941-856a-f543f8ecf0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:18.819190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1145/2327] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:35:18 2022] DELETE /identity/v3/projects/6cc11e70b59c4427bc16b63064b2ecc6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:18.820973 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5727e93-ce3a-4a21-9ea1-237216cfabf4 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:18.833532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5727e93-ce3a-4a21-9ea1-237216cfabf4 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:18.904432 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:18.905403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:18.905843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:18.906130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] PATH_INFO: `/v3/users/2173c4028b914899aa4582a867d001ae` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:18.907572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2173c4028b914899aa4582a867d001ae)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:18.909400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:19.097428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2173c4028b914899aa4582a867d001ae'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:19.105907 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2173c4028b914899aa4582a867d001ae'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:19.201537 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2173c4028b914899aa4582a867d001ae'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:19.203098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2173c4028b914899aa4582a867d001ae'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:19.217708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2173c4028b914899aa4582a867d001ae'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:19.233255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1183/2328] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:35:18 2022] DELETE /identity/v3/users/2173c4028b914899aa4582a867d001ae => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:19.323336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8b09-3d20-4d08-85bb-7533c9311a3e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:19.324236 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8b09-3d20-4d08-85bb-7533c9311a3e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:19.325031 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8b09-3d20-4d08-85bb-7533c9311a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:19.348433 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-755a8b09-3d20-4d08-85bb-7533c9311a3e None None] MFA Rules not processed for user `986c778234494f8cbbed7e7ff9537f19`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:19.349996 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-755a8b09-3d20-4d08-85bb-7533c9311a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:19.416583 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1146/2329] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:19.675015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:19.676778 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:19.778484 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94931b81-4a44-4395-a5fd-baa2ea629871 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:19.785612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4d179-409e-4f9f-bb01-c12344c63b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:19.786685 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4d179-409e-4f9f-bb01-c12344c63b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:19.786976 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4d179-409e-4f9f-bb01-c12344c63b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:19.787259 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4d179-409e-4f9f-bb01-c12344c63b2c admin admin] PATH_INFO: `/v3/projects/52a9ef270bdc43459f9ec8b1e57783c8` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:19.789878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4d179-409e-4f9f-bb01-c12344c63b2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a9ef270bdc43459f9ec8b1e57783c8)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:19.791931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4d179-409e-4f9f-bb01-c12344c63b2c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:19.925396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f1e4d179-409e-4f9f-bb01-c12344c63b2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a9ef270bdc43459f9ec8b1e57783c8', 'request_id': 'req-f1e4d179-409e-4f9f-bb01-c12344c63b2c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:19.937685 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f1e4d179-409e-4f9f-bb01-c12344c63b2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a9ef270bdc43459f9ec8b1e57783c8', 'request_id': 'req-f1e4d179-409e-4f9f-bb01-c12344c63b2c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:20.055830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f1e4d179-409e-4f9f-bb01-c12344c63b2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a9ef270bdc43459f9ec8b1e57783c8', 'request_id': 'req-f1e4d179-409e-4f9f-bb01-c12344c63b2c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:20.069951 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f1e4d179-409e-4f9f-bb01-c12344c63b2c admin admin] The token cache is being invalidate because project 52a9ef270bdc43459f9ec8b1e57783c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:20.070390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f1e4d179-409e-4f9f-bb01-c12344c63b2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:20.071182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f1e4d179-409e-4f9f-bb01-c12344c63b2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:20.073680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1184/2330] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:35:19 2022] DELETE /identity/v3/projects/52a9ef270bdc43459f9ec8b1e57783c8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:20.078446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9bb16-1ce4-4850-b47b-b0fda552834f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:20.078919 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9bb16-1ce4-4850-b47b-b0fda552834f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:20.079191 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9bb16-1ce4-4850-b47b-b0fda552834f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:20.102426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-80b9bb16-1ce4-4850-b47b-b0fda552834f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:20.103781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-80b9bb16-1ce4-4850-b47b-b0fda552834f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:20.170187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1147/2331] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:20.178087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0815ac-43ec-4815-a885-1835e5476033 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:20.179585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0815ac-43ec-4815-a885-1835e5476033 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:20.179585 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0815ac-43ec-4815-a885-1835e5476033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:20.203799 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-9c0815ac-43ec-4815-a885-1835e5476033 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:20.205268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9c0815ac-43ec-4815-a885-1835e5476033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:20.214569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1185/2332] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:20.219098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9bb16-1ce4-4850-b47b-b0fda552834f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:20.233831 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9bb16-1ce4-4850-b47b-b0fda552834f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:20.239576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4091ee6-9cc3-4f9f-a5bc-71aaf6353af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:20.240411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4091ee6-9cc3-4f9f-a5bc-71aaf6353af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:20.240827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4091ee6-9cc3-4f9f-a5bc-71aaf6353af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:20.241847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4091ee6-9cc3-4f9f-a5bc-71aaf6353af7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:20.242720 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4091ee6-9cc3-4f9f-a5bc-71aaf6353af7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:35:20.243129 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4091ee6-9cc3-4f9f-a5bc-71aaf6353af7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:20.244907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4091ee6-9cc3-4f9f-a5bc-71aaf6353af7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:20.259592 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1148/2333] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:35:20.267374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0815ac-43ec-4815-a885-1835e5476033 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:20.294416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0815ac-43ec-4815-a885-1835e5476033 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:20.307540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5ac2d-ee64-4456-b862-17cce1f99cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:20.312156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5ac2d-ee64-4456-b862-17cce1f99cab admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:20.312156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5ac2d-ee64-4456-b862-17cce1f99cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:20.312156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5ac2d-ee64-4456-b862-17cce1f99cab admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:20.312156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5ac2d-ee64-4456-b862-17cce1f99cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:20.313698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5ac2d-ee64-4456-b862-17cce1f99cab admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:20.416323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1186/2334] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:20 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:20.421082 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4091ee6-9cc3-4f9f-a5bc-71aaf6353af7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:20.432535 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4091ee6-9cc3-4f9f-a5bc-71aaf6353af7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:20.494899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a440b-72a4-4d8c-9a54-ef7a26535d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:20.495609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a440b-72a4-4d8c-9a54-ef7a26535d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:20.495897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a440b-72a4-4d8c-9a54-ef7a26535d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:20.496172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a440b-72a4-4d8c-9a54-ef7a26535d88 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:20.496895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a440b-72a4-4d8c-9a54-ef7a26535d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:20.499086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a440b-72a4-4d8c-9a54-ef7a26535d88 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:20.628588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1149/2335] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:20 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:20.629617 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5ac2d-ee64-4456-b862-17cce1f99cab admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:20.641057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5ac2d-ee64-4456-b862-17cce1f99cab admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:20.645901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6899003-3c6e-4416-ae68-963f48f10ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:20.646600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6899003-3c6e-4416-ae68-963f48f10ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:20.646884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6899003-3c6e-4416-ae68-963f48f10ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:20.647212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6899003-3c6e-4416-ae68-963f48f10ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:20.648437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6899003-3c6e-4416-ae68-963f48f10ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:20.650163 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6899003-3c6e-4416-ae68-963f48f10ac9 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:20.663491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1187/2336] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:35:20.670043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a440b-72a4-4d8c-9a54-ef7a26535d88 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:20.681762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a440b-72a4-4d8c-9a54-ef7a26535d88 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:20.686960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d409a8-dbf1-427e-9b6a-fa404f3ac227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:20.687627 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d409a8-dbf1-427e-9b6a-fa404f3ac227 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:20.687915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d409a8-dbf1-427e-9b6a-fa404f3ac227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:20.688191 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d409a8-dbf1-427e-9b6a-fa404f3ac227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:20.688904 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d409a8-dbf1-427e-9b6a-fa404f3ac227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:20.690637 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d409a8-dbf1-427e-9b6a-fa404f3ac227 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:20.702362 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1150/2337] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:20.706926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6899003-3c6e-4416-ae68-963f48f10ac9 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:20.718922 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6899003-3c6e-4416-ae68-963f48f10ac9 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:20.724512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b31dd-fc4a-4eb0-ab68-49783c1a404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:20.726268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b31dd-fc4a-4eb0-ab68-49783c1a404c admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:20.726630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b31dd-fc4a-4eb0-ab68-49783c1a404c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:20.726916 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b31dd-fc4a-4eb0-ab68-49783c1a404c admin admin] PATH_INFO: `/v3/projects/548df14543994a3e97a09384f1e1f2cd/users/ebc8e237bc044da3a30b5cc6dc500baf/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:20.745575 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b31dd-fc4a-4eb0-ab68-49783c1a404c admin admin] RBAC: Authorizing `identity:create_grant(project_id=548df14543994a3e97a09384f1e1f2cd, user_id=ebc8e237bc044da3a30b5cc6dc500baf, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:20.749301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b31dd-fc4a-4eb0-ab68-49783c1a404c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:20.825057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1188/2338] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:20 2022] PUT /identity/v3/projects/548df14543994a3e97a09384f1e1f2cd/users/ebc8e237bc044da3a30b5cc6dc500baf/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:20.838434 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa956e0-7c48-4c9b-9bbf-076e7c58ca3e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:20.838853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa956e0-7c48-4c9b-9bbf-076e7c58ca3e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:20.839155 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa956e0-7c48-4c9b-9bbf-076e7c58ca3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:20.872647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7aa956e0-7c48-4c9b-9bbf-076e7c58ca3e None None] MFA Rules not processed for user `ebc8e237bc044da3a30b5cc6dc500baf`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:20.874043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7aa956e0-7c48-4c9b-9bbf-076e7c58ca3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:20.952167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1151/2339] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:20.956914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b31dd-fc4a-4eb0-ab68-49783c1a404c admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:21.022810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b31dd-fc4a-4eb0-ab68-49783c1a404c admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:21.027780 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2976f-ccd6-40b2-8f1f-7c72a84b3ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:21.028446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2976f-ccd6-40b2-8f1f-7c72a84b3ddc admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:21.028732 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2976f-ccd6-40b2-8f1f-7c72a84b3ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:21.029013 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2976f-ccd6-40b2-8f1f-7c72a84b3ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:21.029738 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2976f-ccd6-40b2-8f1f-7c72a84b3ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:21.032021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2976f-ccd6-40b2-8f1f-7c72a84b3ddc admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:21.129111 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1189/2340] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:20 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:21.135851 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa956e0-7c48-4c9b-9bbf-076e7c58ca3e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:21.151733 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa956e0-7c48-4c9b-9bbf-076e7c58ca3e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:21.236610 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d044d2d-ce5c-46c5-8339-2fe6142edfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:21.238742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d044d2d-ce5c-46c5-8339-2fe6142edfe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:21.239593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d044d2d-ce5c-46c5-8339-2fe6142edfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:21.240131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d044d2d-ce5c-46c5-8339-2fe6142edfe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:21.241786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d044d2d-ce5c-46c5-8339-2fe6142edfe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:21.245210 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d044d2d-ce5c-46c5-8339-2fe6142edfe3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:21.326072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1152/2341] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:21 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:21.330808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2976f-ccd6-40b2-8f1f-7c72a84b3ddc admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:21.343940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2976f-ccd6-40b2-8f1f-7c72a84b3ddc admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:21.351060 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d7bf4-2db9-490f-ada9-8bd381c3e5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:21.352265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d7bf4-2db9-490f-ada9-8bd381c3e5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:21.352801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d7bf4-2db9-490f-ada9-8bd381c3e5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:21.353176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d7bf4-2db9-490f-ada9-8bd381c3e5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:21.354093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d7bf4-2db9-490f-ada9-8bd381c3e5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:21.355966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d7bf4-2db9-490f-ada9-8bd381c3e5c2 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:21.369496 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1190/2342] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:21.373737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d044d2d-ce5c-46c5-8339-2fe6142edfe3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:21.385006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d044d2d-ce5c-46c5-8339-2fe6142edfe3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:21.390411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d911c97-cbd1-4291-894a-2edb6204b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:21.400595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d911c97-cbd1-4291-894a-2edb6204b05f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:21.400595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d911c97-cbd1-4291-894a-2edb6204b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:21.400595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d911c97-cbd1-4291-894a-2edb6204b05f admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:21.400595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d911c97-cbd1-4291-894a-2edb6204b05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:21.400595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d911c97-cbd1-4291-894a-2edb6204b05f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:21.408199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1153/2343] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:21.419366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d7bf4-2db9-490f-ada9-8bd381c3e5c2 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:21.433249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d7bf4-2db9-490f-ada9-8bd381c3e5c2 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:21.441087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87e201-329e-405d-830a-993326d5d384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:21.442434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87e201-329e-405d-830a-993326d5d384 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:21.442816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87e201-329e-405d-830a-993326d5d384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:21.443195 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87e201-329e-405d-830a-993326d5d384 admin admin] PATH_INFO: `/v3/projects/8abc9c23aeee4d179ef354c364a3a743/users/a2afe1910231497f89f1f71774f9379d/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:21.460243 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87e201-329e-405d-830a-993326d5d384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abc9c23aeee4d179ef354c364a3a743, user_id=a2afe1910231497f89f1f71774f9379d, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:21.463429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87e201-329e-405d-830a-993326d5d384 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:21.534394 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1191/2344] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:21 2022] PUT /identity/v3/projects/8abc9c23aeee4d179ef354c364a3a743/users/a2afe1910231497f89f1f71774f9379d/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:21.544963 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d3862-a3e7-482c-a320-91ed50139f96 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:21.545352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d3862-a3e7-482c-a320-91ed50139f96 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:21.545650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d3862-a3e7-482c-a320-91ed50139f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:21.594000 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-741d3862-a3e7-482c-a320-91ed50139f96 None None] MFA Rules not processed for user `a2afe1910231497f89f1f71774f9379d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:21.595961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-741d3862-a3e7-482c-a320-91ed50139f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:21.687530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1154/2345] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:21.688435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87e201-329e-405d-830a-993326d5d384 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:21.756507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87e201-329e-405d-830a-993326d5d384 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:21.762409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f1d74-a3b8-4cdf-a573-b0f849db17f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:21.763344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f1d74-a3b8-4cdf-a573-b0f849db17f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:21.763732 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f1d74-a3b8-4cdf-a573-b0f849db17f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:21.764155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f1d74-a3b8-4cdf-a573-b0f849db17f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:21.765021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f1d74-a3b8-4cdf-a573-b0f849db17f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:21.767098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f1d74-a3b8-4cdf-a573-b0f849db17f2 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:21.859041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1192/2346] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:21 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:35:21.863602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d3862-a3e7-482c-a320-91ed50139f96 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:21.879988 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d3862-a3e7-482c-a320-91ed50139f96 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:21.941233 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a9e34-5561-4362-9c3d-e86fb84f007c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:21.941994 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a9e34-5561-4362-9c3d-e86fb84f007c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:21.942194 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a9e34-5561-4362-9c3d-e86fb84f007c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:21.942503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a9e34-5561-4362-9c3d-e86fb84f007c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:21.943200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a9e34-5561-4362-9c3d-e86fb84f007c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:21.945471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a9e34-5561-4362-9c3d-e86fb84f007c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:22.015785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1155/2347] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:21 2022] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:22.019970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f1d74-a3b8-4cdf-a573-b0f849db17f2 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:22.031522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f1d74-a3b8-4cdf-a573-b0f849db17f2 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:22.037228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247c2b0-5024-459c-bcbb-f065438852fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:22.038709 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247c2b0-5024-459c-bcbb-f065438852fe admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:22.039250 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247c2b0-5024-459c-bcbb-f065438852fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:22.039554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247c2b0-5024-459c-bcbb-f065438852fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:22.040266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247c2b0-5024-459c-bcbb-f065438852fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:22.041971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247c2b0-5024-459c-bcbb-f065438852fe admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:22.054194 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1193/2348] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:35:22.058598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a9e34-5561-4362-9c3d-e86fb84f007c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:22.069781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a9e34-5561-4362-9c3d-e86fb84f007c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:22.075167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92542500-26d9-4d32-8476-be41898b318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:22.076072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92542500-26d9-4d32-8476-be41898b318b admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:22.076394 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92542500-26d9-4d32-8476-be41898b318b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:22.076656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92542500-26d9-4d32-8476-be41898b318b admin admin] PATH_INFO: `/v3/projects/0269807e4b3b45258fc1017cf8966ef8/users/ac7fa3ee455c4b25a7cb477772992765/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:22.093786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92542500-26d9-4d32-8476-be41898b318b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0269807e4b3b45258fc1017cf8966ef8, user_id=ac7fa3ee455c4b25a7cb477772992765, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:22.096570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92542500-26d9-4d32-8476-be41898b318b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:22.159421 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1156/2349] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:22 2022] PUT /identity/v3/projects/0269807e4b3b45258fc1017cf8966ef8/users/ac7fa3ee455c4b25a7cb477772992765/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:22.163824 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247c2b0-5024-459c-bcbb-f065438852fe admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:22.177257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247c2b0-5024-459c-bcbb-f065438852fe admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:22.248734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f2437-8280-4a24-8449-d8e029a2557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:22.249849 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f2437-8280-4a24-8449-d8e029a2557f admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:22.250614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f2437-8280-4a24-8449-d8e029a2557f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:22.250983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f2437-8280-4a24-8449-d8e029a2557f admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:22.251852 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f2437-8280-4a24-8449-d8e029a2557f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:22.253702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f2437-8280-4a24-8449-d8e029a2557f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:22.265721 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1194/2350] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:22.270298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92542500-26d9-4d32-8476-be41898b318b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:22.282300 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92542500-26d9-4d32-8476-be41898b318b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:22.290981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08dc4f-614f-4aae-9c5c-f553b8468d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:22.292220 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08dc4f-614f-4aae-9c5c-f553b8468d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:22.292671 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08dc4f-614f-4aae-9c5c-f553b8468d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:22.293179 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08dc4f-614f-4aae-9c5c-f553b8468d9a admin admin] PATH_INFO: `/v3/projects/0269807e4b3b45258fc1017cf8966ef8/users/ac7fa3ee455c4b25a7cb477772992765/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:22.295400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08dc4f-614f-4aae-9c5c-f553b8468d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0269807e4b3b45258fc1017cf8966ef8, user_id=ac7fa3ee455c4b25a7cb477772992765, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:22.298565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08dc4f-614f-4aae-9c5c-f553b8468d9a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:22.316723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1157/2351] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:22 2022] PUT /identity/v3/projects/0269807e4b3b45258fc1017cf8966ef8/users/ac7fa3ee455c4b25a7cb477772992765/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:22.327581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaea99-4291-4938-8267-172ef258f538 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:22.328428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaea99-4291-4938-8267-172ef258f538 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:22.328914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaea99-4291-4938-8267-172ef258f538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:22.370629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-1deaea99-4291-4938-8267-172ef258f538 None None] MFA Rules not processed for user `ac7fa3ee455c4b25a7cb477772992765`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:22.380676 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1deaea99-4291-4938-8267-172ef258f538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:22.592061 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1195/2352] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:22.603844 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08dc4f-614f-4aae-9c5c-f553b8468d9a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:22.607798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aa08dc4f-614f-4aae-9c5c-f553b8468d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:22.709453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08dc4f-614f-4aae-9c5c-f553b8468d9a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:22.719433 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb9afa-6ede-4a17-9ee3-c905f9822811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:22.720443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb9afa-6ede-4a17-9ee3-c905f9822811 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:22.720805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb9afa-6ede-4a17-9ee3-c905f9822811 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:22.721160 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb9afa-6ede-4a17-9ee3-c905f9822811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:22.758105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb9afa-6ede-4a17-9ee3-c905f9822811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:22.760782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb9afa-6ede-4a17-9ee3-c905f9822811 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:22.798625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1158/2353] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:23.932894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf35fb-44c2-49f3-af2f-971f01a5c7ee None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:23.933408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf35fb-44c2-49f3-af2f-971f01a5c7ee None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:23.933489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf35fb-44c2-49f3-af2f-971f01a5c7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:23.966172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-62bf35fb-44c2-49f3-af2f-971f01a5c7ee None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:23.968117 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-62bf35fb-44c2-49f3-af2f-971f01a5c7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:24.127837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1196/2354] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:35:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:24.129659 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb9afa-6ede-4a17-9ee3-c905f9822811 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:24.131020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-acbb9afa-6ede-4a17-9ee3-c905f9822811 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:24.142661 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf35fb-44c2-49f3-af2f-971f01a5c7ee None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:24.143557 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb9afa-6ede-4a17-9ee3-c905f9822811 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:24.144181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-62bf35fb-44c2-49f3-af2f-971f01a5c7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:24.147302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf268a3f-d48e-4d87-9848-d6533e3df9eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:24.148058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268a3f-d48e-4d87-9848-d6533e3df9eb service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:24.148500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268a3f-d48e-4d87-9848-d6533e3df9eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:24.149963 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268a3f-d48e-4d87-9848-d6533e3df9eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:24.224195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf268a3f-d48e-4d87-9848-d6533e3df9eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:24.224994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf35fb-44c2-49f3-af2f-971f01a5c7ee None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:24.229199 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf268a3f-d48e-4d87-9848-d6533e3df9eb service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:24.230150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8916b42-d0b4-4054-89fc-7cfdc93f42f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:24.230835 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8916b42-d0b4-4054-89fc-7cfdc93f42f7 service swift] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:24.231295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8916b42-d0b4-4054-89fc-7cfdc93f42f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:24.231743 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8916b42-d0b4-4054-89fc-7cfdc93f42f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:24.237245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1159/2355] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:24.247159 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8916b42-d0b4-4054-89fc-7cfdc93f42f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:24.248828 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8916b42-d0b4-4054-89fc-7cfdc93f42f7 service swift] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:24.259543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1197/2356] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:35:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:35:30.173013 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf268a3f-d48e-4d87-9848-d6533e3df9eb service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:30.190584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf268a3f-d48e-4d87-9848-d6533e3df9eb service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:30.196766 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d73538-9e34-4fa8-9b7b-e665bb464c1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:30.197823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d73538-9e34-4fa8-9b7b-e665bb464c1e service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:30.198315 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d73538-9e34-4fa8-9b7b-e665bb464c1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:30.199038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d73538-9e34-4fa8-9b7b-e665bb464c1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:30.394359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d73538-9e34-4fa8-9b7b-e665bb464c1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:30.399243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d73538-9e34-4fa8-9b7b-e665bb464c1e service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:30.415152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1160/2357] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:35.712431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8916b42-d0b4-4054-89fc-7cfdc93f42f7 service swift] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:35.810329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8916b42-d0b4-4054-89fc-7cfdc93f42f7 service swift] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:35.814132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d827fb-c5b8-441c-aff9-0f8172fc532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:35.817204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d827fb-c5b8-441c-aff9-0f8172fc532a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:35.817204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d827fb-c5b8-441c-aff9-0f8172fc532a admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:35.817204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d827fb-c5b8-441c-aff9-0f8172fc532a admin admin] PATH_INFO: `/v3/users/ebc8e237bc044da3a30b5cc6dc500baf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:35.817520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d827fb-c5b8-441c-aff9-0f8172fc532a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc8e237bc044da3a30b5cc6dc500baf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:35.820351 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d827fb-c5b8-441c-aff9-0f8172fc532a admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:36.541096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-01d827fb-c5b8-441c-aff9-0f8172fc532a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc8e237bc044da3a30b5cc6dc500baf'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:36.548908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-01d827fb-c5b8-441c-aff9-0f8172fc532a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc8e237bc044da3a30b5cc6dc500baf'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:36.587887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8217ae7-2462-49eb-9724-036fccfe91ee None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:36.588782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8217ae7-2462-49eb-9724-036fccfe91ee None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:36.589127 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8217ae7-2462-49eb-9724-036fccfe91ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:36.645874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-01d827fb-c5b8-441c-aff9-0f8172fc532a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc8e237bc044da3a30b5cc6dc500baf'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:36.646787 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-01d827fb-c5b8-441c-aff9-0f8172fc532a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc8e237bc044da3a30b5cc6dc500baf'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:36.669724 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-01d827fb-c5b8-441c-aff9-0f8172fc532a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc8e237bc044da3a30b5cc6dc500baf'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:36.671558 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a8217ae7-2462-49eb-9724-036fccfe91ee None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:36.676028 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a8217ae7-2462-49eb-9724-036fccfe91ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:36.677785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1198/2358] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:35:35 2022] DELETE /identity/v3/users/ebc8e237bc044da3a30b5cc6dc500baf => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:36.683760 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c7dc-89a4-41d8-adcd-3da2ad696739 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:36.684371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c7dc-89a4-41d8-adcd-3da2ad696739 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:36.684754 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c7dc-89a4-41d8-adcd-3da2ad696739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:36.727619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ae77c7dc-89a4-41d8-adcd-3da2ad696739 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:36.730550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ae77c7dc-89a4-41d8-adcd-3da2ad696739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:36.798446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1161/2359] 10.222.0.44 () {58 vars in 967 bytes} [Thu May 5 15:35:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:36.806714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8217ae7-2462-49eb-9724-036fccfe91ee None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:36.809389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a8217ae7-2462-49eb-9724-036fccfe91ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:36.849527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1199/2360] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:36.854721 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c7dc-89a4-41d8-adcd-3da2ad696739 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:36.857720 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ae77c7dc-89a4-41d8-adcd-3da2ad696739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:36.913427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8217ae7-2462-49eb-9724-036fccfe91ee None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:36.928068 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:36.929386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:36.929819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:36.930202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] PATH_INFO: `/v3/users/74ac3a6655814635ad3706d12ee2d19b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:36.932344 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ac3a6655814635ad3706d12ee2d19b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:36.934499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:36.975014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c7dc-89a4-41d8-adcd-3da2ad696739 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:36.982172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd0499-41e4-4089-8c6a-c7833321f86a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:36.982998 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd0499-41e4-4089-8c6a-c7833321f86a service swift] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:36.983350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd0499-41e4-4089-8c6a-c7833321f86a service swift] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:36.983755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd0499-41e4-4089-8c6a-c7833321f86a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:36.992975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd0499-41e4-4089-8c6a-c7833321f86a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:36.994668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd0499-41e4-4089-8c6a-c7833321f86a service swift] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:37.003339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1200/2361] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:35:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:35:37.004220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd0499-41e4-4089-8c6a-c7833321f86a service swift] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:37.005660 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-dcbd0499-41e4-4089-8c6a-c7833321f86a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:37.074335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd0499-41e4-4089-8c6a-c7833321f86a service swift] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:37.079148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b8c0d-0726-4856-b018-13ae1b8a14e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:37.079994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8c0d-0726-4856-b018-13ae1b8a14e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:37.080381 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8c0d-0726-4856-b018-13ae1b8a14e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:37.080829 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8c0d-0726-4856-b018-13ae1b8a14e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:37.091614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b8c0d-0726-4856-b018-13ae1b8a14e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:37.093142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b8c0d-0726-4856-b018-13ae1b8a14e6 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:37.104261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1201/2362] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:37.154100 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ac3a6655814635ad3706d12ee2d19b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:37.162168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ac3a6655814635ad3706d12ee2d19b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:37.163553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ac3a6655814635ad3706d12ee2d19b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:37.165082 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ac3a6655814635ad3706d12ee2d19b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:37.186930 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ac3a6655814635ad3706d12ee2d19b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:37.277954 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1162/2363] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:35:36 2022] DELETE /identity/v3/users/74ac3a6655814635ad3706d12ee2d19b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:37.279648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8666edc-74d3-49e4-ae1e-ea0f41fd6ff1 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:37.279941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8666edc-74d3-49e4-ae1e-ea0f41fd6ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:37.280226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8666edc-74d3-49e4-ae1e-ea0f41fd6ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:37.301063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e8666edc-74d3-49e4-ae1e-ea0f41fd6ff1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:37.302351 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e8666edc-74d3-49e4-ae1e-ea0f41fd6ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:37.381592 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1202/2364] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:37.396405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:37.398677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:37.485321 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab01de-7a7b-4be8-85b9-e9b30506fe0a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:37.489608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212518a2-bbe8-4825-87b4-57b7ab859e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:37.490595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212518a2-bbe8-4825-87b4-57b7ab859e0d service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:37.491442 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212518a2-bbe8-4825-87b4-57b7ab859e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:37.491759 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212518a2-bbe8-4825-87b4-57b7ab859e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:37.502239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212518a2-bbe8-4825-87b4-57b7ab859e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:37.503706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212518a2-bbe8-4825-87b4-57b7ab859e0d service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:37.523306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1163/2365] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:35:37.783138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8666edc-74d3-49e4-ae1e-ea0f41fd6ff1 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:37.786566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e8666edc-74d3-49e4-ae1e-ea0f41fd6ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:37.807365 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8666edc-74d3-49e4-ae1e-ea0f41fd6ff1 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:37.813426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:37.814784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:37.816005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:37.816454 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] PATH_INFO: `/v3/projects/548df14543994a3e97a09384f1e1f2cd` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:37.818521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=548df14543994a3e97a09384f1e1f2cd)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:37.824826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:38.021468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548df14543994a3e97a09384f1e1f2cd', 'request_id': 'req-86b914f2-b037-42e7-89aa-9e162031db8e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.029758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548df14543994a3e97a09384f1e1f2cd', 'request_id': 'req-86b914f2-b037-42e7-89aa-9e162031db8e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.090758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548df14543994a3e97a09384f1e1f2cd', 'request_id': 'req-86b914f2-b037-42e7-89aa-9e162031db8e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.107668 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] The token cache is being invalidate because project 548df14543994a3e97a09384f1e1f2cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:38.107967 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.108640 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.110257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1203/2366] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:35:37 2022] DELETE /identity/v3/projects/548df14543994a3e97a09384f1e1f2cd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:38.131085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212518a2-bbe8-4825-87b4-57b7ab859e0d service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:38.140745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212518a2-bbe8-4825-87b4-57b7ab859e0d service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:38.199829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:38.202874 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:38.202874 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:38.202874 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] PATH_INFO: `/v3/users/a2afe1910231497f89f1f71774f9379d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:38.202874 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2afe1910231497f89f1f71774f9379d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:38.204407 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:38.260395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:38.262012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:38.276651 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b914f2-b037-42e7-89aa-9e162031db8e admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:38.282516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a3906-5282-45ea-941d-0013c51a2faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:38.283472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a3906-5282-45ea-941d-0013c51a2faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:38.283811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a3906-5282-45ea-941d-0013c51a2faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:38.284143 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a3906-5282-45ea-941d-0013c51a2faa admin admin] PATH_INFO: `/v3/projects/c5d7c7142a7e46dead5a87518c074060` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:38.285482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a3906-5282-45ea-941d-0013c51a2faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d7c7142a7e46dead5a87518c074060)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:38.287492 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a3906-5282-45ea-941d-0013c51a2faa admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:38.437464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-e52a3906-5282-45ea-941d-0013c51a2faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d7c7142a7e46dead5a87518c074060', 'request_id': 'req-e52a3906-5282-45ea-941d-0013c51a2faa'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.438121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2afe1910231497f89f1f71774f9379d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.443923 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-e52a3906-5282-45ea-941d-0013c51a2faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d7c7142a7e46dead5a87518c074060', 'request_id': 'req-e52a3906-5282-45ea-941d-0013c51a2faa'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.445071 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2afe1910231497f89f1f71774f9379d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.445846 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2afe1910231497f89f1f71774f9379d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.446551 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2afe1910231497f89f1f71774f9379d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.458604 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2afe1910231497f89f1f71774f9379d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.524521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-e52a3906-5282-45ea-941d-0013c51a2faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d7c7142a7e46dead5a87518c074060', 'request_id': 'req-e52a3906-5282-45ea-941d-0013c51a2faa'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.535540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-e52a3906-5282-45ea-941d-0013c51a2faa admin admin] The token cache is being invalidate because project c5d7c7142a7e46dead5a87518c074060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:38.538753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-e52a3906-5282-45ea-941d-0013c51a2faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.538753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-e52a3906-5282-45ea-941d-0013c51a2faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:38.538753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1204/2367] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:35:38 2022] DELETE /identity/v3/projects/c5d7c7142a7e46dead5a87518c074060 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:38.542842 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d78101-ba83-45d4-83f7-3ce698a58842 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:38.543136 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d78101-ba83-45d4-83f7-3ce698a58842 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:38.543415 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d78101-ba83-45d4-83f7-3ce698a58842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:38.562123 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-81d78101-ba83-45d4-83f7-3ce698a58842 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:38.563374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-81d78101-ba83-45d4-83f7-3ce698a58842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:38.621385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1205/2368] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:38.629000 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29bdfb-2d25-4900-a21f-7da13cb48c02 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:38.629287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29bdfb-2d25-4900-a21f-7da13cb48c02 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:38.629564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29bdfb-2d25-4900-a21f-7da13cb48c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:38.649919 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-1f29bdfb-2d25-4900-a21f-7da13cb48c02 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:38.651150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1f29bdfb-2d25-4900-a21f-7da13cb48c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:38.659155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1206/2369] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:38.663321 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29bdfb-2d25-4900-a21f-7da13cb48c02 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:38.672237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29bdfb-2d25-4900-a21f-7da13cb48c02 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:38.674423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1164/2370] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:35:38 2022] DELETE /identity/v3/users/a2afe1910231497f89f1f71774f9379d => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:38.678179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd86b6-44ad-4e60-ae48-0b87db3e5362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:38.678179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd86b6-44ad-4e60-ae48-0b87db3e5362 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:38.678179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd86b6-44ad-4e60-ae48-0b87db3e5362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:38.678179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd86b6-44ad-4e60-ae48-0b87db3e5362 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:38.679333 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd86b6-44ad-4e60-ae48-0b87db3e5362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:35:38.679644 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd86b6-44ad-4e60-ae48-0b87db3e5362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:38.681237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd86b6-44ad-4e60-ae48-0b87db3e5362 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:38.696953 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1207/2371] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:35:38.699003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:38.700408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:38.786334 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082613c-f2e7-47c2-a5de-67a1d027637f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:38.794749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768655e7-31cc-443c-aaf9-450057f93f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:38.794749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768655e7-31cc-443c-aaf9-450057f93f53 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:38.794749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768655e7-31cc-443c-aaf9-450057f93f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:38.794749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768655e7-31cc-443c-aaf9-450057f93f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:38.795447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768655e7-31cc-443c-aaf9-450057f93f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:38.796387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768655e7-31cc-443c-aaf9-450057f93f53 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:38.913317 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1165/2372] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:38 2022] POST /identity/v3/projects => generated 385 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:35:38.917715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd86b6-44ad-4e60-ae48-0b87db3e5362 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:38.931444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd86b6-44ad-4e60-ae48-0b87db3e5362 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:39.028403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d8448-4e27-438b-a8b2-e443793ab2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:39.030395 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d8448-4e27-438b-a8b2-e443793ab2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:39.030698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d8448-4e27-438b-a8b2-e443793ab2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:39.030987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d8448-4e27-438b-a8b2-e443793ab2b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:39.031716 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d8448-4e27-438b-a8b2-e443793ab2b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:39.033788 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d8448-4e27-438b-a8b2-e443793ab2b5 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:39.158273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1208/2373] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:38 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:39.159462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768655e7-31cc-443c-aaf9-450057f93f53 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:39.180457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768655e7-31cc-443c-aaf9-450057f93f53 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:39.185812 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416674f6-1010-435e-a274-3392784b2680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:39.186857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416674f6-1010-435e-a274-3392784b2680 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:39.187343 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416674f6-1010-435e-a274-3392784b2680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:39.187761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416674f6-1010-435e-a274-3392784b2680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:39.188716 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416674f6-1010-435e-a274-3392784b2680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:39.190563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416674f6-1010-435e-a274-3392784b2680 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:39.204852 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1166/2374] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:39.208485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d8448-4e27-438b-a8b2-e443793ab2b5 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:39.219370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d8448-4e27-438b-a8b2-e443793ab2b5 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:39.224173 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e4abc-9c88-43e1-a6c3-ff5c4c8bc5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:39.224843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e4abc-9c88-43e1-a6c3-ff5c4c8bc5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:39.225132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e4abc-9c88-43e1-a6c3-ff5c4c8bc5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:39.225976 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e4abc-9c88-43e1-a6c3-ff5c4c8bc5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:39.226759 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e4abc-9c88-43e1-a6c3-ff5c4c8bc5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:39.228432 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e4abc-9c88-43e1-a6c3-ff5c4c8bc5d0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:39.238950 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1209/2375] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:39.243607 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416674f6-1010-435e-a274-3392784b2680 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:39.246239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e4abc-9c88-43e1-a6c3-ff5c4c8bc5d0 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:39.248642 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d25e4abc-9c88-43e1-a6c3-ff5c4c8bc5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:39.254823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416674f6-1010-435e-a274-3392784b2680 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:39.269552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51a79d-b30e-4957-9934-c8a071765473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:39.270570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51a79d-b30e-4957-9934-c8a071765473 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:39.270800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51a79d-b30e-4957-9934-c8a071765473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:39.271693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51a79d-b30e-4957-9934-c8a071765473 admin admin] PATH_INFO: `/v3/projects/b9373d1d19b54831ae91fb87c0faefed/users/9e6d29b571fe40f5ab82484e1c7c040b/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:39.272193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e4abc-9c88-43e1-a6c3-ff5c4c8bc5d0 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:39.290677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:39.291614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:39.291900 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:39.292177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] PATH_INFO: `/v3/projects/8abc9c23aeee4d179ef354c364a3a743` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:39.293463 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8abc9c23aeee4d179ef354c364a3a743)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:39.295535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:39.304292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51a79d-b30e-4957-9934-c8a071765473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9373d1d19b54831ae91fb87c0faefed, user_id=9e6d29b571fe40f5ab82484e1c7c040b, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:39.307222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51a79d-b30e-4957-9934-c8a071765473 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:39.406645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1167/2376] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:39 2022] PUT /identity/v3/projects/b9373d1d19b54831ae91fb87c0faefed/users/9e6d29b571fe40f5ab82484e1c7c040b/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:39.411798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2082c8-c09b-43df-8fe8-d59d740838a1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:39.412086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2082c8-c09b-43df-8fe8-d59d740838a1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:39.412365 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2082c8-c09b-43df-8fe8-d59d740838a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:39.418902 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8abc9c23aeee4d179ef354c364a3a743', 'request_id': 'req-767f84af-feac-4d3b-b863-9381562cedbd'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:39.425693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8abc9c23aeee4d179ef354c364a3a743', 'request_id': 'req-767f84af-feac-4d3b-b863-9381562cedbd'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:39.429760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cc2082c8-c09b-43df-8fe8-d59d740838a1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:39.430996 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cc2082c8-c09b-43df-8fe8-d59d740838a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:39.488011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1168/2377] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:39.497677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2082c8-c09b-43df-8fe8-d59d740838a1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:39.499112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cc2082c8-c09b-43df-8fe8-d59d740838a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:39.524688 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8abc9c23aeee4d179ef354c364a3a743', 'request_id': 'req-767f84af-feac-4d3b-b863-9381562cedbd'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:39.535778 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] The token cache is being invalidate because project 8abc9c23aeee4d179ef354c364a3a743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:39.537592 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:39.537592 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:39.538717 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1210/2378] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:35:39 2022] DELETE /identity/v3/projects/8abc9c23aeee4d179ef354c364a3a743 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:35:39.542471 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:39.543775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:39.556307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f84af-feac-4d3b-b863-9381562cedbd admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:39.558013 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2082c8-c09b-43df-8fe8-d59d740838a1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:39.560990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ca8d3-eed5-4090-97c4-b61fb25cf7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:39.561760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6768a8d-90b1-41e4-a369-f1fcfcc2f2e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:39.561880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ca8d3-eed5-4090-97c4-b61fb25cf7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:39.562120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ca8d3-eed5-4090-97c4-b61fb25cf7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:39.562426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ca8d3-eed5-4090-97c4-b61fb25cf7ec admin admin] PATH_INFO: `/v3/users/ac7fa3ee455c4b25a7cb477772992765` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:39.562542 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768a8d-90b1-41e4-a369-f1fcfcc2f2e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:39.562706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768a8d-90b1-41e4-a369-f1fcfcc2f2e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:39.562981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768a8d-90b1-41e4-a369-f1fcfcc2f2e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:39.563615 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ca8d3-eed5-4090-97c4-b61fb25cf7ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7fa3ee455c4b25a7cb477772992765)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:39.564746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f6768a8d-90b1-41e4-a369-f1fcfcc2f2e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:39.565561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ca8d3-eed5-4090-97c4-b61fb25cf7ec admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:39.577414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6768a8d-90b1-41e4-a369-f1fcfcc2f2e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:39.578863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6768a8d-90b1-41e4-a369-f1fcfcc2f2e7 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:39.589278 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1169/2379] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:35:39.742444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c29ca8d3-eed5-4090-97c4-b61fb25cf7ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7fa3ee455c4b25a7cb477772992765'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:39.749435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c29ca8d3-eed5-4090-97c4-b61fb25cf7ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7fa3ee455c4b25a7cb477772992765'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:39.838599 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c29ca8d3-eed5-4090-97c4-b61fb25cf7ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7fa3ee455c4b25a7cb477772992765'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:39.839276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c29ca8d3-eed5-4090-97c4-b61fb25cf7ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7fa3ee455c4b25a7cb477772992765'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:39.853132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c29ca8d3-eed5-4090-97c4-b61fb25cf7ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7fa3ee455c4b25a7cb477772992765'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:39.859372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1211/2380] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:35:39 2022] DELETE /identity/v3/users/ac7fa3ee455c4b25a7cb477772992765 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:35:40.344073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6768a8d-90b1-41e4-a369-f1fcfcc2f2e7 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:40.360383 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6768a8d-90b1-41e4-a369-f1fcfcc2f2e7 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:40.442025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8658d-21c7-49b3-992e-1420e26fcd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:40.443055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8658d-21c7-49b3-992e-1420e26fcd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:40.443425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8658d-21c7-49b3-992e-1420e26fcd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:40.443777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8658d-21c7-49b3-992e-1420e26fcd2a admin admin] PATH_INFO: `/v3/projects/0269807e4b3b45258fc1017cf8966ef8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:40.446002 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8658d-21c7-49b3-992e-1420e26fcd2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0269807e4b3b45258fc1017cf8966ef8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:40.448324 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8658d-21c7-49b3-992e-1420e26fcd2a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:40.636835 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-76a8658d-21c7-49b3-992e-1420e26fcd2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0269807e4b3b45258fc1017cf8966ef8', 'request_id': 'req-76a8658d-21c7-49b3-992e-1420e26fcd2a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:40.643254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-76a8658d-21c7-49b3-992e-1420e26fcd2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0269807e4b3b45258fc1017cf8966ef8', 'request_id': 'req-76a8658d-21c7-49b3-992e-1420e26fcd2a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:40.737464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-76a8658d-21c7-49b3-992e-1420e26fcd2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0269807e4b3b45258fc1017cf8966ef8', 'request_id': 'req-76a8658d-21c7-49b3-992e-1420e26fcd2a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:40.751586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-76a8658d-21c7-49b3-992e-1420e26fcd2a admin admin] The token cache is being invalidate because project 0269807e4b3b45258fc1017cf8966ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:40.752056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-76a8658d-21c7-49b3-992e-1420e26fcd2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:40.752809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-76a8658d-21c7-49b3-992e-1420e26fcd2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:40.760512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1170/2381] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:35:40 2022] DELETE /identity/v3/projects/0269807e4b3b45258fc1017cf8966ef8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:40.762846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de025a8a-8294-41db-b458-3a4778392d87 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:40.763345 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de025a8a-8294-41db-b458-3a4778392d87 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:40.765744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de025a8a-8294-41db-b458-3a4778392d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:40.785032 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-de025a8a-8294-41db-b458-3a4778392d87 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:40.786340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-de025a8a-8294-41db-b458-3a4778392d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:40.847333 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1212/2382] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:40.856428 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9e45d-3497-43b4-8c7f-e4d245ab1dd1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:40.856821 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9e45d-3497-43b4-8c7f-e4d245ab1dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:40.857168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9e45d-3497-43b4-8c7f-e4d245ab1dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:40.876780 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-43f9e45d-3497-43b4-8c7f-e4d245ab1dd1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:40.878074 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-43f9e45d-3497-43b4-8c7f-e4d245ab1dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:40.886813 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1171/2383] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:40.891138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de025a8a-8294-41db-b458-3a4778392d87 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:40.901552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de025a8a-8294-41db-b458-3a4778392d87 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:40.911960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a6442-7554-44a1-9bb8-aba0070565ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:40.917166 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a6442-7554-44a1-9bb8-aba0070565ba admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:40.917433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a6442-7554-44a1-9bb8-aba0070565ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:40.917714 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a6442-7554-44a1-9bb8-aba0070565ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:40.918512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a6442-7554-44a1-9bb8-aba0070565ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:35:40.918825 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a6442-7554-44a1-9bb8-aba0070565ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:40.920947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a6442-7554-44a1-9bb8-aba0070565ba admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:40.935954 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1213/2384] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:35:40.940333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9e45d-3497-43b4-8c7f-e4d245ab1dd1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:40.951675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9e45d-3497-43b4-8c7f-e4d245ab1dd1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:40.968549 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b909f-b9cb-4bc6-abf7-ef40fdf54042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:40.970462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b909f-b9cb-4bc6-abf7-ef40fdf54042 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:40.970923 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b909f-b9cb-4bc6-abf7-ef40fdf54042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:40.971445 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b909f-b9cb-4bc6-abf7-ef40fdf54042 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:40.972284 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b909f-b9cb-4bc6-abf7-ef40fdf54042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:40.974313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b909f-b9cb-4bc6-abf7-ef40fdf54042 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:41.065342 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1172/2385] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:40 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:35:41.070973 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a6442-7554-44a1-9bb8-aba0070565ba admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:41.086525 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a6442-7554-44a1-9bb8-aba0070565ba admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:41.159767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf63607-8d4e-426e-a0d4-ee5f598dcab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:41.160564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf63607-8d4e-426e-a0d4-ee5f598dcab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:41.160964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf63607-8d4e-426e-a0d4-ee5f598dcab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:41.161333 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf63607-8d4e-426e-a0d4-ee5f598dcab5 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:41.162222 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf63607-8d4e-426e-a0d4-ee5f598dcab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:41.166678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf63607-8d4e-426e-a0d4-ee5f598dcab5 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:41.258042 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1214/2386] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:41 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:41.262425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b909f-b9cb-4bc6-abf7-ef40fdf54042 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:41.279568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b909f-b9cb-4bc6-abf7-ef40fdf54042 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:41.284919 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958aa89-f3ca-45eb-888f-378fe24b13be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:41.285632 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958aa89-f3ca-45eb-888f-378fe24b13be admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:41.285922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958aa89-f3ca-45eb-888f-378fe24b13be admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:41.287561 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958aa89-f3ca-45eb-888f-378fe24b13be admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:41.287561 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958aa89-f3ca-45eb-888f-378fe24b13be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:41.289254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958aa89-f3ca-45eb-888f-378fe24b13be admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:41.304962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1173/2387] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:41.306478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf63607-8d4e-426e-a0d4-ee5f598dcab5 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:41.316555 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf63607-8d4e-426e-a0d4-ee5f598dcab5 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:41.325525 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff914b-1856-44fe-8808-f56149b5f116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:41.326261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff914b-1856-44fe-8808-f56149b5f116 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:41.326735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff914b-1856-44fe-8808-f56149b5f116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:41.327370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff914b-1856-44fe-8808-f56149b5f116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:41.327743 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff914b-1856-44fe-8808-f56149b5f116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:41.329385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff914b-1856-44fe-8808-f56149b5f116 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:41.346640 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1215/2388] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:41.348125 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958aa89-f3ca-45eb-888f-378fe24b13be admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:41.362400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958aa89-f3ca-45eb-888f-378fe24b13be admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:41.363327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff914b-1856-44fe-8808-f56149b5f116 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:41.368583 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6fff914b-1856-44fe-8808-f56149b5f116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:41.384502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26f969-1b56-4543-8cbe-5d045fdcb276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:41.386237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26f969-1b56-4543-8cbe-5d045fdcb276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:41.390097 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26f969-1b56-4543-8cbe-5d045fdcb276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:41.390439 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26f969-1b56-4543-8cbe-5d045fdcb276 admin admin] PATH_INFO: `/v3/projects/186149575e3a4e14a3fe1251ac8137b2/users/ed2339ae7d4143d5886e6fca9c25e16e/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:41.402010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff914b-1856-44fe-8808-f56149b5f116 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:41.407886 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:41.408904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:41.409196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:41.409473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] PATH_INFO: `/v3/users/9af6f43e494f485196d6ba2245bceed3` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:41.411434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af6f43e494f485196d6ba2245bceed3)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:41.414103 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:41.423083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26f969-1b56-4543-8cbe-5d045fdcb276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=186149575e3a4e14a3fe1251ac8137b2, user_id=ed2339ae7d4143d5886e6fca9c25e16e, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:41.426020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26f969-1b56-4543-8cbe-5d045fdcb276 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:41.521201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1174/2389] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:41 2022] PUT /identity/v3/projects/186149575e3a4e14a3fe1251ac8137b2/users/ed2339ae7d4143d5886e6fca9c25e16e/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:41.533320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49ee8d-7c16-448a-8e46-7276271373b0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:41.533612 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49ee8d-7c16-448a-8e46-7276271373b0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:41.533937 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49ee8d-7c16-448a-8e46-7276271373b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:41.565266 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bf49ee8d-7c16-448a-8e46-7276271373b0 None None] MFA Rules not processed for user `ed2339ae7d4143d5886e6fca9c25e16e`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:41.566617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bf49ee8d-7c16-448a-8e46-7276271373b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:41.623472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af6f43e494f485196d6ba2245bceed3'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:41.648839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af6f43e494f485196d6ba2245bceed3'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:41.681328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1175/2390] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:41.691394 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49ee8d-7c16-448a-8e46-7276271373b0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:41.693702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bf49ee8d-7c16-448a-8e46-7276271373b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:41.772520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af6f43e494f485196d6ba2245bceed3'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:41.773570 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af6f43e494f485196d6ba2245bceed3'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:41.789337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af6f43e494f485196d6ba2245bceed3'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:41.797767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1216/2391] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:35:41 2022] DELETE /identity/v3/users/9af6f43e494f485196d6ba2245bceed3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:41.839415 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49ee8d-7c16-448a-8e46-7276271373b0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:41.914859 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac866fb-55b1-4f60-a274-84f88957ed8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f973b13dd44e609110f9a967ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:41.915729 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac866fb-55b1-4f60-a274-84f88957ed8c service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:41.916133 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac866fb-55b1-4f60-a274-84f88957ed8c service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:41.916512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac866fb-55b1-4f60-a274-84f88957ed8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:41.918777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8ac866fb-55b1-4f60-a274-84f88957ed8c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:42.001619 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac866fb-55b1-4f60-a274-84f88957ed8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:42.003730 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac866fb-55b1-4f60-a274-84f88957ed8c service glance] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:42.018822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1176/2392] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:35:42.197119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:42.198961 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:42.276695 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4c03d-58c1-48fd-a4a3-c88394fba83a admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:42.287479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:42.288439 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:42.288726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:42.289003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2 admin admin] PATH_INFO: `/v3/projects/8683b51e4909484ea07d9508e11ed256` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:42.290265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8683b51e4909484ea07d9508e11ed256)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:42.292423 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:42.492414 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8683b51e4909484ea07d9508e11ed256', 'request_id': 'req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:42.501026 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8683b51e4909484ea07d9508e11ed256', 'request_id': 'req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:42.629059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8683b51e4909484ea07d9508e11ed256', 'request_id': 'req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:42.640830 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2 admin admin] The token cache is being invalidate because project 8683b51e4909484ea07d9508e11ed256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:35:42.641117 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:42.650474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2d9b59de-c21b-42a8-b0c0-35725e2ba4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:35:42.650474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1217/2393] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:35:42 2022] DELETE /identity/v3/projects/8683b51e4909484ea07d9508e11ed256 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:42.650711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea6582-c532-41d2-bd6e-f8c463254879 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:42.650711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea6582-c532-41d2-bd6e-f8c463254879 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:42.650711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea6582-c532-41d2-bd6e-f8c463254879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:42.667182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c2ea6582-c532-41d2-bd6e-f8c463254879 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:42.668350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c2ea6582-c532-41d2-bd6e-f8c463254879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:42.729675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1177/2394] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:42.737328 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d298b1e-d0da-4d9f-a845-e44fabf1098f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:42.742298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d298b1e-d0da-4d9f-a845-e44fabf1098f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:42.742298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d298b1e-d0da-4d9f-a845-e44fabf1098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:42.761441 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-1d298b1e-d0da-4d9f-a845-e44fabf1098f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:42.766460 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1d298b1e-d0da-4d9f-a845-e44fabf1098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:42.776353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1218/2395] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:42.780566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea6582-c532-41d2-bd6e-f8c463254879 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:42.792285 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea6582-c532-41d2-bd6e-f8c463254879 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:42.798309 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0cc74-c8fd-451d-b79c-f090255c7c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:42.799668 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0cc74-c8fd-451d-b79c-f090255c7c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:42.800065 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0cc74-c8fd-451d-b79c-f090255c7c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:42.800450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0cc74-c8fd-451d-b79c-f090255c7c61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:42.801343 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0cc74-c8fd-451d-b79c-f090255c7c61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:35:42.801791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0cc74-c8fd-451d-b79c-f090255c7c61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:42.805483 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0cc74-c8fd-451d-b79c-f090255c7c61 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:42.818184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1178/2396] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:35:42.825045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d298b1e-d0da-4d9f-a845-e44fabf1098f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:42.837179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d298b1e-d0da-4d9f-a845-e44fabf1098f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:42.842271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019810e9-ec23-4b03-a147-2f611d78f630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:42.842985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019810e9-ec23-4b03-a147-2f611d78f630 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:42.843353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019810e9-ec23-4b03-a147-2f611d78f630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:42.843691 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019810e9-ec23-4b03-a147-2f611d78f630 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:42.844441 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019810e9-ec23-4b03-a147-2f611d78f630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:42.846544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019810e9-ec23-4b03-a147-2f611d78f630 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:42.957473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1219/2397] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:42 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:35:42.962759 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0cc74-c8fd-451d-b79c-f090255c7c61 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:42.978612 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0cc74-c8fd-451d-b79c-f090255c7c61 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:43.113761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818cc7a-74b8-41ac-970e-3d4721c2117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:43.114772 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818cc7a-74b8-41ac-970e-3d4721c2117c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:43.115151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818cc7a-74b8-41ac-970e-3d4721c2117c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:43.115562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818cc7a-74b8-41ac-970e-3d4721c2117c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:43.124796 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818cc7a-74b8-41ac-970e-3d4721c2117c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:43.127555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818cc7a-74b8-41ac-970e-3d4721c2117c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:43.233634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1179/2398] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:42 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:43.237641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019810e9-ec23-4b03-a147-2f611d78f630 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:43.262269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019810e9-ec23-4b03-a147-2f611d78f630 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:43.268980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660baa04-bbdc-4b55-a0d7-0f1157ca2466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:43.269672 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660baa04-bbdc-4b55-a0d7-0f1157ca2466 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:43.270042 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660baa04-bbdc-4b55-a0d7-0f1157ca2466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:43.270347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660baa04-bbdc-4b55-a0d7-0f1157ca2466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:43.271176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660baa04-bbdc-4b55-a0d7-0f1157ca2466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:43.273690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660baa04-bbdc-4b55-a0d7-0f1157ca2466 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:43.299707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1220/2399] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:35:43.302625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818cc7a-74b8-41ac-970e-3d4721c2117c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:43.325471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818cc7a-74b8-41ac-970e-3d4721c2117c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:43.333001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9f8d6-667a-4674-bf83-6dc00a870100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:43.333801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f8d6-667a-4674-bf83-6dc00a870100 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:43.335425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f8d6-667a-4674-bf83-6dc00a870100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:43.336038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f8d6-667a-4674-bf83-6dc00a870100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:43.344878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9f8d6-667a-4674-bf83-6dc00a870100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:43.346801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9f8d6-667a-4674-bf83-6dc00a870100 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:43.361739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1180/2400] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:35:43.366814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660baa04-bbdc-4b55-a0d7-0f1157ca2466 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:43.390405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660baa04-bbdc-4b55-a0d7-0f1157ca2466 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:43.395935 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c14510-0edb-4692-a4c8-a2d234673448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:43.396840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c14510-0edb-4692-a4c8-a2d234673448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:43.398399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c14510-0edb-4692-a4c8-a2d234673448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:43.398521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c14510-0edb-4692-a4c8-a2d234673448 admin admin] PATH_INFO: `/v3/projects/bf61282f689243b28d6c274f616534f0/users/33d51822558148749bd9070aff15494c/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:43.430340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c14510-0edb-4692-a4c8-a2d234673448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf61282f689243b28d6c274f616534f0, user_id=33d51822558148749bd9070aff15494c, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:43.434014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c14510-0edb-4692-a4c8-a2d234673448 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:43.504229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1221/2401] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:43 2022] PUT /identity/v3/projects/bf61282f689243b28d6c274f616534f0/users/33d51822558148749bd9070aff15494c/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:43.509713 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c130d-3d68-4d72-b671-74953a2fbd9d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:43.510018 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c130d-3d68-4d72-b671-74953a2fbd9d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:43.510312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c130d-3d68-4d72-b671-74953a2fbd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:43.542806 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0b0c130d-3d68-4d72-b671-74953a2fbd9d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:43.544408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0b0c130d-3d68-4d72-b671-74953a2fbd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:43.636128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1181/2402] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:43.645364 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c14510-0edb-4692-a4c8-a2d234673448 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:43.648348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-13c14510-0edb-4692-a4c8-a2d234673448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:43.728621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c14510-0edb-4692-a4c8-a2d234673448 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:43.733755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40486dfd-9615-4780-a0c3-8775d208dec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:43.734633 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40486dfd-9615-4780-a0c3-8775d208dec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:43.735631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40486dfd-9615-4780-a0c3-8775d208dec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:43.735915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40486dfd-9615-4780-a0c3-8775d208dec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:43.756113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40486dfd-9615-4780-a0c3-8775d208dec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:43.756113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40486dfd-9615-4780-a0c3-8775d208dec2 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:43.771114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1222/2403] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:45.853493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5ebc2-6151-448b-9461-56bce4efb19b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.853960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5ebc2-6151-448b-9461-56bce4efb19b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.854050 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5ebc2-6151-448b-9461-56bce4efb19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.913967 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8ea5ebc2-6151-448b-9461-56bce4efb19b None None] MFA Rules not processed for user `33d51822558148749bd9070aff15494c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:45.915407 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8ea5ebc2-6151-448b-9461-56bce4efb19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:46.056020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1182/2404] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:46.065504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40486dfd-9615-4780-a0c3-8775d208dec2 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:46.067187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-40486dfd-9615-4780-a0c3-8775d208dec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:46.244837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40486dfd-9615-4780-a0c3-8775d208dec2 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:46.251924 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccae56-f9ef-4fa9-a4a6-67681e66455d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:46.252731 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccae56-f9ef-4fa9-a4a6-67681e66455d service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:46.253028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccae56-f9ef-4fa9-a4a6-67681e66455d service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:46.253299 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccae56-f9ef-4fa9-a4a6-67681e66455d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:46.266742 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ccae56-f9ef-4fa9-a4a6-67681e66455d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:46.269214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ccae56-f9ef-4fa9-a4a6-67681e66455d service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:46.331893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1223/2405] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:35:46.931443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9c2df-455c-4416-b08b-d97c1c1c8bee None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:46.931992 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9c2df-455c-4416-b08b-d97c1c1c8bee None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:46.931992 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9c2df-455c-4416-b08b-d97c1c1c8bee None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:46.933730 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1183/2406] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 5 15:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:46.941620 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae12e4-2d2b-467f-997f-c8bb786420cd None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:46.941881 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae12e4-2d2b-467f-997f-c8bb786420cd None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:46.942162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae12e4-2d2b-467f-997f-c8bb786420cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:47.003150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-0fae12e4-2d2b-467f-997f-c8bb786420cd None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:47.004464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-0fae12e4-2d2b-467f-997f-c8bb786420cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:47.128984 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1224/2407] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 5 15:35:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:47.143545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9c2df-455c-4416-b08b-d97c1c1c8bee None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:47.145869 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-77e9c2df-455c-4416-b08b-d97c1c1c8bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:47.256225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9c2df-455c-4416-b08b-d97c1c1c8bee None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:47.265900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb957d-6c69-45ef-a7a3-ca66b39e54c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f973b13dd44e609110f9a967ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:47.266617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb957d-6c69-45ef-a7a3-ca66b39e54c0 service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:47.266958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb957d-6c69-45ef-a7a3-ca66b39e54c0 service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:47.267383 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb957d-6c69-45ef-a7a3-ca66b39e54c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:47.280872 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb957d-6c69-45ef-a7a3-ca66b39e54c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:47.282566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb957d-6c69-45ef-a7a3-ca66b39e54c0 service glance] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:47.301016 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1184/2408] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:47.626564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b95a3-43ea-41b5-ba49-c6e3b49b8889 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:47.626693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b95a3-43ea-41b5-ba49-c6e3b49b8889 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:47.626954 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b95a3-43ea-41b5-ba49-c6e3b49b8889 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:47.628628 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1225/2409] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 5 15:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:47.639620 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdae6e4-e1b7-4ba9-9194-4cf1ef802fbe None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:47.640201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdae6e4-e1b7-4ba9-9194-4cf1ef802fbe None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:47.640343 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdae6e4-e1b7-4ba9-9194-4cf1ef802fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:47.694746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-dfdae6e4-e1b7-4ba9-9194-4cf1ef802fbe None None] MFA Rules not processed for user `c5efb606fb1b422182ab91576088c85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:47.701994 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dfdae6e4-e1b7-4ba9-9194-4cf1ef802fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:47.716294 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1185/2410] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 5 15:35:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:47.733598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b95a3-43ea-41b5-ba49-c6e3b49b8889 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:47.747516 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b95a3-43ea-41b5-ba49-c6e3b49b8889 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:47.751344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7875ec-397b-4e74-b70f-5db6375f7a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:47.752287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7875ec-397b-4e74-b70f-5db6375f7a6a service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:47.752610 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7875ec-397b-4e74-b70f-5db6375f7a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:47.752893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7875ec-397b-4e74-b70f-5db6375f7a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:47.770854 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7875ec-397b-4e74-b70f-5db6375f7a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:47.770854 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7875ec-397b-4e74-b70f-5db6375f7a6a service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:47.780462 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1226/2411] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:47.805320 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8179db-5569-42c2-a2a0-25d3af569a2a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:47.805928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8179db-5569-42c2-a2a0-25d3af569a2a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:47.806222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8179db-5569-42c2-a2a0-25d3af569a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:47.844104 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bd8179db-5569-42c2-a2a0-25d3af569a2a None None] MFA Rules not processed for user `9e6d29b571fe40f5ab82484e1c7c040b`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:47.845462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bd8179db-5569-42c2-a2a0-25d3af569a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:47.907850 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fb2ee-a925-4006-b3f6-ea3bbe5c830b None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:47.908322 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fb2ee-a925-4006-b3f6-ea3bbe5c830b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:47.908681 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fb2ee-a925-4006-b3f6-ea3bbe5c830b None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:47.911064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1227/2412] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 5 15:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:35:47.917835 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af3e02-0d03-40db-841d-3bbbb48afeb6 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:47.918573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af3e02-0d03-40db-841d-3bbbb48afeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:47.919232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af3e02-0d03-40db-841d-3bbbb48afeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:47.931554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1186/2413] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:47.936121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8179db-5569-42c2-a2a0-25d3af569a2a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:47.946831 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bd8179db-5569-42c2-a2a0-25d3af569a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:47.965093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-12af3e02-0d03-40db-841d-3bbbb48afeb6 None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:47.966501 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8179db-5569-42c2-a2a0-25d3af569a2a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:47.968188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-12af3e02-0d03-40db-841d-3bbbb48afeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:47.971801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6588c4f-8551-47a6-bc35-e9a0f8c2fdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:47.972628 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6588c4f-8551-47a6-bc35-e9a0f8c2fdd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:47.973029 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6588c4f-8551-47a6-bc35-e9a0f8c2fdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:47.973407 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6588c4f-8551-47a6-bc35-e9a0f8c2fdd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:47.974193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6588c4f-8551-47a6-bc35-e9a0f8c2fdd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:47.976821 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6588c4f-8551-47a6-bc35-e9a0f8c2fdd1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:47.986612 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1228/2414] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 5 15:35:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:47.998400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af3e02-0d03-40db-841d-3bbbb48afeb6 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:48.008849 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af3e02-0d03-40db-841d-3bbbb48afeb6 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:48.012600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b33aee-7b9f-4f58-b75d-ae7dd8a91bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:48.013403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b33aee-7b9f-4f58-b75d-ae7dd8a91bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:48.013866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b33aee-7b9f-4f58-b75d-ae7dd8a91bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:48.014150 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b33aee-7b9f-4f58-b75d-ae7dd8a91bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:48.026167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b33aee-7b9f-4f58-b75d-ae7dd8a91bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:48.027753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b33aee-7b9f-4f58-b75d-ae7dd8a91bc8 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:48.039955 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1229/2415] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:35:48.081080 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1187/2416] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:35:47 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:48.082355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b33aee-7b9f-4f58-b75d-ae7dd8a91bc8 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:48.100736 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b33aee-7b9f-4f58-b75d-ae7dd8a91bc8 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:48.285968 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603739d-b0f9-47ed-a86a-649cbccccdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:48.286703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603739d-b0f9-47ed-a86a-649cbccccdaf admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:48.287104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603739d-b0f9-47ed-a86a-649cbccccdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:48.287839 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603739d-b0f9-47ed-a86a-649cbccccdaf admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:48.292290 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603739d-b0f9-47ed-a86a-649cbccccdaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:48.294502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603739d-b0f9-47ed-a86a-649cbccccdaf admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:48.426813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1230/2417] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:35:48 2022] POST /identity/v3/users => generated 299 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:35:48.429563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6588c4f-8551-47a6-bc35-e9a0f8c2fdd1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:48.436248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7b95d-3c26-405a-b290-8e5f7d4c3251 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:48.436570 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7b95d-3c26-405a-b290-8e5f7d4c3251 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:48.436873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7b95d-3c26-405a-b290-8e5f7d4c3251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:48.447624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6588c4f-8551-47a6-bc35-e9a0f8c2fdd1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:48.465456 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88a3ac-ffcb-429f-a621-a224ca595977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:48.466481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88a3ac-ffcb-429f-a621-a224ca595977 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:48.467019 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88a3ac-ffcb-429f-a621-a224ca595977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:48.468093 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88a3ac-ffcb-429f-a621-a224ca595977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:48.476666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88a3ac-ffcb-429f-a621-a224ca595977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:48.481118 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-e6f7b95d-3c26-405a-b290-8e5f7d4c3251 None None] MFA Rules not processed for user `33d51822558148749bd9070aff15494c`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:48.481712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88a3ac-ffcb-429f-a621-a224ca595977 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:48.483072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e6f7b95d-3c26-405a-b290-8e5f7d4c3251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:48.520728 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1188/2418] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:48.521714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88a3ac-ffcb-429f-a621-a224ca595977 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:48.542455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88a3ac-ffcb-429f-a621-a224ca595977 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:48.548858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131d213-b63a-4db2-a4b4-11ff731b01bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:48.549899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131d213-b63a-4db2-a4b4-11ff731b01bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:48.550229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131d213-b63a-4db2-a4b4-11ff731b01bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:48.555272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131d213-b63a-4db2-a4b4-11ff731b01bf admin admin] PATH_INFO: `/v3/projects/d8f16621bb88409f98b981ede4570704/users/a24eaad188424bdc89a2895fbdf1dc03/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:48.580407 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131d213-b63a-4db2-a4b4-11ff731b01bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f16621bb88409f98b981ede4570704, user_id=a24eaad188424bdc89a2895fbdf1dc03, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:48.583258 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131d213-b63a-4db2-a4b4-11ff731b01bf admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:48.624020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1231/2419] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:35:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:48.753697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7b95d-3c26-405a-b290-8e5f7d4c3251 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:48.754520 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1189/2420] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:48 2022] PUT /identity/v3/projects/d8f16621bb88409f98b981ede4570704/users/a24eaad188424bdc89a2895fbdf1dc03/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:35:48.773046 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7b95d-3c26-405a-b290-8e5f7d4c3251 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:48.867671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84832f3f-aae6-471b-8d9f-1d0729a4904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:48.868530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84832f3f-aae6-471b-8d9f-1d0729a4904c admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:48.868916 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84832f3f-aae6-471b-8d9f-1d0729a4904c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:48.869425 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84832f3f-aae6-471b-8d9f-1d0729a4904c admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:48.870361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84832f3f-aae6-471b-8d9f-1d0729a4904c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:48.872156 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84832f3f-aae6-471b-8d9f-1d0729a4904c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:48.883878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1232/2421] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:35:48.888174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131d213-b63a-4db2-a4b4-11ff731b01bf admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:48.899673 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131d213-b63a-4db2-a4b4-11ff731b01bf admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:48.904606 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103ae2c-f697-4a4c-93fc-ea301003acd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:48.905495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103ae2c-f697-4a4c-93fc-ea301003acd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:48.905776 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103ae2c-f697-4a4c-93fc-ea301003acd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:48.906048 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103ae2c-f697-4a4c-93fc-ea301003acd5 admin admin] PATH_INFO: `/v3/projects/d8f16621bb88409f98b981ede4570704/users/a24eaad188424bdc89a2895fbdf1dc03/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:48.908041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103ae2c-f697-4a4c-93fc-ea301003acd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f16621bb88409f98b981ede4570704, user_id=a24eaad188424bdc89a2895fbdf1dc03, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:48.910871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103ae2c-f697-4a4c-93fc-ea301003acd5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:48.922707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1190/2422] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:35:48 2022] PUT /identity/v3/projects/d8f16621bb88409f98b981ede4570704/users/a24eaad188424bdc89a2895fbdf1dc03/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:35:51.580072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84832f3f-aae6-471b-8d9f-1d0729a4904c admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:51.582531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-84832f3f-aae6-471b-8d9f-1d0729a4904c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:51.758082 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84832f3f-aae6-471b-8d9f-1d0729a4904c admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:51.987154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1347388-123d-4f2f-9116-df98931b001c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db978c3b147c4b259b623e8c64e7c13a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:51.987901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1347388-123d-4f2f-9116-df98931b001c service placement] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:51.988246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1347388-123d-4f2f-9116-df98931b001c service placement] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:51.988582 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1347388-123d-4f2f-9116-df98931b001c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:52.001735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c1347388-123d-4f2f-9116-df98931b001c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:52.024120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1347388-123d-4f2f-9116-df98931b001c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:52.026496 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1347388-123d-4f2f-9116-df98931b001c service placement] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:52.050490 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1233/2423] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:35:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:55.566779 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4477ce8-f518-485c-99c9-ba1d865a2f48 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:55.567611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4477ce8-f518-485c-99c9-ba1d865a2f48 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:55.567892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4477ce8-f518-485c-99c9-ba1d865a2f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:55.588350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e4477ce8-f518-485c-99c9-ba1d865a2f48 None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:55.589701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e4477ce8-f518-485c-99c9-ba1d865a2f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:55.658486 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1191/2424] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:35:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:55.685340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1347388-123d-4f2f-9116-df98931b001c service placement] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:55.687374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c1347388-123d-4f2f-9116-df98931b001c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:55.780098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1347388-123d-4f2f-9116-df98931b001c service placement] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:55.786006 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46212f-a26f-4718-91bf-6a831f24a829 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:55.786702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46212f-a26f-4718-91bf-6a831f24a829 service swift] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:55.788340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46212f-a26f-4718-91bf-6a831f24a829 service swift] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:55.788340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46212f-a26f-4718-91bf-6a831f24a829 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:55.800444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46212f-a26f-4718-91bf-6a831f24a829 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:55.804512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46212f-a26f-4718-91bf-6a831f24a829 service swift] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:55.816075 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1234/2425] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:35:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:35:55.816890 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd946fff-a72b-46b6-a2db-056ac4aed8da None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:55.817188 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd946fff-a72b-46b6-a2db-056ac4aed8da None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:55.817468 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd946fff-a72b-46b6-a2db-056ac4aed8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:55.841660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-dd946fff-a72b-46b6-a2db-056ac4aed8da None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:55.843224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dd946fff-a72b-46b6-a2db-056ac4aed8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:55.853142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1192/2426] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:35:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:55.866767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46212f-a26f-4718-91bf-6a831f24a829 service swift] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:55.882795 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46212f-a26f-4718-91bf-6a831f24a829 service swift] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:55.891219 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a3b0-7e78-4dcc-bd19-697c4c7c1039 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:55.892098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a3b0-7e78-4dcc-bd19-697c4c7c1039 service swift] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:55.892638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a3b0-7e78-4dcc-bd19-697c4c7c1039 service swift] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:55.893081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a3b0-7e78-4dcc-bd19-697c4c7c1039 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:55.902964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a3b0-7e78-4dcc-bd19-697c4c7c1039 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:55.905468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a3b0-7e78-4dcc-bd19-697c4c7c1039 service swift] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:55.915392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1235/2427] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:35:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:35:57.299315 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c0cfe-ee38-4b23-a4cc-66a829ccb07a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:57.299824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c0cfe-ee38-4b23-a4cc-66a829ccb07a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:57.299824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c0cfe-ee38-4b23-a4cc-66a829ccb07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:57.342561 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fa3c0cfe-ee38-4b23-a4cc-66a829ccb07a None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:57.344041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fa3c0cfe-ee38-4b23-a4cc-66a829ccb07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:57.372037 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1193/2428] 10.222.0.44 () {58 vars in 967 bytes} [Thu May 5 15:35:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:57.389930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a3b0-7e78-4dcc-bd19-697c4c7c1039 service swift] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:57.409036 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a3b0-7e78-4dcc-bd19-697c4c7c1039 service swift] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:57.422224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5deae16-a46e-4d6f-93da-127187afce4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:57.423460 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deae16-a46e-4d6f-93da-127187afce4e service swift] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:57.423975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deae16-a46e-4d6f-93da-127187afce4e service swift] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:57.424793 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deae16-a46e-4d6f-93da-127187afce4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:57.438936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5deae16-a46e-4d6f-93da-127187afce4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:57.441472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5deae16-a46e-4d6f-93da-127187afce4e service swift] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:57.454404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1236/2429] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:35:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:35:58.985888 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cc790-999d-4042-964a-42c0872aef28 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:58.988826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cc790-999d-4042-964a-42c0872aef28 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:58.988826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cc790-999d-4042-964a-42c0872aef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:59.012337 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ff2cc790-999d-4042-964a-42c0872aef28 None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:59.013650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ff2cc790-999d-4042-964a-42c0872aef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:59.022247 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1194/2430] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:35:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:59.042215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5deae16-a46e-4d6f-93da-127187afce4e service swift] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:59.063422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5deae16-a46e-4d6f-93da-127187afce4e service swift] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:59.069704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56087511-673b-4990-b64b-d8ed91d1b23f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:59.070704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56087511-673b-4990-b64b-d8ed91d1b23f service swift] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:59.071162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56087511-673b-4990-b64b-d8ed91d1b23f service swift] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:59.071654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56087511-673b-4990-b64b-d8ed91d1b23f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:59.080942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56087511-673b-4990-b64b-d8ed91d1b23f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:59.083144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56087511-673b-4990-b64b-d8ed91d1b23f service swift] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:59.094560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1237/2431] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:35:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:36:00.275370 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79594a-2ca9-4eac-a7ab-7844c0184a5f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:00.277590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79594a-2ca9-4eac-a7ab-7844c0184a5f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:00.278701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79594a-2ca9-4eac-a7ab-7844c0184a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:00.367330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7b79594a-2ca9-4eac-a7ab-7844c0184a5f None None] MFA Rules not processed for user `a24eaad188424bdc89a2895fbdf1dc03`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:00.368744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7b79594a-2ca9-4eac-a7ab-7844c0184a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:00.492105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927567d3-cebd-4636-ab41-1e2f05db910b None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:00.492608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927567d3-cebd-4636-ab41-1e2f05db910b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:00.492608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927567d3-cebd-4636-ab41-1e2f05db910b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:00.525716 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-927567d3-cebd-4636-ab41-1e2f05db910b None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:00.527319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-927567d3-cebd-4636-ab41-1e2f05db910b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:00.528503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1195/2432] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:36:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:00.542698 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1238/2433] 10.222.0.44 () {58 vars in 967 bytes} [Thu May 5 15:36:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:36:00.549531 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79594a-2ca9-4eac-a7ab-7844c0184a5f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:00.563379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79594a-2ca9-4eac-a7ab-7844c0184a5f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:00.569508 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2e378-3bc2-4492-85dc-d4b8340e6d6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:00.570453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2e378-3bc2-4492-85dc-d4b8340e6d6c service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:00.570724 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2e378-3bc2-4492-85dc-d4b8340e6d6c service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:00.571002 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2e378-3bc2-4492-85dc-d4b8340e6d6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:00.583884 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2e378-3bc2-4492-85dc-d4b8340e6d6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:00.586744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2e378-3bc2-4492-85dc-d4b8340e6d6c service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:00.597566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1196/2434] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:36:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:36:01.122553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927567d3-cebd-4636-ab41-1e2f05db910b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:01.283358 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927567d3-cebd-4636-ab41-1e2f05db910b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:01.295504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ceafa-71a1-4114-90db-1b8d93888e25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f973b13dd44e609110f9a967ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:01.298613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ceafa-71a1-4114-90db-1b8d93888e25 service glance] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:01.298613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ceafa-71a1-4114-90db-1b8d93888e25 service glance] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:01.298613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ceafa-71a1-4114-90db-1b8d93888e25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:01.493753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ceafa-71a1-4114-90db-1b8d93888e25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:01.495511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ceafa-71a1-4114-90db-1b8d93888e25 service glance] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:01.526058 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1239/2435] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:36:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:01.791770 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2e378-3bc2-4492-85dc-d4b8340e6d6c service swift] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:01.793358 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f3b2e378-3bc2-4492-85dc-d4b8340e6d6c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:01.960931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3b686-9378-43eb-bbe4-f93fa9af3a21 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:01.960931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3b686-9378-43eb-bbe4-f93fa9af3a21 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:01.960931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3b686-9378-43eb-bbe4-f93fa9af3a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:01.993187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b1b3b686-9378-43eb-bbe4-f93fa9af3a21 None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:02.006021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2e378-3bc2-4492-85dc-d4b8340e6d6c service swift] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:02.008410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b1b3b686-9378-43eb-bbe4-f93fa9af3a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:02.020698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:02.024943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:02.026649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:02.032182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] PATH_INFO: `/v3/users/ed2339ae7d4143d5886e6fca9c25e16e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:02.032182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2339ae7d4143d5886e6fca9c25e16e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:02.034130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1240/2436] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:36:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:36:02.035745 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:02.081919 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3b686-9378-43eb-bbe4-f93fa9af3a21 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:02.104596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3b686-9378-43eb-bbe4-f93fa9af3a21 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:02.119014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351a247-b0ed-4d15-bf66-4c2a58e239a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:02.127097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351a247-b0ed-4d15-bf66-4c2a58e239a8 service swift] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:02.128642 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351a247-b0ed-4d15-bf66-4c2a58e239a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:02.128930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351a247-b0ed-4d15-bf66-4c2a58e239a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:02.182260 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351a247-b0ed-4d15-bf66-4c2a58e239a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:02.200091 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351a247-b0ed-4d15-bf66-4c2a58e239a8 service swift] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:02.232894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1241/2437] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:36:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:36:02.309055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2339ae7d4143d5886e6fca9c25e16e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:02.330274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2339ae7d4143d5886e6fca9c25e16e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:02.330274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2339ae7d4143d5886e6fca9c25e16e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:02.330274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2339ae7d4143d5886e6fca9c25e16e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:02.349752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2339ae7d4143d5886e6fca9c25e16e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:02.449183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1197/2438] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:36:01 2022] DELETE /identity/v3/users/ed2339ae7d4143d5886e6fca9c25e16e => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:36:02.453885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e84489-9559-4cf2-8e5d-b44878c41072 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:02.454188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e84489-9559-4cf2-8e5d-b44878c41072 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:02.454553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e84489-9559-4cf2-8e5d-b44878c41072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:02.493163 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-18e84489-9559-4cf2-8e5d-b44878c41072 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:02.496469 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-18e84489-9559-4cf2-8e5d-b44878c41072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:02.704593 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1242/2439] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:02.761215 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:02.766471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:02.930135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43b27a-67d5-40ad-858e-f8821b4400b1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:02.951103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04b0a4-77cb-4792-85c9-ff7362980443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:02.952075 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04b0a4-77cb-4792-85c9-ff7362980443 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:02.952552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04b0a4-77cb-4792-85c9-ff7362980443 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:02.953013 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04b0a4-77cb-4792-85c9-ff7362980443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:02.967037 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04b0a4-77cb-4792-85c9-ff7362980443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:02.970783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04b0a4-77cb-4792-85c9-ff7362980443 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:02.987338 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1198/2440] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:04.295385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e84489-9559-4cf2-8e5d-b44878c41072 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:04.296869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-18e84489-9559-4cf2-8e5d-b44878c41072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:04.321765 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e84489-9559-4cf2-8e5d-b44878c41072 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:04.336692 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:04.343185 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:04.343487 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:04.343769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] PATH_INFO: `/v3/users/986c778234494f8cbbed7e7ff9537f19` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:04.345175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=986c778234494f8cbbed7e7ff9537f19)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:04.349399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:05.033316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986c778234494f8cbbed7e7ff9537f19'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:05.055372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986c778234494f8cbbed7e7ff9537f19'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:05.120353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986c778234494f8cbbed7e7ff9537f19'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:05.120985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986c778234494f8cbbed7e7ff9537f19'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:05.159051 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986c778234494f8cbbed7e7ff9537f19'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:05.180709 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1243/2441] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:36:04 2022] DELETE /identity/v3/users/986c778234494f8cbbed7e7ff9537f19 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:36:05.186181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6900e42-4c22-43c6-a9e9-ca7c65533185 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:05.186742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6900e42-4c22-43c6-a9e9-ca7c65533185 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:05.186742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6900e42-4c22-43c6-a9e9-ca7c65533185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:05.221562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f6900e42-4c22-43c6-a9e9-ca7c65533185 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:05.222885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f6900e42-4c22-43c6-a9e9-ca7c65533185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:05.317530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1199/2442] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:05.327533 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:05.329786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:05.349507 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6900e42-4c22-43c6-a9e9-ca7c65533185 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:05.349507 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f6900e42-4c22-43c6-a9e9-ca7c65533185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:05.368915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6900e42-4c22-43c6-a9e9-ca7c65533185 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:05.380053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:05.381826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:05.382666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:05.384325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2 admin admin] PATH_INFO: `/v3/projects/186149575e3a4e14a3fe1251ac8137b2` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:05.387492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=186149575e3a4e14a3fe1251ac8137b2)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:05.389677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:05.467115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6790b-a642-4c48-8caa-49ea9f9d1114 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:05.471566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bcbe0-9d4f-4c21-aefc-a6a19c09fea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:05.472315 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bcbe0-9d4f-4c21-aefc-a6a19c09fea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:05.472607 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bcbe0-9d4f-4c21-aefc-a6a19c09fea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:05.473050 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bcbe0-9d4f-4c21-aefc-a6a19c09fea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:05.494778 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bcbe0-9d4f-4c21-aefc-a6a19c09fea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:05.496394 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bcbe0-9d4f-4c21-aefc-a6a19c09fea8 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:05.525083 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1244/2443] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:36:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:05.587711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '186149575e3a4e14a3fe1251ac8137b2', 'request_id': 'req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:05.628833 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '186149575e3a4e14a3fe1251ac8137b2', 'request_id': 'req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:05.725647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '186149575e3a4e14a3fe1251ac8137b2', 'request_id': 'req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:05.773410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2 admin admin] The token cache is being invalidate because project 186149575e3a4e14a3fe1251ac8137b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:36:05.773662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:05.775146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bcfea504-d246-4c5f-aa7f-555eee9a1fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:05.790335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1200/2444] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:36:05 2022] DELETE /identity/v3/projects/186149575e3a4e14a3fe1251ac8137b2 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:36:06.184177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bcbe0-9d4f-4c21-aefc-a6a19c09fea8 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:06.185958 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-fd3bcbe0-9d4f-4c21-aefc-a6a19c09fea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:06.224171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bcbe0-9d4f-4c21-aefc-a6a19c09fea8 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:06.374189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:06.375124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:06.375408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:06.375872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] PATH_INFO: `/v3/projects/9e3d8f068e6b41d385d3fdc46ac8b06c` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:06.379332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3d8f068e6b41d385d3fdc46ac8b06c)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:06.381542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:06.580842 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3d8f068e6b41d385d3fdc46ac8b06c', 'request_id': 'req-82a7c674-2ca1-405e-93bf-96759b021ede'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:06.587704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3d8f068e6b41d385d3fdc46ac8b06c', 'request_id': 'req-82a7c674-2ca1-405e-93bf-96759b021ede'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:06.988755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3d8f068e6b41d385d3fdc46ac8b06c', 'request_id': 'req-82a7c674-2ca1-405e-93bf-96759b021ede'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:07.013765 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] The token cache is being invalidate because project 9e3d8f068e6b41d385d3fdc46ac8b06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:36:07.020052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:07.020225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:36:07.043702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1245/2445] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:36:06 2022] DELETE /identity/v3/projects/9e3d8f068e6b41d385d3fdc46ac8b06c => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:36:16.691453 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cf7ea-6ef2-4310-a2c3-62858215fa5f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:16.692022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cf7ea-6ef2-4310-a2c3-62858215fa5f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:16.692022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cf7ea-6ef2-4310-a2c3-62858215fa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:16.712853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e34cf7ea-6ef2-4310-a2c3-62858215fa5f None None] MFA Rules not processed for user `9e6d29b571fe40f5ab82484e1c7c040b`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:16.714078 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e34cf7ea-6ef2-4310-a2c3-62858215fa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:16.770961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1201/2446] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:36:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:17.375809 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:17.377233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:17.468539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7c674-2ca1-405e-93bf-96759b021ede admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:17.472347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309759b-e4e7-4882-8c70-718665342100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:17.473069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309759b-e4e7-4882-8c70-718665342100 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:17.473352 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309759b-e4e7-4882-8c70-718665342100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:17.473630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309759b-e4e7-4882-8c70-718665342100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:17.476085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4309759b-e4e7-4882-8c70-718665342100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:17.555728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309759b-e4e7-4882-8c70-718665342100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:17.558807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309759b-e4e7-4882-8c70-718665342100 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:17.567697 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1246/2447] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:36:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:22.446706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234463-10f8-4800-9c18-543efcda5944 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:22.447209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234463-10f8-4800-9c18-543efcda5944 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:22.449268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234463-10f8-4800-9c18-543efcda5944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:22.468296 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1c234463-10f8-4800-9c18-543efcda5944 None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:22.469524 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1c234463-10f8-4800-9c18-543efcda5944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:22.528539 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1202/2448] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:36:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:22.541114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309759b-e4e7-4882-8c70-718665342100 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:22.542768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4309759b-e4e7-4882-8c70-718665342100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:22.616759 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309759b-e4e7-4882-8c70-718665342100 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:22.621704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76836523-2e44-4ed1-bec9-8fc6f4b84e39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:22.622399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76836523-2e44-4ed1-bec9-8fc6f4b84e39 service swift] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:22.622682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76836523-2e44-4ed1-bec9-8fc6f4b84e39 service swift] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:22.622960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76836523-2e44-4ed1-bec9-8fc6f4b84e39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:22.632020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76836523-2e44-4ed1-bec9-8fc6f4b84e39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:22.633337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76836523-2e44-4ed1-bec9-8fc6f4b84e39 service swift] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:22.641341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1247/2449] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:36:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:36:26.870554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8091208-33b9-4f28-8b0b-8c5e2fdc9074 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:26.871224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8091208-33b9-4f28-8b0b-8c5e2fdc9074 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:26.871224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8091208-33b9-4f28-8b0b-8c5e2fdc9074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:26.891804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e8091208-33b9-4f28-8b0b-8c5e2fdc9074 None None] MFA Rules not processed for user `d03ba17f93a34c77a027c03a0a800aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:26.893044 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e8091208-33b9-4f28-8b0b-8c5e2fdc9074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:26.956276 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1203/2450] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:36:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:32.684872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feb954-32a4-4636-98b4-127134196e8f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:32.685401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feb954-32a4-4636-98b4-127134196e8f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:32.685401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feb954-32a4-4636-98b4-127134196e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:32.705209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-c3feb954-32a4-4636-98b4-127134196e8f None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:32.706456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c3feb954-32a4-4636-98b4-127134196e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:32.714941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1248/2451] 10.222.0.44 () {58 vars in 967 bytes} [Thu May 5 15:36:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:36:32.727787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8091208-33b9-4f28-8b0b-8c5e2fdc9074 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:32.739602 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8091208-33b9-4f28-8b0b-8c5e2fdc9074 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:32.745737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfce428-2d13-45ae-abce-93050537af4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:32.746417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfce428-2d13-45ae-abce-93050537af4c service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:32.746703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfce428-2d13-45ae-abce-93050537af4c service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:32.746980 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfce428-2d13-45ae-abce-93050537af4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:32.763807 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfce428-2d13-45ae-abce-93050537af4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:32.765618 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfce428-2d13-45ae-abce-93050537af4c service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:32.776297 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1204/2452] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:36:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:37:01.912965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feb954-32a4-4636-98b4-127134196e8f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:01.914445 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c3feb954-32a4-4636-98b4-127134196e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:01.925412 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feb954-32a4-4636-98b4-127134196e8f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:01.929696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908c1fc-668d-4f82-b260-1ccefb495887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:01.930362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908c1fc-668d-4f82-b260-1ccefb495887 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:01.930645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908c1fc-668d-4f82-b260-1ccefb495887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:01.931182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908c1fc-668d-4f82-b260-1ccefb495887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:01.932844 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-5908c1fc-668d-4f82-b260-1ccefb495887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:01.993905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908c1fc-668d-4f82-b260-1ccefb495887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:01.995377 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908c1fc-668d-4f82-b260-1ccefb495887 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:02.005107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1249/2453] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:37:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:21.508458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ac5bf-1d33-445b-bb89-2d4cc7f2d1df None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:21.508987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ac5bf-1d33-445b-bb89-2d4cc7f2d1df None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:21.509095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ac5bf-1d33-445b-bb89-2d4cc7f2d1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:21.526368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c18ac5bf-1d33-445b-bb89-2d4cc7f2d1df None None] MFA Rules not processed for user `33d51822558148749bd9070aff15494c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:21.527559 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c18ac5bf-1d33-445b-bb89-2d4cc7f2d1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:21.580435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1205/2454] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:37:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:46.069921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06665a-a242-4cab-8770-3ba5334e54a9 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:46.070517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06665a-a242-4cab-8770-3ba5334e54a9 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:46.070638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06665a-a242-4cab-8770-3ba5334e54a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:46.102406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ae06665a-a242-4cab-8770-3ba5334e54a9 None None] MFA Rules not processed for user `82f193153bf04ff8b39a9ecf3da423ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:46.113291 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ae06665a-a242-4cab-8770-3ba5334e54a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:46.184168 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1250/2455] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:37:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:46.658230 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ac5bf-1d33-445b-bb89-2d4cc7f2d1df None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:46.668414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ac5bf-1d33-445b-bb89-2d4cc7f2d1df None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:46.672283 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1f035-c9a5-4870-9c2f-b45814061b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:46.672938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1f035-c9a5-4870-9c2f-b45814061b78 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:46.673357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1f035-c9a5-4870-9c2f-b45814061b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:46.673645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1f035-c9a5-4870-9c2f-b45814061b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:46.675494 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d0a1f035-c9a5-4870-9c2f-b45814061b78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:46.758242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1f035-c9a5-4870-9c2f-b45814061b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:46.759797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1f035-c9a5-4870-9c2f-b45814061b78 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:46.771537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1206/2456] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:37:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:49.214834 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06665a-a242-4cab-8770-3ba5334e54a9 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:49.226448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06665a-a242-4cab-8770-3ba5334e54a9 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:49.230129 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19056c5a-d74a-4040-9db0-b685dc611676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:49.233161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19056c5a-d74a-4040-9db0-b685dc611676 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:49.233161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19056c5a-d74a-4040-9db0-b685dc611676 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:49.233161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19056c5a-d74a-4040-9db0-b685dc611676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:49.233451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-19056c5a-d74a-4040-9db0-b685dc611676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:49.246967 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19056c5a-d74a-4040-9db0-b685dc611676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:49.248404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19056c5a-d74a-4040-9db0-b685dc611676 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:49.258328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d057d2-d674-4809-8fa8-0c69f30c4473 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:49.258831 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d057d2-d674-4809-8fa8-0c69f30c4473 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:49.258950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d057d2-d674-4809-8fa8-0c69f30c4473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:49.264596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1251/2457] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:37:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:49.277901 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-08d057d2-d674-4809-8fa8-0c69f30c4473 None None] MFA Rules not processed for user `8e128963426d4f129226a981689531a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:37:49.279308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-08d057d2-d674-4809-8fa8-0c69f30c4473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:49.345582 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1207/2458] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:37:57.406329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19056c5a-d74a-4040-9db0-b685dc611676 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:57.407718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-19056c5a-d74a-4040-9db0-b685dc611676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:57.421330 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19056c5a-d74a-4040-9db0-b685dc611676 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:57.428046 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87f0b6-90c8-4900-ac55-0d13c20d18f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:57.428705 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f0b6-90c8-4900-ac55-0d13c20d18f0 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:57.429012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f0b6-90c8-4900-ac55-0d13c20d18f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:57.429257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f0b6-90c8-4900-ac55-0d13c20d18f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:57.431120 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9b87f0b6-90c8-4900-ac55-0d13c20d18f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:57.444142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87f0b6-90c8-4900-ac55-0d13c20d18f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:57.445671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87f0b6-90c8-4900-ac55-0d13c20d18f0 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:57.455561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1252/2459] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:37:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:37:57.497350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d057d2-d674-4809-8fa8-0c69f30c4473 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:37:57.499065 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-08d057d2-d674-4809-8fa8-0c69f30c4473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:57.588819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d057d2-d674-4809-8fa8-0c69f30c4473 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:37:57.592711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d8d53-690c-46f3-a9a5-f45c44e09a24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f973b13dd44e609110f9a967ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:37:57.593847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d8d53-690c-46f3-a9a5-f45c44e09a24 service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:37:57.594130 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d8d53-690c-46f3-a9a5-f45c44e09a24 service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:37:57.594448 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d8d53-690c-46f3-a9a5-f45c44e09a24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:37:57.596406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e31d8d53-690c-46f3-a9a5-f45c44e09a24 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:37:57.610069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d8d53-690c-46f3-a9a5-f45c44e09a24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:37:57.611765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d8d53-690c-46f3-a9a5-f45c44e09a24 service glance] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:37:57.624200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1208/2460] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:37:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:04.505305 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87f0b6-90c8-4900-ac55-0d13c20d18f0 service nova] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:04.514367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87f0b6-90c8-4900-ac55-0d13c20d18f0 service nova] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:04.518073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8cccd-e6da-4ac6-a41c-d55ebe8b3e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:04.518812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8cccd-e6da-4ac6-a41c-d55ebe8b3e81 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:04.519097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8cccd-e6da-4ac6-a41c-d55ebe8b3e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:04.519374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8cccd-e6da-4ac6-a41c-d55ebe8b3e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:04.521755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c8d8cccd-e6da-4ac6-a41c-d55ebe8b3e81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:04.531095 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8cccd-e6da-4ac6-a41c-d55ebe8b3e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:04.532507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8cccd-e6da-4ac6-a41c-d55ebe8b3e81 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:04.541122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1253/2461] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:38:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:08.624220 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d8d53-690c-46f3-a9a5-f45c44e09a24 service glance] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:08.626038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e31d8d53-690c-46f3-a9a5-f45c44e09a24 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:08.641331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d8d53-690c-46f3-a9a5-f45c44e09a24 service glance] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:08.647457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677b8f4-15b9-4a75-bb30-ce292d75724b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:08.648109 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677b8f4-15b9-4a75-bb30-ce292d75724b service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:08.648474 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677b8f4-15b9-4a75-bb30-ce292d75724b service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:08.648758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677b8f4-15b9-4a75-bb30-ce292d75724b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:08.650674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7677b8f4-15b9-4a75-bb30-ce292d75724b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:08.664184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677b8f4-15b9-4a75-bb30-ce292d75724b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:08.665766 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677b8f4-15b9-4a75-bb30-ce292d75724b service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:08.676269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1209/2462] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:38:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:19.733873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410e229-a9a6-44a1-9245-4e5a6348f8af None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:19.734404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410e229-a9a6-44a1-9245-4e5a6348f8af None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:19.734527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410e229-a9a6-44a1-9245-4e5a6348f8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:19.752354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a410e229-a9a6-44a1-9245-4e5a6348f8af None None] MFA Rules not processed for user `d03ba17f93a34c77a027c03a0a800aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:19.753613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a410e229-a9a6-44a1-9245-4e5a6348f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:19.760836 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1254/2463] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:31.170871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677b8f4-15b9-4a75-bb30-ce292d75724b service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:31.172960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7677b8f4-15b9-4a75-bb30-ce292d75724b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:31.237277 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677b8f4-15b9-4a75-bb30-ce292d75724b service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:31.242400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93290b84-f6c4-4066-8fa3-988a703b37d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:31.243260 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93290b84-f6c4-4066-8fa3-988a703b37d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:31.243542 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93290b84-f6c4-4066-8fa3-988a703b37d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:31.243820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93290b84-f6c4-4066-8fa3-988a703b37d3 admin admin] PATH_INFO: `/v3/users/33d51822558148749bd9070aff15494c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:31.244985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93290b84-f6c4-4066-8fa3-988a703b37d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d51822558148749bd9070aff15494c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:31.246942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93290b84-f6c4-4066-8fa3-988a703b37d3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:31.406290 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-93290b84-f6c4-4066-8fa3-988a703b37d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d51822558148749bd9070aff15494c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:31.413712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-93290b84-f6c4-4066-8fa3-988a703b37d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d51822558148749bd9070aff15494c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:31.414397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-93290b84-f6c4-4066-8fa3-988a703b37d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d51822558148749bd9070aff15494c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:31.415008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-93290b84-f6c4-4066-8fa3-988a703b37d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d51822558148749bd9070aff15494c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:31.426395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-93290b84-f6c4-4066-8fa3-988a703b37d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d51822558148749bd9070aff15494c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:31.507339 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1210/2464] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:38:31 2022] DELETE /identity/v3/users/33d51822558148749bd9070aff15494c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:31.771277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410e229-a9a6-44a1-9245-4e5a6348f8af None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:31.781964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410e229-a9a6-44a1-9245-4e5a6348f8af None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:31.839486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a788a-b175-40dc-9c4e-6e219ee7bf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:31.840354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a788a-b175-40dc-9c4e-6e219ee7bf4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:31.840639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a788a-b175-40dc-9c4e-6e219ee7bf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:31.840917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a788a-b175-40dc-9c4e-6e219ee7bf4c admin admin] PATH_INFO: `/v3/projects/bf61282f689243b28d6c274f616534f0` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:31.842255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a788a-b175-40dc-9c4e-6e219ee7bf4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf61282f689243b28d6c274f616534f0)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:31.844265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a788a-b175-40dc-9c4e-6e219ee7bf4c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:31.956898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-327a788a-b175-40dc-9c4e-6e219ee7bf4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf61282f689243b28d6c274f616534f0', 'request_id': 'req-327a788a-b175-40dc-9c4e-6e219ee7bf4c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:31.962822 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-327a788a-b175-40dc-9c4e-6e219ee7bf4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf61282f689243b28d6c274f616534f0', 'request_id': 'req-327a788a-b175-40dc-9c4e-6e219ee7bf4c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:32.085007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-327a788a-b175-40dc-9c4e-6e219ee7bf4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf61282f689243b28d6c274f616534f0', 'request_id': 'req-327a788a-b175-40dc-9c4e-6e219ee7bf4c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:32.095486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-327a788a-b175-40dc-9c4e-6e219ee7bf4c admin admin] The token cache is being invalidate because project bf61282f689243b28d6c274f616534f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:38:32.095773 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-327a788a-b175-40dc-9c4e-6e219ee7bf4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:32.096482 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-327a788a-b175-40dc-9c4e-6e219ee7bf4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:32.098085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1255/2465] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:38:31 2022] DELETE /identity/v3/projects/bf61282f689243b28d6c274f616534f0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:32.103835 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001fc1-e33c-40b1-9a51-739398756be0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:32.104117 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001fc1-e33c-40b1-9a51-739398756be0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:32.104396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001fc1-e33c-40b1-9a51-739398756be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:32.121436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b2001fc1-e33c-40b1-9a51-739398756be0 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:32.122654 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b2001fc1-e33c-40b1-9a51-739398756be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:32.179793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1211/2466] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:32.187998 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe0e12-a76f-4642-b433-f9c6167f5ac1 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:32.188318 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe0e12-a76f-4642-b433-f9c6167f5ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:32.188594 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe0e12-a76f-4642-b433-f9c6167f5ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:32.206735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-adbe0e12-a76f-4642-b433-f9c6167f5ac1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:32.208580 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-adbe0e12-a76f-4642-b433-f9c6167f5ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:32.216315 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1256/2467] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:32.220703 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2001fc1-e33c-40b1-9a51-739398756be0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:32.231071 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2001fc1-e33c-40b1-9a51-739398756be0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:32.235657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39957b7a-d476-4d70-9d02-c03bdbb152a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:32.236310 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957b7a-d476-4d70-9d02-c03bdbb152a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:32.236597 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957b7a-d476-4d70-9d02-c03bdbb152a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:32.236879 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957b7a-d476-4d70-9d02-c03bdbb152a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:32.237630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39957b7a-d476-4d70-9d02-c03bdbb152a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:38:32.237940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39957b7a-d476-4d70-9d02-c03bdbb152a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:32.239752 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39957b7a-d476-4d70-9d02-c03bdbb152a3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:32.250963 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1212/2468] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:38:32.255981 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe0e12-a76f-4642-b433-f9c6167f5ac1 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:32.265036 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe0e12-a76f-4642-b433-f9c6167f5ac1 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:32.269625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348c471-a260-44ab-9e70-8a253dc7dc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:32.270929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c471-a260-44ab-9e70-8a253dc7dc9c admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:32.271263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c471-a260-44ab-9e70-8a253dc7dc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:32.271502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c471-a260-44ab-9e70-8a253dc7dc9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:32.272215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348c471-a260-44ab-9e70-8a253dc7dc9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:32.274100 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348c471-a260-44ab-9e70-8a253dc7dc9c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:32.359503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1257/2469] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:38:32 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:38:32.363636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39957b7a-d476-4d70-9d02-c03bdbb152a3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:32.373813 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39957b7a-d476-4d70-9d02-c03bdbb152a3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:32.429581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23beeea8-5e4f-4dfa-b99c-b48029abcfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:32.430246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beeea8-5e4f-4dfa-b99c-b48029abcfa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:32.430565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beeea8-5e4f-4dfa-b99c-b48029abcfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:32.430846 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beeea8-5e4f-4dfa-b99c-b48029abcfa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:32.431518 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23beeea8-5e4f-4dfa-b99c-b48029abcfa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:32.433692 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23beeea8-5e4f-4dfa-b99c-b48029abcfa7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:32.546758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1213/2470] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:38:32 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:38:32.550866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348c471-a260-44ab-9e70-8a253dc7dc9c admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:32.561897 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348c471-a260-44ab-9e70-8a253dc7dc9c admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:32.566407 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea54a2-fa8e-4262-ad91-b824201d1784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:32.567614 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea54a2-fa8e-4262-ad91-b824201d1784 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:32.568316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea54a2-fa8e-4262-ad91-b824201d1784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:32.568603 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea54a2-fa8e-4262-ad91-b824201d1784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:32.569328 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea54a2-fa8e-4262-ad91-b824201d1784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:32.570969 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea54a2-fa8e-4262-ad91-b824201d1784 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:32.581042 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1258/2471] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:38:32.585721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23beeea8-5e4f-4dfa-b99c-b48029abcfa7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:32.595424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23beeea8-5e4f-4dfa-b99c-b48029abcfa7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:32.599997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022dd32-e894-4f38-baf3-1697606def44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:32.600650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022dd32-e894-4f38-baf3-1697606def44 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:32.600936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022dd32-e894-4f38-baf3-1697606def44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:32.601215 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022dd32-e894-4f38-baf3-1697606def44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:32.601928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022dd32-e894-4f38-baf3-1697606def44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:32.603566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022dd32-e894-4f38-baf3-1697606def44 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:32.613315 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1214/2472] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:38:32.617405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea54a2-fa8e-4262-ad91-b824201d1784 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:32.627169 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea54a2-fa8e-4262-ad91-b824201d1784 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:32.632391 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb8901-7754-421b-b446-1dfdb5b54712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:32.633258 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb8901-7754-421b-b446-1dfdb5b54712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:32.633533 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb8901-7754-421b-b446-1dfdb5b54712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:32.633805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb8901-7754-421b-b446-1dfdb5b54712 admin admin] PATH_INFO: `/v3/projects/b97c929f22d641ed8726135a088f8313/users/b05dac3c70c44f59a1c333316ba072ac/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:32.648354 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb8901-7754-421b-b446-1dfdb5b54712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97c929f22d641ed8726135a088f8313, user_id=b05dac3c70c44f59a1c333316ba072ac, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:32.650991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb8901-7754-421b-b446-1dfdb5b54712 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:32.730690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1259/2473] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:38:32 2022] PUT /identity/v3/projects/b97c929f22d641ed8726135a088f8313/users/b05dac3c70c44f59a1c333316ba072ac/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:32.736060 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e6adc-b83f-4fa9-995d-44930302432e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:32.736381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e6adc-b83f-4fa9-995d-44930302432e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:32.736662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e6adc-b83f-4fa9-995d-44930302432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:32.755191 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3f6e6adc-b83f-4fa9-995d-44930302432e None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:32.756516 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3f6e6adc-b83f-4fa9-995d-44930302432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:32.814184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1215/2474] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:32.824327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb8901-7754-421b-b446-1dfdb5b54712 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:32.826057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-69eb8901-7754-421b-b446-1dfdb5b54712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:32.883901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb8901-7754-421b-b446-1dfdb5b54712 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:32.887572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd3a3e-ca9d-41da-a5fb-05ca416cb1bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:32.888218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3a3e-ca9d-41da-a5fb-05ca416cb1bf service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:32.888502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3a3e-ca9d-41da-a5fb-05ca416cb1bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:32.888779 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3a3e-ca9d-41da-a5fb-05ca416cb1bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:32.898308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd3a3e-ca9d-41da-a5fb-05ca416cb1bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:32.899734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd3a3e-ca9d-41da-a5fb-05ca416cb1bf service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:32.908933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1260/2475] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:38.865141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61d268-5993-45b0-9aa0-121c74c90729 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:38.867534 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61d268-5993-45b0-9aa0-121c74c90729 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:38.868046 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61d268-5993-45b0-9aa0-121c74c90729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:38.909340 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cc61d268-5993-45b0-9aa0-121c74c90729 None None] MFA Rules not processed for user `b05dac3c70c44f59a1c333316ba072ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:38.910643 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cc61d268-5993-45b0-9aa0-121c74c90729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:38.992105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1216/2476] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:38:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:38.999851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd3a3e-ca9d-41da-a5fb-05ca416cb1bf service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:39.010476 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd3a3e-ca9d-41da-a5fb-05ca416cb1bf service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:39.015061 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03bd26-110e-4035-b945-bc324d3675d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:39.015715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03bd26-110e-4035-b945-bc324d3675d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:39.015994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03bd26-110e-4035-b945-bc324d3675d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:39.016269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03bd26-110e-4035-b945-bc324d3675d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:39.016964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03bd26-110e-4035-b945-bc324d3675d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:39.018892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03bd26-110e-4035-b945-bc324d3675d8 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:39.132145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1261/2477] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:38:38 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:38:39.136227 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61d268-5993-45b0-9aa0-121c74c90729 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:39.147239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61d268-5993-45b0-9aa0-121c74c90729 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:39.207147 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f435b5-4103-4d6f-98e7-a71b66a2dc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:39.207835 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f435b5-4103-4d6f-98e7-a71b66a2dc92 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:39.208207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f435b5-4103-4d6f-98e7-a71b66a2dc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:39.208404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f435b5-4103-4d6f-98e7-a71b66a2dc92 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:39.209251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f435b5-4103-4d6f-98e7-a71b66a2dc92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:39.211254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f435b5-4103-4d6f-98e7-a71b66a2dc92 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:39.244264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03bd26-110e-4035-b945-bc324d3675d8 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:39.246914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2d03bd26-110e-4035-b945-bc324d3675d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:39.308891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1217/2478] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:38:39 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:38:39.312905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f435b5-4103-4d6f-98e7-a71b66a2dc92 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:39.333107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f435b5-4103-4d6f-98e7-a71b66a2dc92 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:39.346519 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22301d-e9ce-44e8-92ed-eda56503b3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:39.347206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22301d-e9ce-44e8-92ed-eda56503b3eb admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:39.347492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22301d-e9ce-44e8-92ed-eda56503b3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:39.347771 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22301d-e9ce-44e8-92ed-eda56503b3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:39.349728 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22301d-e9ce-44e8-92ed-eda56503b3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:39.351388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22301d-e9ce-44e8-92ed-eda56503b3eb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:39.365691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1218/2479] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:38:39.372094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22301d-e9ce-44e8-92ed-eda56503b3eb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:39.392469 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03bd26-110e-4035-b945-bc324d3675d8 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:39.402744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22301d-e9ce-44e8-92ed-eda56503b3eb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:39.408640 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8e221-4488-467b-ad63-486c5f35c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:39.408870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab87d57-de00-43c1-ac17-c69fd0bcfd62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:39.409554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e221-4488-467b-ad63-486c5f35c380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:39.409836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e221-4488-467b-ad63-486c5f35c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:39.410119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e221-4488-467b-ad63-486c5f35c380 admin admin] PATH_INFO: `/v3/projects/188fa01c56c1487a9d106e95aacdef32/users/2cbfef7f4f5c42c3991db7e456a91bb1/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:39.410366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab87d57-de00-43c1-ac17-c69fd0bcfd62 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:39.411659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab87d57-de00-43c1-ac17-c69fd0bcfd62 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:39.412108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab87d57-de00-43c1-ac17-c69fd0bcfd62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:39.424193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8ab87d57-de00-43c1-ac17-c69fd0bcfd62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:39.432223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8e221-4488-467b-ad63-486c5f35c380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188fa01c56c1487a9d106e95aacdef32, user_id=2cbfef7f4f5c42c3991db7e456a91bb1, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:39.435297 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8e221-4488-467b-ad63-486c5f35c380 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:39.451822 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab87d57-de00-43c1-ac17-c69fd0bcfd62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:39.454349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab87d57-de00-43c1-ac17-c69fd0bcfd62 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:39.471953 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1262/2480] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:38:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:39.521867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1219/2481] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:38:39 2022] PUT /identity/v3/projects/188fa01c56c1487a9d106e95aacdef32/users/2cbfef7f4f5c42c3991db7e456a91bb1/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:39.524708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab87d57-de00-43c1-ac17-c69fd0bcfd62 service nova] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:39.538316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab87d57-de00-43c1-ac17-c69fd0bcfd62 service nova] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:39.611896 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d7483-4ec8-4c24-afa8-2ebef4733cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:39.612579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d7483-4ec8-4c24-afa8-2ebef4733cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:39.612949 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d7483-4ec8-4c24-afa8-2ebef4733cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:39.613301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d7483-4ec8-4c24-afa8-2ebef4733cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:39.614653 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d7483-4ec8-4c24-afa8-2ebef4733cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:39.616499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d7483-4ec8-4c24-afa8-2ebef4733cbe admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:39.630815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1263/2482] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:38:39.632188 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8e221-4488-467b-ad63-486c5f35c380 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:39.644386 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8e221-4488-467b-ad63-486c5f35c380 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:39.651121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a68ddf-6a11-4481-ae2a-40391f9ea12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:39.669871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a68ddf-6a11-4481-ae2a-40391f9ea12a admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:39.670169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a68ddf-6a11-4481-ae2a-40391f9ea12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:39.670489 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a68ddf-6a11-4481-ae2a-40391f9ea12a admin admin] PATH_INFO: `/v3/projects/188fa01c56c1487a9d106e95aacdef32/users/2cbfef7f4f5c42c3991db7e456a91bb1/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:39.672757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a68ddf-6a11-4481-ae2a-40391f9ea12a admin admin] RBAC: Authorizing `identity:create_grant(project_id=188fa01c56c1487a9d106e95aacdef32, user_id=2cbfef7f4f5c42c3991db7e456a91bb1, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:39.675575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a68ddf-6a11-4481-ae2a-40391f9ea12a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:39.702754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1220/2483] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:38:39 2022] PUT /identity/v3/projects/188fa01c56c1487a9d106e95aacdef32/users/2cbfef7f4f5c42c3991db7e456a91bb1/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:45.980971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5409-d593-4aba-97a3-f83fd161c0c4 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:45.981534 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5409-d593-4aba-97a3-f83fd161c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:45.981631 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5409-d593-4aba-97a3-f83fd161c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:46.014056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-017e5409-d593-4aba-97a3-f83fd161c0c4 None None] MFA Rules not processed for user `2cbfef7f4f5c42c3991db7e456a91bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:46.015384 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-017e5409-d593-4aba-97a3-f83fd161c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:46.088177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1264/2484] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:46.106274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a68ddf-6a11-4481-ae2a-40391f9ea12a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:46.108077 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-13a68ddf-6a11-4481-ae2a-40391f9ea12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:46.201306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a68ddf-6a11-4481-ae2a-40391f9ea12a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:46.212476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8f9a1-79da-492b-aec2-17325a46ed09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:46.212476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8f9a1-79da-492b-aec2-17325a46ed09 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:46.212476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8f9a1-79da-492b-aec2-17325a46ed09 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:46.213989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8f9a1-79da-492b-aec2-17325a46ed09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:46.277170 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8f9a1-79da-492b-aec2-17325a46ed09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:46.279269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8f9a1-79da-492b-aec2-17325a46ed09 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:46.289557 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1221/2485] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:38:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:38:49.958227 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73a6d9-502f-489c-a2ee-9f2e678b2f43 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:49.958733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73a6d9-502f-489c-a2ee-9f2e678b2f43 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:49.958924 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73a6d9-502f-489c-a2ee-9f2e678b2f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:49.976757 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-5f73a6d9-502f-489c-a2ee-9f2e678b2f43 None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:49.978001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-5f73a6d9-502f-489c-a2ee-9f2e678b2f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:50.042923 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1265/2486] 10.222.0.44 () {58 vars in 967 bytes} [Thu May 5 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:50.202725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8f9a1-79da-492b-aec2-17325a46ed09 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:50.204436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-40b8f9a1-79da-492b-aec2-17325a46ed09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:50.280304 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8f9a1-79da-492b-aec2-17325a46ed09 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:50.293853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986821d7-13de-446f-8987-7686c3f06081 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:50.294746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986821d7-13de-446f-8987-7686c3f06081 service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:50.295181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986821d7-13de-446f-8987-7686c3f06081 service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:50.295471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986821d7-13de-446f-8987-7686c3f06081 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:50.325547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986821d7-13de-446f-8987-7686c3f06081 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:50.327641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986821d7-13de-446f-8987-7686c3f06081 service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:50.359196 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1222/2487] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:38:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:39:00.407335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73a6d9-502f-489c-a2ee-9f2e678b2f43 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:00.407335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-5f73a6d9-502f-489c-a2ee-9f2e678b2f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:00.471360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73a6d9-502f-489c-a2ee-9f2e678b2f43 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:00.477065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:00.477942 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:00.478230 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:00.478555 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] PATH_INFO: `/v3/users/9e6d29b571fe40f5ab82484e1c7c040b` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:00.479776 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6d29b571fe40f5ab82484e1c7c040b)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:00.481837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:00.709545 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6d29b571fe40f5ab82484e1c7c040b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:00.717206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6d29b571fe40f5ab82484e1c7c040b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:00.775392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6d29b571fe40f5ab82484e1c7c040b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:00.776011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6d29b571fe40f5ab82484e1c7c040b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:00.790207 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6d29b571fe40f5ab82484e1c7c040b'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:00.796210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1266/2488] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:39:00 2022] DELETE /identity/v3/users/9e6d29b571fe40f5ab82484e1c7c040b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:01.108698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986821d7-13de-446f-8987-7686c3f06081 service swift] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:01.120446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986821d7-13de-446f-8987-7686c3f06081 service swift] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:01.179156 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:01.180144 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:01.180438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:01.180722 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] PATH_INFO: `/v3/projects/b9373d1d19b54831ae91fb87c0faefed` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:01.181888 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9373d1d19b54831ae91fb87c0faefed)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:01.184066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:01.325711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9373d1d19b54831ae91fb87c0faefed', 'request_id': 'req-39c9ede7-34fd-4301-8739-a692bae19e12'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:01.331954 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9373d1d19b54831ae91fb87c0faefed', 'request_id': 'req-39c9ede7-34fd-4301-8739-a692bae19e12'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:01.439666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9373d1d19b54831ae91fb87c0faefed', 'request_id': 'req-39c9ede7-34fd-4301-8739-a692bae19e12'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:01.450535 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] The token cache is being invalidate because project b9373d1d19b54831ae91fb87c0faefed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:39:01.450826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:01.451460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:01.453215 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1223/2489] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:39:01 2022] DELETE /identity/v3/projects/b9373d1d19b54831ae91fb87c0faefed => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:01.456973 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:01.458677 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:01.471686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198143ee-71cf-4c33-b6d1-3277df0245c3 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:01.529832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451f637-3d08-478c-af8e-36c19ae3d5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:01.530795 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451f637-3d08-478c-af8e-36c19ae3d5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:01.531076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451f637-3d08-478c-af8e-36c19ae3d5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:01.531380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451f637-3d08-478c-af8e-36c19ae3d5b5 admin admin] PATH_INFO: `/v3/users/a24eaad188424bdc89a2895fbdf1dc03` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:01.532593 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451f637-3d08-478c-af8e-36c19ae3d5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24eaad188424bdc89a2895fbdf1dc03)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:01.535002 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451f637-3d08-478c-af8e-36c19ae3d5b5 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:01.715237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2451f637-3d08-478c-af8e-36c19ae3d5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24eaad188424bdc89a2895fbdf1dc03'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:01.722198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2451f637-3d08-478c-af8e-36c19ae3d5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24eaad188424bdc89a2895fbdf1dc03'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:01.798538 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2451f637-3d08-478c-af8e-36c19ae3d5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24eaad188424bdc89a2895fbdf1dc03'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:01.799151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2451f637-3d08-478c-af8e-36c19ae3d5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24eaad188424bdc89a2895fbdf1dc03'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:01.814081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-2451f637-3d08-478c-af8e-36c19ae3d5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24eaad188424bdc89a2895fbdf1dc03'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:01.821719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1267/2490] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:39:01 2022] DELETE /identity/v3/users/a24eaad188424bdc89a2895fbdf1dc03 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:02.084305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:02.085775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:02.099418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9ede7-34fd-4301-8739-a692bae19e12 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:02.161425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:02.162333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:02.162678 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:02.162959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0 admin admin] PATH_INFO: `/v3/projects/d8f16621bb88409f98b981ede4570704` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:02.164235 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f16621bb88409f98b981ede4570704)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:02.166137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:02.306974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f16621bb88409f98b981ede4570704', 'request_id': 'req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:02.313458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f16621bb88409f98b981ede4570704', 'request_id': 'req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:02.421137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f16621bb88409f98b981ede4570704', 'request_id': 'req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:02.431740 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0 admin admin] The token cache is being invalidate because project d8f16621bb88409f98b981ede4570704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:39:02.432016 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:02.432622 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-77aa63fe-51bc-440e-a6e4-cf25ccf3a4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:02.434434 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1224/2491] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:39:02 2022] DELETE /identity/v3/projects/d8f16621bb88409f98b981ede4570704 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:05.991558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb26fe-7c3a-4080-9a80-39d771b33098 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:05.992195 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb26fe-7c3a-4080-9a80-39d771b33098 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:05.992307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb26fe-7c3a-4080-9a80-39d771b33098 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:05.993675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1268/2492] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 5 15:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:39:05.999970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab8f49-ec12-41f5-bfa1-99d4c38f70f2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:06.000427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab8f49-ec12-41f5-bfa1-99d4c38f70f2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:06.000855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab8f49-ec12-41f5-bfa1-99d4c38f70f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:06.024730 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-55ab8f49-ec12-41f5-bfa1-99d4c38f70f2 None None] MFA Rules not processed for user `c5efb606fb1b422182ab91576088c85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:06.026060 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-55ab8f49-ec12-41f5-bfa1-99d4c38f70f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:06.079972 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1225/2493] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 5 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:39:06.092569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb26fe-7c3a-4080-9a80-39d771b33098 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:06.094481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-61fb26fe-7c3a-4080-9a80-39d771b33098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:06.109025 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb26fe-7c3a-4080-9a80-39d771b33098 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:06.113373 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be5313-d426-4ab3-8bf1-3a67dfeab953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:06.114820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be5313-d426-4ab3-8bf1-3a67dfeab953 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:06.118016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be5313-d426-4ab3-8bf1-3a67dfeab953 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:06.118016 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be5313-d426-4ab3-8bf1-3a67dfeab953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:06.122855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be5313-d426-4ab3-8bf1-3a67dfeab953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:06.124280 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be5313-d426-4ab3-8bf1-3a67dfeab953 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:06.133396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1269/2494] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:06.183540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab8f49-ec12-41f5-bfa1-99d4c38f70f2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:06.185232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-55ab8f49-ec12-41f5-bfa1-99d4c38f70f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:06.250708 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24aa7-d2cf-429f-b73d-119f88e16c63 None None] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:06.250993 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24aa7-d2cf-429f-b73d-119f88e16c63 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:06.251279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24aa7-d2cf-429f-b73d-119f88e16c63 None None] PATH_INFO: `/` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:06.252664 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1270/2495] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 5 15:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:39:06.258604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c0f2-f0d4-495c-8933-485ac3024423 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:06.258891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c0f2-f0d4-495c-8933-485ac3024423 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:06.259224 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c0f2-f0d4-495c-8933-485ac3024423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:06.268624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab8f49-ec12-41f5-bfa1-99d4c38f70f2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:06.274670 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d777e1-2c22-4573-a3b1-dfee8e5826e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:06.275302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d777e1-2c22-4573-a3b1-dfee8e5826e4 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:06.275563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d777e1-2c22-4573-a3b1-dfee8e5826e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:06.275837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d777e1-2c22-4573-a3b1-dfee8e5826e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:06.277636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-12d777e1-2c22-4573-a3b1-dfee8e5826e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:06.278070 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-c904c0f2-f0d4-495c-8933-485ac3024423 None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:06.279329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c904c0f2-f0d4-495c-8933-485ac3024423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:06.290142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d777e1-2c22-4573-a3b1-dfee8e5826e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:06.291781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d777e1-2c22-4573-a3b1-dfee8e5826e4 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:06.292673 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1271/2496] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 5 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:39:06.303572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904c0f2-f0d4-495c-8933-485ac3024423 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:06.317797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1226/2497] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:06.322611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904c0f2-f0d4-495c-8933-485ac3024423 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:06.326783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f040c8-4b01-4964-9183-8a0746a8b644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:06.328335 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f040c8-4b01-4964-9183-8a0746a8b644 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:06.328456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f040c8-4b01-4964-9183-8a0746a8b644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:06.328800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f040c8-4b01-4964-9183-8a0746a8b644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:06.341353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f040c8-4b01-4964-9183-8a0746a8b644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:06.343353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f040c8-4b01-4964-9183-8a0746a8b644 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:06.356986 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1272/2498] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:39:06.436378 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d777e1-2c22-4573-a3b1-dfee8e5826e4 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:06.437874 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-12d777e1-2c22-4573-a3b1-dfee8e5826e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:06.508310 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d777e1-2c22-4573-a3b1-dfee8e5826e4 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:06.513441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922ef72-de77-4c37-9be0-d88120e488db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db978c3b147c4b259b623e8c64e7c13a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:06.514090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922ef72-de77-4c37-9be0-d88120e488db service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:06.514420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922ef72-de77-4c37-9be0-d88120e488db service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:06.514701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922ef72-de77-4c37-9be0-d88120e488db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:06.516493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d922ef72-de77-4c37-9be0-d88120e488db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:06.528681 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922ef72-de77-4c37-9be0-d88120e488db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:06.530189 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922ef72-de77-4c37-9be0-d88120e488db service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:06.541000 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1227/2499] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:07.028606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f040c8-4b01-4964-9183-8a0746a8b644 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:07.029989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-97f040c8-4b01-4964-9183-8a0746a8b644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:07.092011 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f040c8-4b01-4964-9183-8a0746a8b644 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:07.096184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf8577-2384-4146-a8dc-6e914a8fd595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:07.096871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf8577-2384-4146-a8dc-6e914a8fd595 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:07.097154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf8577-2384-4146-a8dc-6e914a8fd595 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:07.097427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf8577-2384-4146-a8dc-6e914a8fd595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:07.104904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-27bf8577-2384-4146-a8dc-6e914a8fd595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:07.177277 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf8577-2384-4146-a8dc-6e914a8fd595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:07.178990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf8577-2384-4146-a8dc-6e914a8fd595 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:07.192498 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1273/2500] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:07.402421 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f047bdc-0c59-44aa-8beb-99dc261b969c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:07.403424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f047bdc-0c59-44aa-8beb-99dc261b969c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:07.403725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f047bdc-0c59-44aa-8beb-99dc261b969c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:07.421079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8f047bdc-0c59-44aa-8beb-99dc261b969c None None] MFA Rules not processed for user `b05dac3c70c44f59a1c333316ba072ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:07.422270 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8f047bdc-0c59-44aa-8beb-99dc261b969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:07.476273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1228/2501] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:39:07.858919 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf8577-2384-4146-a8dc-6e914a8fd595 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:07.860416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-27bf8577-2384-4146-a8dc-6e914a8fd595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:07.873594 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf8577-2384-4146-a8dc-6e914a8fd595 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:07.877110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589b472-2448-4a36-acb3-8e0036c505ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:07.877784 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b472-2448-4a36-acb3-8e0036c505ec service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:07.878083 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b472-2448-4a36-acb3-8e0036c505ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:07.878371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b472-2448-4a36-acb3-8e0036c505ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:07.880970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2589b472-2448-4a36-acb3-8e0036c505ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:07.891187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589b472-2448-4a36-acb3-8e0036c505ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:07.892596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589b472-2448-4a36-acb3-8e0036c505ec service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:07.909755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1274/2502] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:14.911905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb8742-ce2b-4320-b336-468688efef4b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:14.912404 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb8742-ce2b-4320-b336-468688efef4b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:14.912972 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb8742-ce2b-4320-b336-468688efef4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:14.932361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-80fb8742-ce2b-4320-b336-468688efef4b None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:14.933645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-80fb8742-ce2b-4320-b336-468688efef4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:14.993681 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1229/2503] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:39:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:15.024233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589b472-2448-4a36-acb3-8e0036c505ec service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:15.024233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2589b472-2448-4a36-acb3-8e0036c505ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:15.127322 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589b472-2448-4a36-acb3-8e0036c505ec service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:15.133166 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b0d4a-e11c-4893-a04e-1f0772c82cd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:15.133840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b0d4a-e11c-4893-a04e-1f0772c82cd7 service swift] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:15.134145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b0d4a-e11c-4893-a04e-1f0772c82cd7 service swift] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:15.134456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b0d4a-e11c-4893-a04e-1f0772c82cd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:15.144429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b0d4a-e11c-4893-a04e-1f0772c82cd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:15.146417 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b0d4a-e11c-4893-a04e-1f0772c82cd7 service swift] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:15.155600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1275/2504] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:39:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:39:36.637171 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb8742-ce2b-4320-b336-468688efef4b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:36.647543 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb8742-ce2b-4320-b336-468688efef4b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:36.651445 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cab0c9-e5f5-4182-a65a-413cddb76c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:36.652187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cab0c9-e5f5-4182-a65a-413cddb76c50 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:36.652502 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cab0c9-e5f5-4182-a65a-413cddb76c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:36.652783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cab0c9-e5f5-4182-a65a-413cddb76c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:36.654791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f8cab0c9-e5f5-4182-a65a-413cddb76c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:36.716950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cab0c9-e5f5-4182-a65a-413cddb76c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:36.718518 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cab0c9-e5f5-4182-a65a-413cddb76c50 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:36.729847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1230/2505] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:36.898437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b0d4a-e11c-4893-a04e-1f0772c82cd7 service swift] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:36.908590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b0d4a-e11c-4893-a04e-1f0772c82cd7 service swift] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:36.913558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0bcd3-e0fc-43b6-9684-2d0a710bf7c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:36.914569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0bcd3-e0fc-43b6-9684-2d0a710bf7c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:36.914852 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0bcd3-e0fc-43b6-9684-2d0a710bf7c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:36.915128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0bcd3-e0fc-43b6-9684-2d0a710bf7c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:36.917031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-3af0bcd3-e0fc-43b6-9684-2d0a710bf7c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:36.987983 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0bcd3-e0fc-43b6-9684-2d0a710bf7c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:36.990402 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0bcd3-e0fc-43b6-9684-2d0a710bf7c4 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:37.003249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1276/2506] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:37.954870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31afe4-7838-43b9-a2c7-2ef5952001fc None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:37.955779 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31afe4-7838-43b9-a2c7-2ef5952001fc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:37.956060 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31afe4-7838-43b9-a2c7-2ef5952001fc None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:37.959625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1231/2507] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 5 15:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:39:37.964596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce267d3-eeb0-4452-8d7b-a5659e9f46d8 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:37.965056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce267d3-eeb0-4452-8d7b-a5659e9f46d8 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:37.965432 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce267d3-eeb0-4452-8d7b-a5659e9f46d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:37.985428 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-2ce267d3-eeb0-4452-8d7b-a5659e9f46d8 None None] MFA Rules not processed for user `eb4ff6ba4e17477d8787eaf1955bd1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:37.986743 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2ce267d3-eeb0-4452-8d7b-a5659e9f46d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:37.997747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1277/2508] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 5 15:39:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:38.010761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31afe4-7838-43b9-a2c7-2ef5952001fc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:38.012514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1d31afe4-7838-43b9-a2c7-2ef5952001fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:38.074380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31afe4-7838-43b9-a2c7-2ef5952001fc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:38.078072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ac20-8e15-46a7-bb6c-507da9aa03b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f973b13dd44e609110f9a967ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:38.078760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ac20-8e15-46a7-bb6c-507da9aa03b6 service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:38.079042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ac20-8e15-46a7-bb6c-507da9aa03b6 service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:38.079333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ac20-8e15-46a7-bb6c-507da9aa03b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:38.090901 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4ac20-8e15-46a7-bb6c-507da9aa03b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:38.092354 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4ac20-8e15-46a7-bb6c-507da9aa03b6 service glance] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:38.104645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1232/2509] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:39.313574 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce267d3-eeb0-4452-8d7b-a5659e9f46d8 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:39.323623 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce267d3-eeb0-4452-8d7b-a5659e9f46d8 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:39.327407 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6105c-fdab-475e-ade8-95c349e50d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:39.328172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6105c-fdab-475e-ade8-95c349e50d53 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:39.328556 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6105c-fdab-475e-ade8-95c349e50d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:39.328935 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6105c-fdab-475e-ade8-95c349e50d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:39.330865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-96f6105c-fdab-475e-ade8-95c349e50d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:39.343263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6105c-fdab-475e-ade8-95c349e50d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:39.344837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6105c-fdab-475e-ade8-95c349e50d53 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:39.356293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1278/2510] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:41.290798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d21034-0c59-44d9-baf0-ebdab5302ba0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:41.292105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d21034-0c59-44d9-baf0-ebdab5302ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:41.292585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d21034-0c59-44d9-baf0-ebdab5302ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:41.325210 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e6d21034-0c59-44d9-baf0-ebdab5302ba0 None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:41.326702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e6d21034-0c59-44d9-baf0-ebdab5302ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:41.351920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6105c-fdab-475e-ade8-95c349e50d53 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:41.362595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1233/2511] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 5 15:39:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:41.365185 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6105c-fdab-475e-ade8-95c349e50d53 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:41.379401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f48a6-634c-4af0-bdcb-209aaddac762 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:41.379401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f48a6-634c-4af0-bdcb-209aaddac762 service swift] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:41.379401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f48a6-634c-4af0-bdcb-209aaddac762 service swift] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:41.379401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f48a6-634c-4af0-bdcb-209aaddac762 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:41.387886 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f48a6-634c-4af0-bdcb-209aaddac762 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:41.391738 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f48a6-634c-4af0-bdcb-209aaddac762 service swift] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:41.419232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1279/2512] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:39:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:39:43.808493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d21034-0c59-44d9-baf0-ebdab5302ba0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:43.811251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e6d21034-0c59-44d9-baf0-ebdab5302ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:43.834530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d21034-0c59-44d9-baf0-ebdab5302ba0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:43.845356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a868f0c-53cc-4008-9bf5-d110d15085de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:43.846915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868f0c-53cc-4008-9bf5-d110d15085de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:43.847606 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868f0c-53cc-4008-9bf5-d110d15085de admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:43.848133 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868f0c-53cc-4008-9bf5-d110d15085de admin admin] PATH_INFO: `/v3/users/d03ba17f93a34c77a027c03a0a800aad` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:43.850452 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a868f0c-53cc-4008-9bf5-d110d15085de admin admin] RBAC: Authorizing `identity:delete_user(user_id=d03ba17f93a34c77a027c03a0a800aad)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:43.852598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a868f0c-53cc-4008-9bf5-d110d15085de admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:44.071645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9a868f0c-53cc-4008-9bf5-d110d15085de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd03ba17f93a34c77a027c03a0a800aad'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:44.078328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9a868f0c-53cc-4008-9bf5-d110d15085de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd03ba17f93a34c77a027c03a0a800aad'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:44.079007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9a868f0c-53cc-4008-9bf5-d110d15085de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd03ba17f93a34c77a027c03a0a800aad'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:44.079609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9a868f0c-53cc-4008-9bf5-d110d15085de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd03ba17f93a34c77a027c03a0a800aad'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:44.091822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9a868f0c-53cc-4008-9bf5-d110d15085de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd03ba17f93a34c77a027c03a0a800aad'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:44.223412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1234/2513] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:39:43 2022] DELETE /identity/v3/users/d03ba17f93a34c77a027c03a0a800aad => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:44.747324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f48a6-634c-4af0-bdcb-209aaddac762 service swift] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:44.768231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f48a6-634c-4af0-bdcb-209aaddac762 service swift] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:44.955990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:44.956928 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:44.957310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:44.957560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] PATH_INFO: `/v3/projects/74c2460709bc4a908b9aa9361b7abfd4` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:44.958978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c2460709bc4a908b9aa9361b7abfd4)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:44.963838 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:45.154550 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c2460709bc4a908b9aa9361b7abfd4', 'request_id': 'req-937da74f-d0b0-40bb-b099-fc99efe69102'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:45.163600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c2460709bc4a908b9aa9361b7abfd4', 'request_id': 'req-937da74f-d0b0-40bb-b099-fc99efe69102'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:45.232632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c2460709bc4a908b9aa9361b7abfd4', 'request_id': 'req-937da74f-d0b0-40bb-b099-fc99efe69102'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:45.248055 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] The token cache is being invalidate because project 74c2460709bc4a908b9aa9361b7abfd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:39:45.250134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:45.250134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:45.255030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1280/2514] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:39:44 2022] DELETE /identity/v3/projects/74c2460709bc4a908b9aa9361b7abfd4 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:45.256845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7afd8b-4c1d-4b0c-bd91-1e91e031ed43 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:45.257316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7afd8b-4c1d-4b0c-bd91-1e91e031ed43 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:45.257407 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7afd8b-4c1d-4b0c-bd91-1e91e031ed43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:45.279074 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9c7afd8b-4c1d-4b0c-bd91-1e91e031ed43 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:45.280628 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9c7afd8b-4c1d-4b0c-bd91-1e91e031ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:45.341902 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:45.343349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:45.368156 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1235/2515] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:45.382398 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6306cf-bd52-41a2-bc93-91fccc045fb1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:45.382691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6306cf-bd52-41a2-bc93-91fccc045fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:45.383165 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6306cf-bd52-41a2-bc93-91fccc045fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:45.422857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-da6306cf-bd52-41a2-bc93-91fccc045fb1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:45.425331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-da6306cf-bd52-41a2-bc93-91fccc045fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:45.435078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937da74f-d0b0-40bb-b099-fc99efe69102 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:45.442525 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:45.443808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:45.444297 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:45.444776 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] PATH_INFO: `/v3/users/8e128963426d4f129226a981689531a9` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:45.446499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e128963426d4f129226a981689531a9)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:45.448797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:45.449046 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1236/2516] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:39:45.454358 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6306cf-bd52-41a2-bc93-91fccc045fb1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:45.470645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6306cf-bd52-41a2-bc93-91fccc045fb1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:45.476395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1e72-1fb9-427c-b6e5-41e7cb29b781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:45.477212 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1e72-1fb9-427c-b6e5-41e7cb29b781 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:45.477490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1e72-1fb9-427c-b6e5-41e7cb29b781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:45.478043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1e72-1fb9-427c-b6e5-41e7cb29b781 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:45.479013 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb1e72-1fb9-427c-b6e5-41e7cb29b781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:39:45.479605 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb1e72-1fb9-427c-b6e5-41e7cb29b781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:45.481638 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb1e72-1fb9-427c-b6e5-41e7cb29b781 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:45.494913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1237/2517] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:39:45.500463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1e72-1fb9-427c-b6e5-41e7cb29b781 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:45.517561 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1e72-1fb9-427c-b6e5-41e7cb29b781 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:45.525003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fb392-ab93-416d-9116-f84e566b2d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:45.525906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fb392-ab93-416d-9116-f84e566b2d56 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:45.526388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fb392-ab93-416d-9116-f84e566b2d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:45.526801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fb392-ab93-416d-9116-f84e566b2d56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:45.527651 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fb392-ab93-416d-9116-f84e566b2d56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:45.529901 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fb392-ab93-416d-9116-f84e566b2d56 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:45.662949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1238/2518] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:39:45 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:39:45.667223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fb392-ab93-416d-9116-f84e566b2d56 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:45.710185 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e128963426d4f129226a981689531a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:45.717999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e128963426d4f129226a981689531a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:45.741164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fb392-ab93-416d-9116-f84e566b2d56 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:45.746329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4c9fc-2e74-4c13-8b61-770bdda55dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:45.747053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4c9fc-2e74-4c13-8b61-770bdda55dae admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:45.753299 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4c9fc-2e74-4c13-8b61-770bdda55dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:45.753625 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4c9fc-2e74-4c13-8b61-770bdda55dae admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:45.754709 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4c9fc-2e74-4c13-8b61-770bdda55dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:45.756708 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4c9fc-2e74-4c13-8b61-770bdda55dae admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:45.803114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e128963426d4f129226a981689531a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:45.803786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e128963426d4f129226a981689531a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:45.817485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e128963426d4f129226a981689531a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:45.824491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1281/2519] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:39:45 2022] DELETE /identity/v3/users/8e128963426d4f129226a981689531a9 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:39:45.872972 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1239/2520] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:39:45 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:39:45.878316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:45.885121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:45.957974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edec418-7efb-4348-b033-6d9a6f589e6c admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:45.963386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a69623-7bf7-4053-8bfc-737df839d7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:45.964078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a69623-7bf7-4053-8bfc-737df839d7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:45.964355 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a69623-7bf7-4053-8bfc-737df839d7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:45.964629 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a69623-7bf7-4053-8bfc-737df839d7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:45.965357 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a69623-7bf7-4053-8bfc-737df839d7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:45.968957 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a69623-7bf7-4053-8bfc-737df839d7e1 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:45.990457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1282/2521] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:39:45.993420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4c9fc-2e74-4c13-8b61-770bdda55dae admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:46.010058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4c9fc-2e74-4c13-8b61-770bdda55dae admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:46.020945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d26db-79e4-4480-b815-b25394d96392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:46.021786 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d26db-79e4-4480-b815-b25394d96392 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:46.022758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d26db-79e4-4480-b815-b25394d96392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:46.023144 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d26db-79e4-4480-b815-b25394d96392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:46.024279 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d26db-79e4-4480-b815-b25394d96392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:46.027613 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d26db-79e4-4480-b815-b25394d96392 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:46.044639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1240/2522] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:39:46.048812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a69623-7bf7-4053-8bfc-737df839d7e1 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:46.060104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a69623-7bf7-4053-8bfc-737df839d7e1 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:46.065232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d79be2-ce8a-4153-9cec-3a2cb7d4f8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:46.066653 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79be2-ce8a-4153-9cec-3a2cb7d4f8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:46.067050 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79be2-ce8a-4153-9cec-3a2cb7d4f8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:46.067230 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79be2-ce8a-4153-9cec-3a2cb7d4f8b0 admin admin] PATH_INFO: `/v3/projects/82169507fe8c48408ee811799ae57210/users/4489fec9456549f09c1d163f1a77cda4/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:46.089652 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d79be2-ce8a-4153-9cec-3a2cb7d4f8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82169507fe8c48408ee811799ae57210, user_id=4489fec9456549f09c1d163f1a77cda4, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:46.093063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d79be2-ce8a-4153-9cec-3a2cb7d4f8b0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:46.156274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d26db-79e4-4480-b815-b25394d96392 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:46.158128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-288d26db-79e4-4480-b815-b25394d96392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:46.188023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d26db-79e4-4480-b815-b25394d96392 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:46.194179 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ae9b9-43f8-4581-9660-7f70a252b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:46.194910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ae9b9-43f8-4581-9660-7f70a252b372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:46.195194 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ae9b9-43f8-4581-9660-7f70a252b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:46.195472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ae9b9-43f8-4581-9660-7f70a252b372 admin admin] PATH_INFO: `/v3/projects/9033d11b107a4c22b38f31a181a05ebe` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:46.196681 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ae9b9-43f8-4581-9660-7f70a252b372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9033d11b107a4c22b38f31a181a05ebe)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:46.198641 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ae9b9-43f8-4581-9660-7f70a252b372 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:46.225940 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1283/2523] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:39:46 2022] PUT /identity/v3/projects/82169507fe8c48408ee811799ae57210/users/4489fec9456549f09c1d163f1a77cda4/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:46.237606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f67db-a2f2-48a4-b103-4f5f572b5bcd None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:46.237992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f67db-a2f2-48a4-b103-4f5f572b5bcd None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:46.238213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f67db-a2f2-48a4-b103-4f5f572b5bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:46.272080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-029f67db-a2f2-48a4-b103-4f5f572b5bcd None None] MFA Rules not processed for user `4489fec9456549f09c1d163f1a77cda4`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:46.273803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-029f67db-a2f2-48a4-b103-4f5f572b5bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:46.359030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1284/2524] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:39:46.370102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f67db-a2f2-48a4-b103-4f5f572b5bcd None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:46.380458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b82ae9b9-43f8-4581-9660-7f70a252b372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9033d11b107a4c22b38f31a181a05ebe', 'request_id': 'req-b82ae9b9-43f8-4581-9660-7f70a252b372'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:46.391653 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b82ae9b9-43f8-4581-9660-7f70a252b372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9033d11b107a4c22b38f31a181a05ebe', 'request_id': 'req-b82ae9b9-43f8-4581-9660-7f70a252b372'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:46.456124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f67db-a2f2-48a4-b103-4f5f572b5bcd None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:46.513557 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dcc33-9d50-4a10-8bb1-10142f4e2a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:46.514358 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dcc33-9d50-4a10-8bb1-10142f4e2a4f admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:46.514718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dcc33-9d50-4a10-8bb1-10142f4e2a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:46.515079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dcc33-9d50-4a10-8bb1-10142f4e2a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:46.515881 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dcc33-9d50-4a10-8bb1-10142f4e2a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:46.517868 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dcc33-9d50-4a10-8bb1-10142f4e2a4f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:46.524458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b82ae9b9-43f8-4581-9660-7f70a252b372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9033d11b107a4c22b38f31a181a05ebe', 'request_id': 'req-b82ae9b9-43f8-4581-9660-7f70a252b372'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:46.536494 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b82ae9b9-43f8-4581-9660-7f70a252b372 admin admin] The token cache is being invalidate because project 9033d11b107a4c22b38f31a181a05ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:39:46.536761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b82ae9b9-43f8-4581-9660-7f70a252b372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:46.537457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b82ae9b9-43f8-4581-9660-7f70a252b372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:46.542664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1241/2525] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:39:46 2022] DELETE /identity/v3/projects/9033d11b107a4c22b38f31a181a05ebe => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:39:46.544357 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d195c8-fa21-4d81-aff0-837ed837ad04 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:46.544754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d195c8-fa21-4d81-aff0-837ed837ad04 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:46.545155 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d195c8-fa21-4d81-aff0-837ed837ad04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:46.564762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-27d195c8-fa21-4d81-aff0-837ed837ad04 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:46.565976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-27d195c8-fa21-4d81-aff0-837ed837ad04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:46.574368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1242/2526] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:46.582828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173658b1-0bad-4aec-a77d-695be72f504f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:46.583331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173658b1-0bad-4aec-a77d-695be72f504f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:46.583681 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173658b1-0bad-4aec-a77d-695be72f504f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:46.604011 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-173658b1-0bad-4aec-a77d-695be72f504f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:46.605226 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-173658b1-0bad-4aec-a77d-695be72f504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:46.613751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1243/2527] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:39:46.617783 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173658b1-0bad-4aec-a77d-695be72f504f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:46.627889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173658b1-0bad-4aec-a77d-695be72f504f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:46.633794 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145eb76-40d5-4a36-b501-90028d18e400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:46.634648 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145eb76-40d5-4a36-b501-90028d18e400 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:46.634936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145eb76-40d5-4a36-b501-90028d18e400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:46.637067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145eb76-40d5-4a36-b501-90028d18e400 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:46.637067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145eb76-40d5-4a36-b501-90028d18e400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:39:46.637067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145eb76-40d5-4a36-b501-90028d18e400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:46.637918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145eb76-40d5-4a36-b501-90028d18e400 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:46.651234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1244/2528] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:39:46.655728 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145eb76-40d5-4a36-b501-90028d18e400 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:46.666481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145eb76-40d5-4a36-b501-90028d18e400 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:46.668690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1285/2529] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:39:46 2022] POST /identity/v3/projects => generated 371 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:39:46.672546 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dcc33-9d50-4a10-8bb1-10142f4e2a4f admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:46.674126 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d97dcc33-9d50-4a10-8bb1-10142f4e2a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:46.738466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2678b-2764-4d39-abc8-a947ee19cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:46.739413 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2678b-2764-4d39-abc8-a947ee19cb03 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:46.739701 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2678b-2764-4d39-abc8-a947ee19cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:46.739984 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2678b-2764-4d39-abc8-a947ee19cb03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:46.740686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2678b-2764-4d39-abc8-a947ee19cb03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:46.742670 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2678b-2764-4d39-abc8-a947ee19cb03 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:46.750055 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dcc33-9d50-4a10-8bb1-10142f4e2a4f admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:46.771980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5a7c3-6d7e-44d1-8c1c-40aa60c0cc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:46.772504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5a7c3-6d7e-44d1-8c1c-40aa60c0cc6b admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:46.772864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5a7c3-6d7e-44d1-8c1c-40aa60c0cc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:46.773451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5a7c3-6d7e-44d1-8c1c-40aa60c0cc6b admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:46.774032 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5a7c3-6d7e-44d1-8c1c-40aa60c0cc6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:46.776101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5a7c3-6d7e-44d1-8c1c-40aa60c0cc6b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:46.891623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1245/2530] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:39:46 2022] POST /identity/v3/projects => generated 407 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:39:46.896551 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2678b-2764-4d39-abc8-a947ee19cb03 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:46.903338 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1286/2531] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:39:46 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:39:46.907405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5a7c3-6d7e-44d1-8c1c-40aa60c0cc6b admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:46.919814 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5a7c3-6d7e-44d1-8c1c-40aa60c0cc6b admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:46.980647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2678b-2764-4d39-abc8-a947ee19cb03 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:46.989704 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae2816-42a5-4864-b570-888315f3bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:46.990785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2816-42a5-4864-b570-888315f3bed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:46.991542 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2816-42a5-4864-b570-888315f3bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:46.991815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2816-42a5-4864-b570-888315f3bed3 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:46.993418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae2816-42a5-4864-b570-888315f3bed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:46.995420 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae2816-42a5-4864-b570-888315f3bed3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:47.008985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccc63a-47ba-4ec6-87f4-70e7b960bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:47.009757 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccc63a-47ba-4ec6-87f4-70e7b960bcac admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:47.010040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccc63a-47ba-4ec6-87f4-70e7b960bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:47.011065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccc63a-47ba-4ec6-87f4-70e7b960bcac admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:47.012455 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccc63a-47ba-4ec6-87f4-70e7b960bcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:47.015890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccc63a-47ba-4ec6-87f4-70e7b960bcac admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:47.026600 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1287/2532] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:39:47.030630 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccc63a-47ba-4ec6-87f4-70e7b960bcac admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:47.041180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccc63a-47ba-4ec6-87f4-70e7b960bcac admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:47.046300 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da214f7d-64ca-44cf-ab80-84d0a276d4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:47.047260 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da214f7d-64ca-44cf-ab80-84d0a276d4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:47.047724 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da214f7d-64ca-44cf-ab80-84d0a276d4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:47.048015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da214f7d-64ca-44cf-ab80-84d0a276d4a4 admin admin] PATH_INFO: `/v3/projects/cbf9815854d848ada8800d0ce9342a75/users/8e26e3bc73a34b079c7a40a4deec1967/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:47.065946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da214f7d-64ca-44cf-ab80-84d0a276d4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf9815854d848ada8800d0ce9342a75, user_id=8e26e3bc73a34b079c7a40a4deec1967, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:47.068880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da214f7d-64ca-44cf-ab80-84d0a276d4a4 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:47.094928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1246/2533] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:39:46 2022] POST /identity/v3/users => generated 304 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:39:47.100097 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae2816-42a5-4864-b570-888315f3bed3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:47.110333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae2816-42a5-4864-b570-888315f3bed3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:47.116062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588bb0b-6ea1-45c3-b9f2-9b224e469ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:47.116732 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588bb0b-6ea1-45c3-b9f2-9b224e469ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:47.117014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588bb0b-6ea1-45c3-b9f2-9b224e469ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:47.117299 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588bb0b-6ea1-45c3-b9f2-9b224e469ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:47.118005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588bb0b-6ea1-45c3-b9f2-9b224e469ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:47.119819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588bb0b-6ea1-45c3-b9f2-9b224e469ed2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:47.130652 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1247/2534] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:39:47.134644 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588bb0b-6ea1-45c3-b9f2-9b224e469ed2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:47.146251 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588bb0b-6ea1-45c3-b9f2-9b224e469ed2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:47.147945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1288/2535] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:39:47 2022] PUT /identity/v3/projects/cbf9815854d848ada8800d0ce9342a75/users/8e26e3bc73a34b079c7a40a4deec1967/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:39:47.154785 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da214f7d-64ca-44cf-ab80-84d0a276d4a4 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:47.214824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f9663-88d0-4d54-855e-4cbb9279bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:47.215503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9663-88d0-4d54-855e-4cbb9279bec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:47.215791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9663-88d0-4d54-855e-4cbb9279bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:47.216075 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9663-88d0-4d54-855e-4cbb9279bec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:47.216793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f9663-88d0-4d54-855e-4cbb9279bec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:47.217361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da214f7d-64ca-44cf-ab80-84d0a276d4a4 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:47.218467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f9663-88d0-4d54-855e-4cbb9279bec8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:47.222076 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1cacd-8a60-4740-94d2-f75a6bd03e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:47.223359 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1cacd-8a60-4740-94d2-f75a6bd03e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:47.223649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1cacd-8a60-4740-94d2-f75a6bd03e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:47.223933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1cacd-8a60-4740-94d2-f75a6bd03e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:47.224664 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1cacd-8a60-4740-94d2-f75a6bd03e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:47.226254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1cacd-8a60-4740-94d2-f75a6bd03e37 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:47.229546 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1248/2536] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:39:47.239620 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1289/2537] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:39:47.239798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f9663-88d0-4d54-855e-4cbb9279bec8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:47.240932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1cacd-8a60-4740-94d2-f75a6bd03e37 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:47.247167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f9663-88d0-4d54-855e-4cbb9279bec8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:47.251805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1cacd-8a60-4740-94d2-f75a6bd03e37 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:47.256775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd83c9-29f6-439f-aa0d-e9e62874d6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:47.257678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd83c9-29f6-439f-aa0d-e9e62874d6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:47.257972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd83c9-29f6-439f-aa0d-e9e62874d6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:47.258258 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd83c9-29f6-439f-aa0d-e9e62874d6b4 admin admin] PATH_INFO: `/v3/projects/cbf9815854d848ada8800d0ce9342a75/users/8e26e3bc73a34b079c7a40a4deec1967/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:47.260341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd83c9-29f6-439f-aa0d-e9e62874d6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf9815854d848ada8800d0ce9342a75, user_id=8e26e3bc73a34b079c7a40a4deec1967, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:47.263072 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd83c9-29f6-439f-aa0d-e9e62874d6b4 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:47.263603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d261427-bd0f-4df9-a03d-686a1ea4ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:47.264505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d261427-bd0f-4df9-a03d-686a1ea4ecc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:47.264801 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d261427-bd0f-4df9-a03d-686a1ea4ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:47.265069 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d261427-bd0f-4df9-a03d-686a1ea4ecc6 admin admin] PATH_INFO: `/v3/projects/c9d70a132ec44eeeb83d1e019527470c/users/46328a5ae7494e89bca0077055fe4c0c/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:47.283658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d261427-bd0f-4df9-a03d-686a1ea4ecc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d70a132ec44eeeb83d1e019527470c, user_id=46328a5ae7494e89bca0077055fe4c0c, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:47.287439 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d261427-bd0f-4df9-a03d-686a1ea4ecc6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:47.294329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1290/2538] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:39:47 2022] PUT /identity/v3/projects/cbf9815854d848ada8800d0ce9342a75/users/8e26e3bc73a34b079c7a40a4deec1967/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:47.302193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f532806-a3ab-4f20-a5c4-50e7ef3fc623 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:47.304442 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f532806-a3ab-4f20-a5c4-50e7ef3fc623 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:47.304442 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f532806-a3ab-4f20-a5c4-50e7ef3fc623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:47.336122 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-7f532806-a3ab-4f20-a5c4-50e7ef3fc623 None None] MFA Rules not processed for user `8e26e3bc73a34b079c7a40a4deec1967`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:47.337778 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7f532806-a3ab-4f20-a5c4-50e7ef3fc623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:47.418040 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1249/2539] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:39:47 2022] PUT /identity/v3/projects/c9d70a132ec44eeeb83d1e019527470c/users/46328a5ae7494e89bca0077055fe4c0c/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:47.428457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1291/2540] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:39:47.430739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540e587-f0c4-4d8d-aa2c-85cfa21417f8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:47.430909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540e587-f0c4-4d8d-aa2c-85cfa21417f8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:47.431156 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540e587-f0c4-4d8d-aa2c-85cfa21417f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:47.436621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f532806-a3ab-4f20-a5c4-50e7ef3fc623 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:47.438796 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7f532806-a3ab-4f20-a5c4-50e7ef3fc623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:47.490476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c540e587-f0c4-4d8d-aa2c-85cfa21417f8 None None] MFA Rules not processed for user `46328a5ae7494e89bca0077055fe4c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:47.492707 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c540e587-f0c4-4d8d-aa2c-85cfa21417f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:47.528413 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f532806-a3ab-4f20-a5c4-50e7ef3fc623 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:47.583608 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1250/2541] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:47.588112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540e587-f0c4-4d8d-aa2c-85cfa21417f8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:47.599842 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984fb45-6692-472b-ae2f-02ce6106d35a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:47.600810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984fb45-6692-472b-ae2f-02ce6106d35a service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:47.601108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984fb45-6692-472b-ae2f-02ce6106d35a service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:47.601389 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984fb45-6692-472b-ae2f-02ce6106d35a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:47.679459 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984fb45-6692-472b-ae2f-02ce6106d35a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:47.681465 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984fb45-6692-472b-ae2f-02ce6106d35a service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:47.685643 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540e587-f0c4-4d8d-aa2c-85cfa21417f8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:47.690466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288f3dd-0327-4268-8652-b73899056f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:47.691134 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f3dd-0327-4268-8652-b73899056f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:47.691635 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f3dd-0327-4268-8652-b73899056f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:47.691899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f3dd-0327-4268-8652-b73899056f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:47.692589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288f3dd-0327-4268-8652-b73899056f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:47.694347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1292/2542] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:39:47.698565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288f3dd-0327-4268-8652-b73899056f97 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:47.808355 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1251/2543] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:39:47 2022] POST /identity/v3/projects => generated 407 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:39:47.812972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984fb45-6692-472b-ae2f-02ce6106d35a service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:47.823768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984fb45-6692-472b-ae2f-02ce6106d35a service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:47.899969 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ca05e-865d-46f0-9e0d-724f8c71ca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:47.900653 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ca05e-865d-46f0-9e0d-724f8c71ca5d admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:47.900931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ca05e-865d-46f0-9e0d-724f8c71ca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:47.901208 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ca05e-865d-46f0-9e0d-724f8c71ca5d admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:47.901914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ca05e-865d-46f0-9e0d-724f8c71ca5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:47.903863 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ca05e-865d-46f0-9e0d-724f8c71ca5d admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:48.018574 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1293/2544] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:39:47 2022] POST /identity/v3/users => generated 310 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:39:48.020510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288f3dd-0327-4268-8652-b73899056f97 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:48.031177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288f3dd-0327-4268-8652-b73899056f97 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:48.036500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256f124-42a9-48f7-9140-00cd8e009c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:48.037192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256f124-42a9-48f7-9140-00cd8e009c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:48.037469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256f124-42a9-48f7-9140-00cd8e009c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:48.037744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256f124-42a9-48f7-9140-00cd8e009c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:48.038511 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256f124-42a9-48f7-9140-00cd8e009c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:48.040095 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256f124-42a9-48f7-9140-00cd8e009c64 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:48.051348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1252/2545] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:39:48.055743 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ca05e-865d-46f0-9e0d-724f8c71ca5d admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:48.066390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ca05e-865d-46f0-9e0d-724f8c71ca5d admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:48.071411 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8493875-dcd5-468b-ba04-074f3d5dbf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:48.072344 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493875-dcd5-468b-ba04-074f3d5dbf32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:48.072628 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493875-dcd5-468b-ba04-074f3d5dbf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:48.072918 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493875-dcd5-468b-ba04-074f3d5dbf32 admin admin] PATH_INFO: `/v3/projects/12cc6fc6e26e47cd98d23ff28107fe59/users/d1cf9569a3e748efb0d7d02820f51193/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:48.089367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8493875-dcd5-468b-ba04-074f3d5dbf32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cc6fc6e26e47cd98d23ff28107fe59, user_id=d1cf9569a3e748efb0d7d02820f51193, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:48.092041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8493875-dcd5-468b-ba04-074f3d5dbf32 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:48.219910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1294/2546] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:39:48 2022] PUT /identity/v3/projects/12cc6fc6e26e47cd98d23ff28107fe59/users/d1cf9569a3e748efb0d7d02820f51193/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:39:48.224870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256f124-42a9-48f7-9140-00cd8e009c64 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:48.235484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256f124-42a9-48f7-9140-00cd8e009c64 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:48.299735 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83277bb3-8e9e-42ab-bad2-af40024fe7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:48.300391 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83277bb3-8e9e-42ab-bad2-af40024fe7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:48.301379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83277bb3-8e9e-42ab-bad2-af40024fe7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:48.301667 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83277bb3-8e9e-42ab-bad2-af40024fe7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:48.307364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83277bb3-8e9e-42ab-bad2-af40024fe7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:48.309259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83277bb3-8e9e-42ab-bad2-af40024fe7c8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:48.322264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1253/2547] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:39:48.325828 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8493875-dcd5-468b-ba04-074f3d5dbf32 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:48.338350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8493875-dcd5-468b-ba04-074f3d5dbf32 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:48.343074 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0a134-b6ca-4bcb-995a-2f6ba3485b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:48.343985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0a134-b6ca-4bcb-995a-2f6ba3485b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:48.344266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0a134-b6ca-4bcb-995a-2f6ba3485b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:48.344543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0a134-b6ca-4bcb-995a-2f6ba3485b1e admin admin] PATH_INFO: `/v3/projects/12cc6fc6e26e47cd98d23ff28107fe59/users/d1cf9569a3e748efb0d7d02820f51193/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:48.346739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0a134-b6ca-4bcb-995a-2f6ba3485b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cc6fc6e26e47cd98d23ff28107fe59, user_id=d1cf9569a3e748efb0d7d02820f51193, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:48.350204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0a134-b6ca-4bcb-995a-2f6ba3485b1e admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:48.363932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1295/2548] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:39:48 2022] PUT /identity/v3/projects/12cc6fc6e26e47cd98d23ff28107fe59/users/d1cf9569a3e748efb0d7d02820f51193/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:48.376471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77713129-ce5b-48f9-8d5a-d557b52763bd None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:48.376471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77713129-ce5b-48f9-8d5a-d557b52763bd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:48.376471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77713129-ce5b-48f9-8d5a-d557b52763bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:48.411543 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-77713129-ce5b-48f9-8d5a-d557b52763bd None None] MFA Rules not processed for user `d1cf9569a3e748efb0d7d02820f51193`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:48.413024 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-77713129-ce5b-48f9-8d5a-d557b52763bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:48.513178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1254/2549] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:48.521761 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0a134-b6ca-4bcb-995a-2f6ba3485b1e admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:48.525564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-81b0a134-b6ca-4bcb-995a-2f6ba3485b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:48.647584 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0a134-b6ca-4bcb-995a-2f6ba3485b1e admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:48.651588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63198e53-8df1-4dc9-a80e-bf117d764625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:48.652241 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198e53-8df1-4dc9-a80e-bf117d764625 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:48.652522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198e53-8df1-4dc9-a80e-bf117d764625 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:48.652798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198e53-8df1-4dc9-a80e-bf117d764625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:48.664514 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63198e53-8df1-4dc9-a80e-bf117d764625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:48.666331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63198e53-8df1-4dc9-a80e-bf117d764625 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:48.682360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1296/2550] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:48 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:48.905881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77713129-ce5b-48f9-8d5a-d557b52763bd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:48.969845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77713129-ce5b-48f9-8d5a-d557b52763bd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:48.976495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:48.977384 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:48.977663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:48.977941 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] PATH_INFO: `/v3/users/4489fec9456549f09c1d163f1a77cda4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:48.979302 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4489fec9456549f09c1d163f1a77cda4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:48.981230 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:49.174331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63198e53-8df1-4dc9-a80e-bf117d764625 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:49.189618 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63198e53-8df1-4dc9-a80e-bf117d764625 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:49.194713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebbf0b-e130-47e3-ac17-5df646d463fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:49.195372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebbf0b-e130-47e3-ac17-5df646d463fb service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:49.195679 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebbf0b-e130-47e3-ac17-5df646d463fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:49.195980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebbf0b-e130-47e3-ac17-5df646d463fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:49.261756 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebbf0b-e130-47e3-ac17-5df646d463fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:49.263280 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebbf0b-e130-47e3-ac17-5df646d463fb service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:49.275059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1297/2551] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:39:49.624427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4489fec9456549f09c1d163f1a77cda4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:49.631336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4489fec9456549f09c1d163f1a77cda4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:49.632002 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4489fec9456549f09c1d163f1a77cda4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:49.632599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4489fec9456549f09c1d163f1a77cda4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:49.643951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4489fec9456549f09c1d163f1a77cda4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:49.762022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1255/2552] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:39:48 2022] DELETE /identity/v3/users/4489fec9456549f09c1d163f1a77cda4 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:49.766539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d4910-f8d7-4474-a822-098211790d22 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:49.766952 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d4910-f8d7-4474-a822-098211790d22 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:49.767321 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d4910-f8d7-4474-a822-098211790d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:49.786805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-7a8d4910-f8d7-4474-a822-098211790d22 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:49.788064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7a8d4910-f8d7-4474-a822-098211790d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:49.865985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1298/2553] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:49.881038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:49.882554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:49.951341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414a02c-567e-4378-8987-fce0386b09d1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:49.955087 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30d36e-d705-4d14-9f11-72324686a8c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:49.955754 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30d36e-d705-4d14-9f11-72324686a8c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:49.956032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30d36e-d705-4d14-9f11-72324686a8c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:49.956313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30d36e-d705-4d14-9f11-72324686a8c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:49.967035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30d36e-d705-4d14-9f11-72324686a8c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:49.968638 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30d36e-d705-4d14-9f11-72324686a8c0 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:49.981741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1256/2554] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:50.481279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d4910-f8d7-4474-a822-098211790d22 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:50.482925 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7a8d4910-f8d7-4474-a822-098211790d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:50.499258 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d4910-f8d7-4474-a822-098211790d22 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:50.506195 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:50.507470 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:50.507988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:50.508476 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] PATH_INFO: `/v3/projects/82169507fe8c48408ee811799ae57210` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:50.510225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82169507fe8c48408ee811799ae57210)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:50.512491 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:50.642973 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82169507fe8c48408ee811799ae57210', 'request_id': 'req-38cd452d-b257-4c8f-98f5-c453cedd2a38'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:50.650893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82169507fe8c48408ee811799ae57210', 'request_id': 'req-38cd452d-b257-4c8f-98f5-c453cedd2a38'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:51.787966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82169507fe8c48408ee811799ae57210', 'request_id': 'req-38cd452d-b257-4c8f-98f5-c453cedd2a38'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:51.798396 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] The token cache is being invalidate because project 82169507fe8c48408ee811799ae57210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:39:51.798689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:51.799343 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:51.800951 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1299/2555] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:39:50 2022] DELETE /identity/v3/projects/82169507fe8c48408ee811799ae57210 => generated 0 bytes in 1320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:51.805014 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30d36e-d705-4d14-9f11-72324686a8c0 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:51.814865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30d36e-d705-4d14-9f11-72324686a8c0 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:51.870550 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bc795-e6c8-4451-a412-392995c40bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:51.871425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bc795-e6c8-4451-a412-392995c40bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:51.871709 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bc795-e6c8-4451-a412-392995c40bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:51.871982 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bc795-e6c8-4451-a412-392995c40bc2 admin admin] PATH_INFO: `/v3/users/8e26e3bc73a34b079c7a40a4deec1967` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:51.873182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bc795-e6c8-4451-a412-392995c40bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e26e3bc73a34b079c7a40a4deec1967)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:51.875140 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bc795-e6c8-4451-a412-392995c40bc2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:52.074984 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-233bc795-e6c8-4451-a412-392995c40bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e26e3bc73a34b079c7a40a4deec1967'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:52.081843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-233bc795-e6c8-4451-a412-392995c40bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e26e3bc73a34b079c7a40a4deec1967'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:52.082714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-233bc795-e6c8-4451-a412-392995c40bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e26e3bc73a34b079c7a40a4deec1967'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:52.083328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-233bc795-e6c8-4451-a412-392995c40bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e26e3bc73a34b079c7a40a4deec1967'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:52.094957 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-233bc795-e6c8-4451-a412-392995c40bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e26e3bc73a34b079c7a40a4deec1967'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:52.198996 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1257/2556] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:39:51 2022] DELETE /identity/v3/users/8e26e3bc73a34b079c7a40a4deec1967 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:52.674060 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:52.675656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:52.690721 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd452d-b257-4c8f-98f5-c453cedd2a38 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:52.759805 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:52.760807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:52.761104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:52.761392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829 admin admin] PATH_INFO: `/v3/projects/cbf9815854d848ada8800d0ce9342a75` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:52.764508 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf9815854d848ada8800d0ce9342a75)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:52.767050 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:52.948425 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf9815854d848ada8800d0ce9342a75', 'request_id': 'req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:52.954850 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf9815854d848ada8800d0ce9342a75', 'request_id': 'req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:53.055551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf9815854d848ada8800d0ce9342a75', 'request_id': 'req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:53.069626 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829 admin admin] The token cache is being invalidate because project cbf9815854d848ada8800d0ce9342a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:39:53.070113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:53.073047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-24a2b8d3-c2f0-4cd5-b3e2-0b19fb83e829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:53.073705 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1300/2557] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:39:52 2022] DELETE /identity/v3/projects/cbf9815854d848ada8800d0ce9342a75 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:53.079708 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f1df8-7a6c-458a-b5e1-20c1d3f83323 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:53.080222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f1df8-7a6c-458a-b5e1-20c1d3f83323 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:53.080331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f1df8-7a6c-458a-b5e1-20c1d3f83323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:53.111822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5c0f1df8-7a6c-458a-b5e1-20c1d3f83323 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:53.113563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5c0f1df8-7a6c-458a-b5e1-20c1d3f83323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:53.174047 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1258/2558] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:53.182511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8cfb3-67ba-452a-bccd-3ba8d02290fc None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:53.182808 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8cfb3-67ba-452a-bccd-3ba8d02290fc None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:53.183093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8cfb3-67ba-452a-bccd-3ba8d02290fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:53.202914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ffa8cfb3-67ba-452a-bccd-3ba8d02290fc None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:53.204057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ffa8cfb3-67ba-452a-bccd-3ba8d02290fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:53.213103 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1301/2559] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:53.218237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f1df8-7a6c-458a-b5e1-20c1d3f83323 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:53.228844 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f1df8-7a6c-458a-b5e1-20c1d3f83323 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:53.233868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb87dd-8783-43e9-823a-ae026637dc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:53.234573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb87dd-8783-43e9-823a-ae026637dc42 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:53.234856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb87dd-8783-43e9-823a-ae026637dc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:53.235130 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb87dd-8783-43e9-823a-ae026637dc42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:53.235853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb87dd-8783-43e9-823a-ae026637dc42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:39:53.236158 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb87dd-8783-43e9-823a-ae026637dc42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:53.237808 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb87dd-8783-43e9-823a-ae026637dc42 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:53.251643 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1259/2560] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:39:53.256746 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8cfb3-67ba-452a-bccd-3ba8d02290fc None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:53.266308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8cfb3-67ba-452a-bccd-3ba8d02290fc None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:53.271503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e9e8a-db16-4f2d-a2dc-375654858c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:53.272257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e9e8a-db16-4f2d-a2dc-375654858c36 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:53.272619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e9e8a-db16-4f2d-a2dc-375654858c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:53.273082 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e9e8a-db16-4f2d-a2dc-375654858c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:53.273876 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e9e8a-db16-4f2d-a2dc-375654858c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:53.276084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e9e8a-db16-4f2d-a2dc-375654858c36 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:53.348151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1302/2561] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:39:53 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:39:53.353815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb87dd-8783-43e9-823a-ae026637dc42 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:53.365822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb87dd-8783-43e9-823a-ae026637dc42 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:53.428500 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec3fb2-0408-4af3-a4d1-272bcc24944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:53.429181 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec3fb2-0408-4af3-a4d1-272bcc24944c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:53.430588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec3fb2-0408-4af3-a4d1-272bcc24944c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:53.430588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec3fb2-0408-4af3-a4d1-272bcc24944c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:53.430588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec3fb2-0408-4af3-a4d1-272bcc24944c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:53.432497 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec3fb2-0408-4af3-a4d1-272bcc24944c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:53.542975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1260/2562] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:39:53 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:39:53.547106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e9e8a-db16-4f2d-a2dc-375654858c36 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:53.557960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e9e8a-db16-4f2d-a2dc-375654858c36 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:53.567939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecbc21-a671-4240-809f-c4764aad43d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:53.567939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecbc21-a671-4240-809f-c4764aad43d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:53.567939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecbc21-a671-4240-809f-c4764aad43d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:53.567939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecbc21-a671-4240-809f-c4764aad43d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:53.568339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecbc21-a671-4240-809f-c4764aad43d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:53.568339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecbc21-a671-4240-809f-c4764aad43d9 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:53.576991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1303/2563] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:39:53.580989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec3fb2-0408-4af3-a4d1-272bcc24944c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:53.591105 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec3fb2-0408-4af3-a4d1-272bcc24944c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:53.595823 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93d7ec-c47c-47b9-8ff5-6dcb635ec8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:53.596478 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d7ec-c47c-47b9-8ff5-6dcb635ec8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:53.596758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d7ec-c47c-47b9-8ff5-6dcb635ec8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:53.597031 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d7ec-c47c-47b9-8ff5-6dcb635ec8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:53.598355 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93d7ec-c47c-47b9-8ff5-6dcb635ec8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:53.599941 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93d7ec-c47c-47b9-8ff5-6dcb635ec8f5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:53.609901 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1261/2564] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:39:53.614804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecbc21-a671-4240-809f-c4764aad43d9 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:53.624689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecbc21-a671-4240-809f-c4764aad43d9 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:53.629343 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1dbff-52ea-40c2-8a0f-b86a123cd4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:53.630217 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1dbff-52ea-40c2-8a0f-b86a123cd4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:53.630539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1dbff-52ea-40c2-8a0f-b86a123cd4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:53.630821 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1dbff-52ea-40c2-8a0f-b86a123cd4a0 admin admin] PATH_INFO: `/v3/projects/030a6fb99b88438ca8a13ed1be7f32aa/users/6458b87fd522437aa4195cd4f0628356/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:53.644834 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1dbff-52ea-40c2-8a0f-b86a123cd4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=030a6fb99b88438ca8a13ed1be7f32aa, user_id=6458b87fd522437aa4195cd4f0628356, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:53.647563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1dbff-52ea-40c2-8a0f-b86a123cd4a0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:53.718020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1304/2565] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:39:53 2022] PUT /identity/v3/projects/030a6fb99b88438ca8a13ed1be7f32aa/users/6458b87fd522437aa4195cd4f0628356/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:53.730427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8122be-7907-4e27-acdc-193e0a4fd0b8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:53.730850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8122be-7907-4e27-acdc-193e0a4fd0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:53.731236 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8122be-7907-4e27-acdc-193e0a4fd0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:53.759890 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ba8122be-7907-4e27-acdc-193e0a4fd0b8 None None] MFA Rules not processed for user `6458b87fd522437aa4195cd4f0628356`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:53.761407 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ba8122be-7907-4e27-acdc-193e0a4fd0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:53.833598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1262/2566] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:53.838010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1dbff-52ea-40c2-8a0f-b86a123cd4a0 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:53.899250 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1dbff-52ea-40c2-8a0f-b86a123cd4a0 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:53.903950 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447299f-0e18-4aad-be5a-c794bb6a4f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:53.904609 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447299f-0e18-4aad-be5a-c794bb6a4f72 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:53.904893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447299f-0e18-4aad-be5a-c794bb6a4f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:53.905170 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447299f-0e18-4aad-be5a-c794bb6a4f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:53.905871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447299f-0e18-4aad-be5a-c794bb6a4f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:53.907853 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447299f-0e18-4aad-be5a-c794bb6a4f72 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:53.999870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1305/2567] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:39:53 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:39:54.003942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8122be-7907-4e27-acdc-193e0a4fd0b8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:54.014525 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8122be-7907-4e27-acdc-193e0a4fd0b8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:54.069852 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba304a8-9070-4fe1-8fdc-aaa32165212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:54.070464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba304a8-9070-4fe1-8fdc-aaa32165212b admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:54.070746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba304a8-9070-4fe1-8fdc-aaa32165212b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:54.071023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba304a8-9070-4fe1-8fdc-aaa32165212b admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:54.071699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba304a8-9070-4fe1-8fdc-aaa32165212b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:54.073604 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba304a8-9070-4fe1-8fdc-aaa32165212b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:54.176433 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1263/2568] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:39:54 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:39:54.180293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447299f-0e18-4aad-be5a-c794bb6a4f72 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:54.190949 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447299f-0e18-4aad-be5a-c794bb6a4f72 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:54.196040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b7dea-0055-4637-8168-715bfabdbd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:54.196736 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b7dea-0055-4637-8168-715bfabdbd6f admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:54.197075 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b7dea-0055-4637-8168-715bfabdbd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:54.197397 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b7dea-0055-4637-8168-715bfabdbd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:54.198124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b7dea-0055-4637-8168-715bfabdbd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:54.199791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b7dea-0055-4637-8168-715bfabdbd6f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:54.210905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1306/2569] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:39:54.214917 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba304a8-9070-4fe1-8fdc-aaa32165212b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:54.225618 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba304a8-9070-4fe1-8fdc-aaa32165212b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:54.230139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab356a-a756-411b-bea9-0c1a81395114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:54.231025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab356a-a756-411b-bea9-0c1a81395114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:54.231306 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab356a-a756-411b-bea9-0c1a81395114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:54.231579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab356a-a756-411b-bea9-0c1a81395114 admin admin] PATH_INFO: `/v3/projects/93c874b6a1fc489d891cfe39fb660da7/users/9f3b6bd808af405095445f007acd05c8/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:54.246944 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab356a-a756-411b-bea9-0c1a81395114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c874b6a1fc489d891cfe39fb660da7, user_id=9f3b6bd808af405095445f007acd05c8, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:54.249570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab356a-a756-411b-bea9-0c1a81395114 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:54.370568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1264/2570] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:39:54 2022] PUT /identity/v3/projects/93c874b6a1fc489d891cfe39fb660da7/users/9f3b6bd808af405095445f007acd05c8/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:54.374572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b7dea-0055-4637-8168-715bfabdbd6f admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:54.385082 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b7dea-0055-4637-8168-715bfabdbd6f admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:54.438394 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a819dfa-7e83-4902-8dff-963d81a36502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:54.439071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a819dfa-7e83-4902-8dff-963d81a36502 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:54.439351 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a819dfa-7e83-4902-8dff-963d81a36502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:54.439621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a819dfa-7e83-4902-8dff-963d81a36502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:54.440373 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a819dfa-7e83-4902-8dff-963d81a36502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:54.442728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a819dfa-7e83-4902-8dff-963d81a36502 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:54.452847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1307/2571] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:39:54.457791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab356a-a756-411b-bea9-0c1a81395114 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:54.467820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab356a-a756-411b-bea9-0c1a81395114 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:54.472654 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03024f83-fd66-48bd-9cb9-4c90dd5dd718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:54.473548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03024f83-fd66-48bd-9cb9-4c90dd5dd718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:54.473836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03024f83-fd66-48bd-9cb9-4c90dd5dd718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:54.474118 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03024f83-fd66-48bd-9cb9-4c90dd5dd718 admin admin] PATH_INFO: `/v3/projects/93c874b6a1fc489d891cfe39fb660da7/users/9f3b6bd808af405095445f007acd05c8/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:54.476160 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03024f83-fd66-48bd-9cb9-4c90dd5dd718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c874b6a1fc489d891cfe39fb660da7, user_id=9f3b6bd808af405095445f007acd05c8, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:54.478849 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03024f83-fd66-48bd-9cb9-4c90dd5dd718 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:54.490157 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1265/2572] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:39:54 2022] PUT /identity/v3/projects/93c874b6a1fc489d891cfe39fb660da7/users/9f3b6bd808af405095445f007acd05c8/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:54.500452 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125397df-091a-4b2a-8de5-4bf764d5d075 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:54.500812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125397df-091a-4b2a-8de5-4bf764d5d075 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:54.501142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125397df-091a-4b2a-8de5-4bf764d5d075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:54.529095 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-125397df-091a-4b2a-8de5-4bf764d5d075 None None] MFA Rules not processed for user `9f3b6bd808af405095445f007acd05c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:54.530386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-125397df-091a-4b2a-8de5-4bf764d5d075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:54.600131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1308/2573] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:54.611397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03024f83-fd66-48bd-9cb9-4c90dd5dd718 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:54.613138 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-03024f83-fd66-48bd-9cb9-4c90dd5dd718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:54.667128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03024f83-fd66-48bd-9cb9-4c90dd5dd718 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:54.670705 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0050bf-9675-4990-96bc-c2602be9acda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:54.671331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0050bf-9675-4990-96bc-c2602be9acda service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:54.671610 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0050bf-9675-4990-96bc-c2602be9acda service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:54.671885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0050bf-9675-4990-96bc-c2602be9acda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:54.680454 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0050bf-9675-4990-96bc-c2602be9acda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:54.681862 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0050bf-9675-4990-96bc-c2602be9acda service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:54.691187 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1266/2574] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:55.643888 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125397df-091a-4b2a-8de5-4bf764d5d075 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:55.706177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125397df-091a-4b2a-8de5-4bf764d5d075 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:55.711147 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:55.712039 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:55.712319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:55.712594 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] PATH_INFO: `/v3/users/6458b87fd522437aa4195cd4f0628356` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:55.713822 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6458b87fd522437aa4195cd4f0628356)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:55.715747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:55.914237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6458b87fd522437aa4195cd4f0628356'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:55.921293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6458b87fd522437aa4195cd4f0628356'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:56.015400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6458b87fd522437aa4195cd4f0628356'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:56.016136 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6458b87fd522437aa4195cd4f0628356'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:56.028841 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6458b87fd522437aa4195cd4f0628356'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:56.035407 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1309/2575] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:39:55 2022] DELETE /identity/v3/users/6458b87fd522437aa4195cd4f0628356 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:39:56.039662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d7fa8-e2d0-4a1e-82dc-906868c4a5fc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:56.040132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d7fa8-e2d0-4a1e-82dc-906868c4a5fc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:56.040291 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d7fa8-e2d0-4a1e-82dc-906868c4a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:56.060035 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e21d7fa8-e2d0-4a1e-82dc-906868c4a5fc None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:56.060243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e21d7fa8-e2d0-4a1e-82dc-906868c4a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:56.119952 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1267/2576] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:56.129822 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:56.132596 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:56.187951 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af5d14-7ee5-475a-8207-c7e9de65bc00 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:56.191765 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f730d7-7d79-4315-b731-2b08dae96883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:56.192412 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f730d7-7d79-4315-b731-2b08dae96883 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:56.192691 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f730d7-7d79-4315-b731-2b08dae96883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:56.192966 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f730d7-7d79-4315-b731-2b08dae96883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:56.202219 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f730d7-7d79-4315-b731-2b08dae96883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:56.203656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f730d7-7d79-4315-b731-2b08dae96883 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:56.213447 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1310/2577] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:56.685146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d7fa8-e2d0-4a1e-82dc-906868c4a5fc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:56.686575 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e21d7fa8-e2d0-4a1e-82dc-906868c4a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:56.700894 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d7fa8-e2d0-4a1e-82dc-906868c4a5fc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:56.705549 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:56.707669 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:56.708128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:56.708422 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] PATH_INFO: `/v3/projects/030a6fb99b88438ca8a13ed1be7f32aa` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:56.709724 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=030a6fb99b88438ca8a13ed1be7f32aa)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:56.711594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:56.815899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030a6fb99b88438ca8a13ed1be7f32aa', 'request_id': 'req-6731883b-4dda-437c-878a-95aa419d33bb'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:56.823312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030a6fb99b88438ca8a13ed1be7f32aa', 'request_id': 'req-6731883b-4dda-437c-878a-95aa419d33bb'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:56.900997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030a6fb99b88438ca8a13ed1be7f32aa', 'request_id': 'req-6731883b-4dda-437c-878a-95aa419d33bb'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:56.914711 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] The token cache is being invalidate because project 030a6fb99b88438ca8a13ed1be7f32aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:39:56.915091 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:56.915628 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:56.920113 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1268/2578] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:39:56 2022] DELETE /identity/v3/projects/030a6fb99b88438ca8a13ed1be7f32aa => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:56.921322 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f730d7-7d79-4315-b731-2b08dae96883 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:56.939108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f730d7-7d79-4315-b731-2b08dae96883 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:56.995093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a03e8d-3f14-42ae-ae99-d06983bcddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:56.996203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a03e8d-3f14-42ae-ae99-d06983bcddf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:56.996715 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a03e8d-3f14-42ae-ae99-d06983bcddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:56.997172 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a03e8d-3f14-42ae-ae99-d06983bcddf3 admin admin] PATH_INFO: `/v3/users/9f3b6bd808af405095445f007acd05c8` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:56.998453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a03e8d-3f14-42ae-ae99-d06983bcddf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3b6bd808af405095445f007acd05c8)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:57.000363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a03e8d-3f14-42ae-ae99-d06983bcddf3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:57.225823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-44a03e8d-3f14-42ae-ae99-d06983bcddf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3b6bd808af405095445f007acd05c8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:57.232991 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-44a03e8d-3f14-42ae-ae99-d06983bcddf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3b6bd808af405095445f007acd05c8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:57.323769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-44a03e8d-3f14-42ae-ae99-d06983bcddf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3b6bd808af405095445f007acd05c8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:57.325240 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-44a03e8d-3f14-42ae-ae99-d06983bcddf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3b6bd808af405095445f007acd05c8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:57.339905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-44a03e8d-3f14-42ae-ae99-d06983bcddf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3b6bd808af405095445f007acd05c8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:57.346034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1311/2579] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:39:56 2022] DELETE /identity/v3/users/9f3b6bd808af405095445f007acd05c8 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:39:57.804832 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:57.806637 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:57.824470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731883b-4dda-437c-878a-95aa419d33bb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:57.883025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d2629-23aa-46a4-ab59-7657bf3864dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:57.883917 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d2629-23aa-46a4-ab59-7657bf3864dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:57.884201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d2629-23aa-46a4-ab59-7657bf3864dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:57.884476 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d2629-23aa-46a4-ab59-7657bf3864dc admin admin] PATH_INFO: `/v3/projects/93c874b6a1fc489d891cfe39fb660da7` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:57.885673 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d2629-23aa-46a4-ab59-7657bf3864dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c874b6a1fc489d891cfe39fb660da7)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:57.887601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d2629-23aa-46a4-ab59-7657bf3864dc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:57.999147 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2a6d2629-23aa-46a4-ab59-7657bf3864dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c874b6a1fc489d891cfe39fb660da7', 'request_id': 'req-2a6d2629-23aa-46a4-ab59-7657bf3864dc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:58.006433 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2a6d2629-23aa-46a4-ab59-7657bf3864dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c874b6a1fc489d891cfe39fb660da7', 'request_id': 'req-2a6d2629-23aa-46a4-ab59-7657bf3864dc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:58.100112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2a6d2629-23aa-46a4-ab59-7657bf3864dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c874b6a1fc489d891cfe39fb660da7', 'request_id': 'req-2a6d2629-23aa-46a4-ab59-7657bf3864dc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:58.111898 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2a6d2629-23aa-46a4-ab59-7657bf3864dc admin admin] The token cache is being invalidate because project 93c874b6a1fc489d891cfe39fb660da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:39:58.116706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2a6d2629-23aa-46a4-ab59-7657bf3864dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:58.116706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2a6d2629-23aa-46a4-ab59-7657bf3864dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:39:58.116706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1269/2580] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:39:57 2022] DELETE /identity/v3/projects/93c874b6a1fc489d891cfe39fb660da7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:58.120919 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070d04-4385-4fd7-b176-7771e4df9162 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:58.121385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070d04-4385-4fd7-b176-7771e4df9162 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:58.121503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070d04-4385-4fd7-b176-7771e4df9162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:58.139531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-db070d04-4385-4fd7-b176-7771e4df9162 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:58.140710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-db070d04-4385-4fd7-b176-7771e4df9162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:58.197712 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1312/2581] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:58.205769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c42e3-7eec-4f79-8c2f-e395a48ebaaa None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:58.206062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c42e3-7eec-4f79-8c2f-e395a48ebaaa None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:58.206383 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c42e3-7eec-4f79-8c2f-e395a48ebaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:58.225282 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-367c42e3-7eec-4f79-8c2f-e395a48ebaaa None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:58.226477 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-367c42e3-7eec-4f79-8c2f-e395a48ebaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:58.234434 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1270/2582] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:58.238588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db070d04-4385-4fd7-b176-7771e4df9162 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:58.248271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db070d04-4385-4fd7-b176-7771e4df9162 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:58.253128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4c977-e4da-45cb-ac17-32f6e4f3e136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:58.254512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c977-e4da-45cb-ac17-32f6e4f3e136 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:58.254880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c977-e4da-45cb-ac17-32f6e4f3e136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:58.255163 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c977-e4da-45cb-ac17-32f6e4f3e136 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:58.255895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4c977-e4da-45cb-ac17-32f6e4f3e136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:39:58.256203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4c977-e4da-45cb-ac17-32f6e4f3e136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:58.257861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4c977-e4da-45cb-ac17-32f6e4f3e136 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:58.269847 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1313/2583] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:39:58.274219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c42e3-7eec-4f79-8c2f-e395a48ebaaa None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:58.283267 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c42e3-7eec-4f79-8c2f-e395a48ebaaa None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:58.287951 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606580da-3f73-4418-a0ac-04a22fa3b0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:58.288601 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606580da-3f73-4418-a0ac-04a22fa3b0db admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:58.288889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606580da-3f73-4418-a0ac-04a22fa3b0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:58.289168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606580da-3f73-4418-a0ac-04a22fa3b0db admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:58.289867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606580da-3f73-4418-a0ac-04a22fa3b0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:58.291797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606580da-3f73-4418-a0ac-04a22fa3b0db admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:58.381698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1271/2584] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:39:58 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:39:58.387515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4c977-e4da-45cb-ac17-32f6e4f3e136 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:58.397552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4c977-e4da-45cb-ac17-32f6e4f3e136 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:58.453654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a5f7f-f807-4bbf-a2b2-801ee015c148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:58.454417 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a5f7f-f807-4bbf-a2b2-801ee015c148 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:58.454709 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a5f7f-f807-4bbf-a2b2-801ee015c148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:58.454990 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a5f7f-f807-4bbf-a2b2-801ee015c148 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:58.455690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a5f7f-f807-4bbf-a2b2-801ee015c148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:58.457656 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a5f7f-f807-4bbf-a2b2-801ee015c148 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:58.570716 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1314/2585] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:39:58 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:39:58.574696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606580da-3f73-4418-a0ac-04a22fa3b0db admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:58.585010 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606580da-3f73-4418-a0ac-04a22fa3b0db admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:58.589497 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a75b6-9fc2-4dbf-b9c9-1a9007c088be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:58.590144 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a75b6-9fc2-4dbf-b9c9-1a9007c088be admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:58.590474 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a75b6-9fc2-4dbf-b9c9-1a9007c088be admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:58.590749 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a75b6-9fc2-4dbf-b9c9-1a9007c088be admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:58.591815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a75b6-9fc2-4dbf-b9c9-1a9007c088be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:58.593412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a75b6-9fc2-4dbf-b9c9-1a9007c088be admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:58.603764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1272/2586] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:39:58.607608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a5f7f-f807-4bbf-a2b2-801ee015c148 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:58.618262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a5f7f-f807-4bbf-a2b2-801ee015c148 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:58.623126 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e3f47-8246-43f4-bdcc-9ba4014383ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:58.623803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3f47-8246-43f4-bdcc-9ba4014383ca admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:58.624090 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3f47-8246-43f4-bdcc-9ba4014383ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:58.624378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3f47-8246-43f4-bdcc-9ba4014383ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:58.625110 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e3f47-8246-43f4-bdcc-9ba4014383ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:58.626735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e3f47-8246-43f4-bdcc-9ba4014383ca admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:58.637154 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1315/2587] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:39:58.648523 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a75b6-9fc2-4dbf-b9c9-1a9007c088be admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:58.658597 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a75b6-9fc2-4dbf-b9c9-1a9007c088be admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:58.663690 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78474dac-50c4-42f4-9713-66b319c6e26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:58.664573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78474dac-50c4-42f4-9713-66b319c6e26d admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:58.664773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78474dac-50c4-42f4-9713-66b319c6e26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:58.665110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78474dac-50c4-42f4-9713-66b319c6e26d admin admin] PATH_INFO: `/v3/projects/731471ab54d14a0587a2e2c3570e6101/users/31059430afd54d1991eba64caeac9ab8/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:58.669625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2c610-1f8e-4bad-89d0-665702e66485 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:58.669934 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2c610-1f8e-4bad-89d0-665702e66485 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:58.670220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2c610-1f8e-4bad-89d0-665702e66485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:58.680595 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78474dac-50c4-42f4-9713-66b319c6e26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=731471ab54d14a0587a2e2c3570e6101, user_id=31059430afd54d1991eba64caeac9ab8, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:58.683330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78474dac-50c4-42f4-9713-66b319c6e26d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:58.689894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-d7d2c610-1f8e-4bad-89d0-665702e66485 None None] MFA Rules not processed for user `6d5886d3fdab4730828183bd6204c6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:58.691798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d7d2c610-1f8e-4bad-89d0-665702e66485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:58.747346 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1316/2588] 10.222.0.44 () {58 vars in 967 bytes} [Thu May 5 15:39:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:39:58.773405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2c610-1f8e-4bad-89d0-665702e66485 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:58.775054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d7d2c610-1f8e-4bad-89d0-665702e66485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:58.777539 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1273/2589] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:39:58 2022] PUT /identity/v3/projects/731471ab54d14a0587a2e2c3570e6101/users/31059430afd54d1991eba64caeac9ab8/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:58.787950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48468dbb-667b-4551-bed8-40fabcea483d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:58.795176 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48468dbb-667b-4551-bed8-40fabcea483d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:58.795176 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48468dbb-667b-4551-bed8-40fabcea483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:58.816584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-48468dbb-667b-4551-bed8-40fabcea483d None None] MFA Rules not processed for user `31059430afd54d1991eba64caeac9ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:58.817949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-48468dbb-667b-4551-bed8-40fabcea483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:58.847929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2c610-1f8e-4bad-89d0-665702e66485 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:58.883344 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1274/2590] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:58.887855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48468dbb-667b-4551-bed8-40fabcea483d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:58.911518 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cdf54-8d3c-4a20-8b7e-fefc9d31b5fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e0b470f6b84df38565abf006dd8ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:58.912177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cdf54-8d3c-4a20-8b7e-fefc9d31b5fd service swift] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:58.912466 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cdf54-8d3c-4a20-8b7e-fefc9d31b5fd service swift] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:58.912744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cdf54-8d3c-4a20-8b7e-fefc9d31b5fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:58.957663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48468dbb-667b-4551-bed8-40fabcea483d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:58.962303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5a260-9063-47ac-bb57-1acc284f6f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:58.962981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a260-9063-47ac-bb57-1acc284f6f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:58.963261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a260-9063-47ac-bb57-1acc284f6f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:58.963536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a260-9063-47ac-bb57-1acc284f6f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:58.964222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5a260-9063-47ac-bb57-1acc284f6f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:58.966106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5a260-9063-47ac-bb57-1acc284f6f88 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:58.969081 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cdf54-8d3c-4a20-8b7e-fefc9d31b5fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:58.970964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cdf54-8d3c-4a20-8b7e-fefc9d31b5fd service swift] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:58.979968 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1317/2591] 10.222.0.44 () {60 vars in 1384 bytes} [Thu May 5 15:39:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:39:59.091225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1275/2592] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:39:58 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:39:59.095118 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cdf54-8d3c-4a20-8b7e-fefc9d31b5fd service swift] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:59.105949 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cdf54-8d3c-4a20-8b7e-fefc9d31b5fd service swift] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:59.168767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a092e-dfd8-4bf4-a692-d7fd6e98c2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:59.168767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a092e-dfd8-4bf4-a692-d7fd6e98c2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:59.168767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a092e-dfd8-4bf4-a692-d7fd6e98c2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:59.168767 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a092e-dfd8-4bf4-a692-d7fd6e98c2e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:59.170037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a092e-dfd8-4bf4-a692-d7fd6e98c2e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:59.170494 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a092e-dfd8-4bf4-a692-d7fd6e98c2e3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:59.273271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1318/2593] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:39:59 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:39:59.273862 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5a260-9063-47ac-bb57-1acc284f6f88 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:59.284231 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5a260-9063-47ac-bb57-1acc284f6f88 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:59.290009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36950539-1c64-4ed9-82c9-601ee9a06c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:59.290660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36950539-1c64-4ed9-82c9-601ee9a06c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:59.290950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36950539-1c64-4ed9-82c9-601ee9a06c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:59.291233 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36950539-1c64-4ed9-82c9-601ee9a06c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:59.291963 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36950539-1c64-4ed9-82c9-601ee9a06c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:59.293867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36950539-1c64-4ed9-82c9-601ee9a06c7e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:59.305717 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1276/2594] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:39:59.310093 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a092e-dfd8-4bf4-a692-d7fd6e98c2e3 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:59.321124 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a092e-dfd8-4bf4-a692-d7fd6e98c2e3 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:59.325797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea956f08-af6d-44df-be23-8ecd0f95e15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:59.326778 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea956f08-af6d-44df-be23-8ecd0f95e15d admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:59.327069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea956f08-af6d-44df-be23-8ecd0f95e15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:59.327343 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea956f08-af6d-44df-be23-8ecd0f95e15d admin admin] PATH_INFO: `/v3/projects/58b399bdb994419f8343d30bdf7e74b1/users/c1c07cbf10e04e998124b12b861fe794/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:59.341823 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea956f08-af6d-44df-be23-8ecd0f95e15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b399bdb994419f8343d30bdf7e74b1, user_id=c1c07cbf10e04e998124b12b861fe794, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:59.344489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea956f08-af6d-44df-be23-8ecd0f95e15d admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:59.459920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1319/2595] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:39:59 2022] PUT /identity/v3/projects/58b399bdb994419f8343d30bdf7e74b1/users/c1c07cbf10e04e998124b12b861fe794/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:59.460496 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36950539-1c64-4ed9-82c9-601ee9a06c7e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:59.471034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36950539-1c64-4ed9-82c9-601ee9a06c7e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:59.527738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5d4d6-5611-4029-a363-0f740e2b1253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:59.528406 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5d4d6-5611-4029-a363-0f740e2b1253 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:59.528686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5d4d6-5611-4029-a363-0f740e2b1253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:59.528962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5d4d6-5611-4029-a363-0f740e2b1253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:59.529675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5d4d6-5611-4029-a363-0f740e2b1253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:59.531313 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5d4d6-5611-4029-a363-0f740e2b1253 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:59.541695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1277/2596] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:39:59.545854 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea956f08-af6d-44df-be23-8ecd0f95e15d admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:59.557678 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea956f08-af6d-44df-be23-8ecd0f95e15d admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:59.562666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294933f-e4fa-400f-b8d9-5edbd997965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:59.563587 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294933f-e4fa-400f-b8d9-5edbd997965f admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:59.563873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294933f-e4fa-400f-b8d9-5edbd997965f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:59.564153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294933f-e4fa-400f-b8d9-5edbd997965f admin admin] PATH_INFO: `/v3/projects/58b399bdb994419f8343d30bdf7e74b1/users/c1c07cbf10e04e998124b12b861fe794/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:59.566266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294933f-e4fa-400f-b8d9-5edbd997965f admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b399bdb994419f8343d30bdf7e74b1, user_id=c1c07cbf10e04e998124b12b861fe794, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:59.569005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294933f-e4fa-400f-b8d9-5edbd997965f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:59.579082 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1320/2597] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:39:59 2022] PUT /identity/v3/projects/58b399bdb994419f8343d30bdf7e74b1/users/c1c07cbf10e04e998124b12b861fe794/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:39:59.589365 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d774b-df54-49d5-b1da-21160501ebad None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:59.589658 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d774b-df54-49d5-b1da-21160501ebad None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:59.589964 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d774b-df54-49d5-b1da-21160501ebad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:59.620104 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-be7d774b-df54-49d5-b1da-21160501ebad None None] MFA Rules not processed for user `c1c07cbf10e04e998124b12b861fe794`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:39:59.620104 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-be7d774b-df54-49d5-b1da-21160501ebad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:59.686960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1278/2598] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:39:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:39:59.698450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294933f-e4fa-400f-b8d9-5edbd997965f admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:59.700160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7294933f-e4fa-400f-b8d9-5edbd997965f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:39:59.758255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294933f-e4fa-400f-b8d9-5edbd997965f admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:59.763106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f792bba-405a-4b51-9401-5925f45a6a45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:59.764133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f792bba-405a-4b51-9401-5925f45a6a45 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:59.764133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f792bba-405a-4b51-9401-5925f45a6a45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:59.764360 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f792bba-405a-4b51-9401-5925f45a6a45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:39:59.774904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f792bba-405a-4b51-9401-5925f45a6a45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:39:59.776401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f792bba-405a-4b51-9401-5925f45a6a45 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:39:59.786410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1321/2599] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:39:59.974989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d774b-df54-49d5-b1da-21160501ebad None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:39:59.984467 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d774b-df54-49d5-b1da-21160501ebad None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:39:59.988274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821dabe-1b58-436d-91e3-f8364369c598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:39:59.988861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821dabe-1b58-436d-91e3-f8364369c598 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:39:59.989138 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821dabe-1b58-436d-91e3-f8364369c598 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:39:59.989411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821dabe-1b58-436d-91e3-f8364369c598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:00.045056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821dabe-1b58-436d-91e3-f8364369c598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:00.046537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821dabe-1b58-436d-91e3-f8364369c598 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:00.058827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1279/2600] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:39:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:00.732645 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f792bba-405a-4b51-9401-5925f45a6a45 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:00.795179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f792bba-405a-4b51-9401-5925f45a6a45 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:00.799862 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f7c80-7fc1-4485-a8d2-43820d40b27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:00.801242 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f7c80-7fc1-4485-a8d2-43820d40b27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:00.801546 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f7c80-7fc1-4485-a8d2-43820d40b27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:00.801826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f7c80-7fc1-4485-a8d2-43820d40b27c admin admin] PATH_INFO: `/v3/users/31059430afd54d1991eba64caeac9ab8` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:00.803249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f7c80-7fc1-4485-a8d2-43820d40b27c admin admin] RBAC: Authorizing `identity:delete_user(user_id=31059430afd54d1991eba64caeac9ab8)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:00.805181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f7c80-7fc1-4485-a8d2-43820d40b27c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:00.905354 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821dabe-1b58-436d-91e3-f8364369c598 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:00.906807 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c821dabe-1b58-436d-91e3-f8364369c598 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:00.920200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821dabe-1b58-436d-91e3-f8364369c598 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:00.924800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc76cd6-4333-4a9e-b664-25d6e501bfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:00.926424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76cd6-4333-4a9e-b664-25d6e501bfd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:00.926910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76cd6-4333-4a9e-b664-25d6e501bfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:00.927203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76cd6-4333-4a9e-b664-25d6e501bfd8 admin admin] PATH_INFO: `/v3/users/46328a5ae7494e89bca0077055fe4c0c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:00.928447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc76cd6-4333-4a9e-b664-25d6e501bfd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46328a5ae7494e89bca0077055fe4c0c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:00.930480 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc76cd6-4333-4a9e-b664-25d6e501bfd8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:01.004193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-009f7c80-7fc1-4485-a8d2-43820d40b27c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31059430afd54d1991eba64caeac9ab8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:01.010825 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-009f7c80-7fc1-4485-a8d2-43820d40b27c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31059430afd54d1991eba64caeac9ab8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:01.067063 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-009f7c80-7fc1-4485-a8d2-43820d40b27c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31059430afd54d1991eba64caeac9ab8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:01.067641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-009f7c80-7fc1-4485-a8d2-43820d40b27c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31059430afd54d1991eba64caeac9ab8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:01.080193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-009f7c80-7fc1-4485-a8d2-43820d40b27c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31059430afd54d1991eba64caeac9ab8'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:01.086199 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1322/2601] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:00 2022] DELETE /identity/v3/users/31059430afd54d1991eba64caeac9ab8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:01.090464 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a7b58-9928-4dd9-be08-c5b6d7c4d17f None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:01.090757 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a7b58-9928-4dd9-be08-c5b6d7c4d17f None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:01.091036 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a7b58-9928-4dd9-be08-c5b6d7c4d17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:01.110338 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-648a7b58-9928-4dd9-be08-c5b6d7c4d17f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:01.111551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-648a7b58-9928-4dd9-be08-c5b6d7c4d17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:01.114130 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-abc76cd6-4333-4a9e-b664-25d6e501bfd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46328a5ae7494e89bca0077055fe4c0c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:01.120566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-abc76cd6-4333-4a9e-b664-25d6e501bfd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46328a5ae7494e89bca0077055fe4c0c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:01.121242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-abc76cd6-4333-4a9e-b664-25d6e501bfd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46328a5ae7494e89bca0077055fe4c0c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:01.121864 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-abc76cd6-4333-4a9e-b664-25d6e501bfd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46328a5ae7494e89bca0077055fe4c0c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:01.134034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-abc76cd6-4333-4a9e-b664-25d6e501bfd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46328a5ae7494e89bca0077055fe4c0c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:01.171466 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1323/2602] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:01.181802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a7b58-9928-4dd9-be08-c5b6d7c4d17f None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:01.183153 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-648a7b58-9928-4dd9-be08-c5b6d7c4d17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:01.232661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1280/2603] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:00 2022] DELETE /identity/v3/users/46328a5ae7494e89bca0077055fe4c0c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:01.237038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650725ed-524c-4c81-925c-9d58df35ee7e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:01.237325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650725ed-524c-4c81-925c-9d58df35ee7e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:01.237599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650725ed-524c-4c81-925c-9d58df35ee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:01.238778 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a7b58-9928-4dd9-be08-c5b6d7c4d17f None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:01.255303 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-650725ed-524c-4c81-925c-9d58df35ee7e None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:01.256509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-650725ed-524c-4c81-925c-9d58df35ee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:01.286149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22459d49-d613-45a3-9ed0-2d526526c360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:01.286844 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22459d49-d613-45a3-9ed0-2d526526c360 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:01.287128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22459d49-d613-45a3-9ed0-2d526526c360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:01.287433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22459d49-d613-45a3-9ed0-2d526526c360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:01.316157 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1281/2604] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:01.325521 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650725ed-524c-4c81-925c-9d58df35ee7e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:01.334773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650725ed-524c-4c81-925c-9d58df35ee7e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:01.338352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0342075-b584-4f37-b220-57d593a870da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:01.338986 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0342075-b584-4f37-b220-57d593a870da service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:01.339267 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0342075-b584-4f37-b220-57d593a870da service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:01.339542 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0342075-b584-4f37-b220-57d593a870da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:01.346401 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22459d49-d613-45a3-9ed0-2d526526c360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:01.348919 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22459d49-d613-45a3-9ed0-2d526526c360 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:01.349055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0342075-b584-4f37-b220-57d593a870da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:01.350443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0342075-b584-4f37-b220-57d593a870da service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:01.358613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1324/2605] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:40:01.359796 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1282/2606] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:40:01.923595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22459d49-d613-45a3-9ed0-2d526526c360 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:01.925060 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-22459d49-d613-45a3-9ed0-2d526526c360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:01.939135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0342075-b584-4f37-b220-57d593a870da service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:01.940455 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22459d49-d613-45a3-9ed0-2d526526c360 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:01.942516 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f0342075-b584-4f37-b220-57d593a870da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:01.952336 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:01.953282 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:01.953956 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:01.954235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] PATH_INFO: `/v3/projects/731471ab54d14a0587a2e2c3570e6101` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:01.959553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=731471ab54d14a0587a2e2c3570e6101)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:01.959553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:01.960341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0342075-b584-4f37-b220-57d593a870da service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:01.965688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:01.966809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:01.967098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:01.967379 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] PATH_INFO: `/v3/projects/c9d70a132ec44eeeb83d1e019527470c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:01.968665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d70a132ec44eeeb83d1e019527470c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:01.970852 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:02.061523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731471ab54d14a0587a2e2c3570e6101', 'request_id': 'req-67c16396-e04e-4b3d-977f-27fc47d8bc37'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.067725 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731471ab54d14a0587a2e2c3570e6101', 'request_id': 'req-67c16396-e04e-4b3d-977f-27fc47d8bc37'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.089098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d70a132ec44eeeb83d1e019527470c', 'request_id': 'req-f96c2913-8694-43fa-a47b-e30669c760f6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.095262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d70a132ec44eeeb83d1e019527470c', 'request_id': 'req-f96c2913-8694-43fa-a47b-e30669c760f6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.135488 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731471ab54d14a0587a2e2c3570e6101', 'request_id': 'req-67c16396-e04e-4b3d-977f-27fc47d8bc37'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.147500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] The token cache is being invalidate because project 731471ab54d14a0587a2e2c3570e6101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:02.147797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.148604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.150245 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1325/2607] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:01 2022] DELETE /identity/v3/projects/731471ab54d14a0587a2e2c3570e6101 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:02.154098 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:02.155468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:02.216735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c16396-e04e-4b3d-977f-27fc47d8bc37 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:02.221149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d70a132ec44eeeb83d1e019527470c', 'request_id': 'req-f96c2913-8694-43fa-a47b-e30669c760f6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.232829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] The token cache is being invalidate because project c9d70a132ec44eeeb83d1e019527470c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:02.233258 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.234073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.235751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1283/2608] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:01 2022] DELETE /identity/v3/projects/c9d70a132ec44eeeb83d1e019527470c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:02.239845 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:02.241198 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:02.272178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:02.273060 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:02.273372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:02.273647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] PATH_INFO: `/v3/users/c1c07cbf10e04e998124b12b861fe794` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:02.275094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c07cbf10e04e998124b12b861fe794)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:02.277239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:02.309293 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c2913-8694-43fa-a47b-e30669c760f6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:02.314987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:02.315900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:02.316255 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:02.316591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] PATH_INFO: `/v3/users/d1cf9569a3e748efb0d7d02820f51193` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:02.317892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1cf9569a3e748efb0d7d02820f51193)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:02.319899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:02.480506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c07cbf10e04e998124b12b861fe794'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.487005 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c07cbf10e04e998124b12b861fe794'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.595341 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1cf9569a3e748efb0d7d02820f51193'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.602720 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1cf9569a3e748efb0d7d02820f51193'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.603382 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1cf9569a3e748efb0d7d02820f51193'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.604003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1cf9569a3e748efb0d7d02820f51193'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.615595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c07cbf10e04e998124b12b861fe794'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.616226 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c07cbf10e04e998124b12b861fe794'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.616495 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1cf9569a3e748efb0d7d02820f51193'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.628480 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c07cbf10e04e998124b12b861fe794'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:02.634999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1326/2609] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:02 2022] DELETE /identity/v3/users/c1c07cbf10e04e998124b12b861fe794 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:02.747015 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1284/2610] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:02 2022] DELETE /identity/v3/users/d1cf9569a3e748efb0d7d02820f51193 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:03.120376 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:03.121827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:03.149362 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:03.150910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:03.200373 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6788ca2-8242-42b8-92e5-3dba9ba34cf8 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:03.228694 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a97ce8-986f-4085-80d1-7a3551a2304f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:03.233380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:03.234239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.234548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.234824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f admin admin] PATH_INFO: `/v3/projects/12cc6fc6e26e47cd98d23ff28107fe59` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.236009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f admin admin] RBAC: Authorizing `identity:delete_project(project_id=12cc6fc6e26e47cd98d23ff28107fe59)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:03.237978 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:03.259130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5223b5-892e-48f7-a885-f8b03df6ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:03.260007 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5223b5-892e-48f7-a885-f8b03df6ace9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.260287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5223b5-892e-48f7-a885-f8b03df6ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.260561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5223b5-892e-48f7-a885-f8b03df6ace9 admin admin] PATH_INFO: `/v3/projects/58b399bdb994419f8343d30bdf7e74b1` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.261755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5223b5-892e-48f7-a885-f8b03df6ace9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b399bdb994419f8343d30bdf7e74b1)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:03.263691 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5223b5-892e-48f7-a885-f8b03df6ace9 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:03.375915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12cc6fc6e26e47cd98d23ff28107fe59', 'request_id': 'req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:03.383087 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12cc6fc6e26e47cd98d23ff28107fe59', 'request_id': 'req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:03.387308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-ac5223b5-892e-48f7-a885-f8b03df6ace9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b399bdb994419f8343d30bdf7e74b1', 'request_id': 'req-ac5223b5-892e-48f7-a885-f8b03df6ace9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:03.393433 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-ac5223b5-892e-48f7-a885-f8b03df6ace9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b399bdb994419f8343d30bdf7e74b1', 'request_id': 'req-ac5223b5-892e-48f7-a885-f8b03df6ace9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:03.461283 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12cc6fc6e26e47cd98d23ff28107fe59', 'request_id': 'req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:03.471977 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f admin admin] The token cache is being invalidate because project 12cc6fc6e26e47cd98d23ff28107fe59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:03.472330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:03.473037 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4f7ecab-ec11-4a72-bc49-4604bdf9e95f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:03.474671 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1285/2611] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:03 2022] DELETE /identity/v3/projects/12cc6fc6e26e47cd98d23ff28107fe59 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:03.479374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19e83c-8f96-4258-81dc-ef0cccacd891 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.479664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19e83c-8f96-4258-81dc-ef0cccacd891 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.479950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19e83c-8f96-4258-81dc-ef0cccacd891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.498043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3b19e83c-8f96-4258-81dc-ef0cccacd891 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:03.499296 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3b19e83c-8f96-4258-81dc-ef0cccacd891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:03.557899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1286/2612] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:03.567164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ad6b3-657e-4870-b248-4c0099db832a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.567457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ad6b3-657e-4870-b248-4c0099db832a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.567738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ad6b3-657e-4870-b248-4c0099db832a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.569863 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-ac5223b5-892e-48f7-a885-f8b03df6ace9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b399bdb994419f8343d30bdf7e74b1', 'request_id': 'req-ac5223b5-892e-48f7-a885-f8b03df6ace9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:03.581028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-ac5223b5-892e-48f7-a885-f8b03df6ace9 admin admin] The token cache is being invalidate because project 58b399bdb994419f8343d30bdf7e74b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:03.581316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-ac5223b5-892e-48f7-a885-f8b03df6ace9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:03.582564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-ac5223b5-892e-48f7-a885-f8b03df6ace9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:03.587025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-568ad6b3-657e-4870-b248-4c0099db832a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:03.587421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1327/2613] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:03 2022] DELETE /identity/v3/projects/58b399bdb994419f8343d30bdf7e74b1 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:03.588300 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-568ad6b3-657e-4870-b248-4c0099db832a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:03.588776 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf653e7d-59a9-4d9b-9bd2-2d7517f8c5cc None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.589137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf653e7d-59a9-4d9b-9bd2-2d7517f8c5cc None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.589340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf653e7d-59a9-4d9b-9bd2-2d7517f8c5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.596589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1287/2614] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:03.600684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ad6b3-657e-4870-b248-4c0099db832a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:03.609746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ad6b3-657e-4870-b248-4c0099db832a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:03.611726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-bf653e7d-59a9-4d9b-9bd2-2d7517f8c5cc None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:03.614053 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-bf653e7d-59a9-4d9b-9bd2-2d7517f8c5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:03.615113 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb96b4-39d1-4ed3-8860-09ab0f739575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:03.615767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb96b4-39d1-4ed3-8860-09ab0f739575 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.616053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb96b4-39d1-4ed3-8860-09ab0f739575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.616363 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb96b4-39d1-4ed3-8860-09ab0f739575 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.617085 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb96b4-39d1-4ed3-8860-09ab0f739575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:40:03.617396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb96b4-39d1-4ed3-8860-09ab0f739575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:03.619038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb96b4-39d1-4ed3-8860-09ab0f739575 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:03.622228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1328/2615] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:03.631958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1288/2616] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:40:03.632329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689fb42-5fd1-4cfe-a4a9-1e3a9cea379c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.632604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689fb42-5fd1-4cfe-a4a9-1e3a9cea379c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.632889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689fb42-5fd1-4cfe-a4a9-1e3a9cea379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.635878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb96b4-39d1-4ed3-8860-09ab0f739575 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:03.645622 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb96b4-39d1-4ed3-8860-09ab0f739575 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:03.650378 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bff6f5-51ab-4174-977d-9bc9f4664cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:03.651022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bff6f5-51ab-4174-977d-9bc9f4664cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.651308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bff6f5-51ab-4174-977d-9bc9f4664cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.651581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b689fb42-5fd1-4cfe-a4a9-1e3a9cea379c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:03.651684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bff6f5-51ab-4174-977d-9bc9f4664cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.652264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bff6f5-51ab-4174-977d-9bc9f4664cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:03.652778 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b689fb42-5fd1-4cfe-a4a9-1e3a9cea379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:03.654172 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bff6f5-51ab-4174-977d-9bc9f4664cb5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:03.660878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1329/2617] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:03.665169 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689fb42-5fd1-4cfe-a4a9-1e3a9cea379c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:03.673878 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689fb42-5fd1-4cfe-a4a9-1e3a9cea379c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:03.679385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56216-cc41-4a46-a42c-7394c328d300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:03.680027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56216-cc41-4a46-a42c-7394c328d300 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.680307 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56216-cc41-4a46-a42c-7394c328d300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.680582 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56216-cc41-4a46-a42c-7394c328d300 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.681300 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e56216-cc41-4a46-a42c-7394c328d300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:40:03.681605 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e56216-cc41-4a46-a42c-7394c328d300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:03.683271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e56216-cc41-4a46-a42c-7394c328d300 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:03.695425 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1330/2618] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:40:03.699552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56216-cc41-4a46-a42c-7394c328d300 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:03.709084 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56216-cc41-4a46-a42c-7394c328d300 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:03.713704 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c971c9-65b1-46ba-8045-c04fd7662ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:03.716421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c971c9-65b1-46ba-8045-c04fd7662ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.716421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c971c9-65b1-46ba-8045-c04fd7662ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.716421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c971c9-65b1-46ba-8045-c04fd7662ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.716421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c971c9-65b1-46ba-8045-c04fd7662ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:03.717486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c971c9-65b1-46ba-8045-c04fd7662ac2 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:03.743374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1289/2619] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:03 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:40:03.747244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bff6f5-51ab-4174-977d-9bc9f4664cb5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:03.807282 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bff6f5-51ab-4174-977d-9bc9f4664cb5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:03.812183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728a6f0-58a7-465b-b1fe-64c7644033a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:03.812836 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728a6f0-58a7-465b-b1fe-64c7644033a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.813119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728a6f0-58a7-465b-b1fe-64c7644033a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.813393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728a6f0-58a7-465b-b1fe-64c7644033a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.814072 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728a6f0-58a7-465b-b1fe-64c7644033a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:03.816660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728a6f0-58a7-465b-b1fe-64c7644033a3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:03.823347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1331/2620] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:03 2022] POST /identity/v3/projects => generated 359 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:03.827310 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c971c9-65b1-46ba-8045-c04fd7662ac2 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:03.885669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c971c9-65b1-46ba-8045-c04fd7662ac2 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:03.890239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7da72-cba6-459d-bbdc-a991f7a78359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:03.890937 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7da72-cba6-459d-bbdc-a991f7a78359 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.894481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7da72-cba6-459d-bbdc-a991f7a78359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.894481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7da72-cba6-459d-bbdc-a991f7a78359 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.894481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7da72-cba6-459d-bbdc-a991f7a78359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:03.894481 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7da72-cba6-459d-bbdc-a991f7a78359 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:03.918569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1290/2621] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:03 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:03.922590 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728a6f0-58a7-465b-b1fe-64c7644033a3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:03.932712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728a6f0-58a7-465b-b1fe-64c7644033a3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:03.937827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0980675-5d72-41d0-ac38-5970b38b1d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:03.938531 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0980675-5d72-41d0-ac38-5970b38b1d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.938817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0980675-5d72-41d0-ac38-5970b38b1d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.943204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0980675-5d72-41d0-ac38-5970b38b1d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.943204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0980675-5d72-41d0-ac38-5970b38b1d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:03.943204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0980675-5d72-41d0-ac38-5970b38b1d61 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:03.952055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1291/2622] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:03.955875 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0980675-5d72-41d0-ac38-5970b38b1d61 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:03.965292 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0980675-5d72-41d0-ac38-5970b38b1d61 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:03.969990 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf6e1d-554b-478d-a3fe-f0b46577ca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:03.970639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf6e1d-554b-478d-a3fe-f0b46577ca50 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:03.970923 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf6e1d-554b-478d-a3fe-f0b46577ca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:03.971206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf6e1d-554b-478d-a3fe-f0b46577ca50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:03.971896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf6e1d-554b-478d-a3fe-f0b46577ca50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:03.974210 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf6e1d-554b-478d-a3fe-f0b46577ca50 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:03.984413 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1292/2623] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:03.989128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf6e1d-554b-478d-a3fe-f0b46577ca50 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:03.998462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf6e1d-554b-478d-a3fe-f0b46577ca50 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:04.003061 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1332/2624] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:03 2022] POST /identity/v3/users => generated 280 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:40:04.006308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d76dc2-1c48-4902-a367-5dea8c061ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:04.006308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d76dc2-1c48-4902-a367-5dea8c061ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.006308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d76dc2-1c48-4902-a367-5dea8c061ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.006308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d76dc2-1c48-4902-a367-5dea8c061ea2 admin admin] PATH_INFO: `/v3/projects/2f712ca164cf4a70b680bda615fbd469/users/e2f284304072449ab2b5e71437458928/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.009295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7da72-cba6-459d-bbdc-a991f7a78359 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:04.019233 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7da72-cba6-459d-bbdc-a991f7a78359 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:04.020465 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d76dc2-1c48-4902-a367-5dea8c061ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f712ca164cf4a70b680bda615fbd469, user_id=e2f284304072449ab2b5e71437458928, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:04.023156 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d76dc2-1c48-4902-a367-5dea8c061ea2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:04.023952 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f37439-14c4-4618-97b0-6738047a292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:04.024609 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f37439-14c4-4618-97b0-6738047a292d admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.024899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f37439-14c4-4618-97b0-6738047a292d admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.025180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f37439-14c4-4618-97b0-6738047a292d admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.025904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f37439-14c4-4618-97b0-6738047a292d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:04.027506 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f37439-14c4-4618-97b0-6738047a292d admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:04.037827 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1333/2625] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:04.041580 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f37439-14c4-4618-97b0-6738047a292d admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:04.051770 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f37439-14c4-4618-97b0-6738047a292d admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:04.056462 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431d35c-5e29-4b69-881d-9534b6c17188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:04.057090 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431d35c-5e29-4b69-881d-9534b6c17188 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.057384 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431d35c-5e29-4b69-881d-9534b6c17188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.057690 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431d35c-5e29-4b69-881d-9534b6c17188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.058448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431d35c-5e29-4b69-881d-9534b6c17188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:04.065376 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431d35c-5e29-4b69-881d-9534b6c17188 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:04.070468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1334/2626] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:04.074435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431d35c-5e29-4b69-881d-9534b6c17188 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:04.083648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431d35c-5e29-4b69-881d-9534b6c17188 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:04.088301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2198797-c37c-4912-90cb-ebe34dec4f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:04.089145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2198797-c37c-4912-90cb-ebe34dec4f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.089432 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2198797-c37c-4912-90cb-ebe34dec4f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.089711 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2198797-c37c-4912-90cb-ebe34dec4f4c admin admin] PATH_INFO: `/v3/projects/5fca4ba244fc415e95e3ecac30e9b5a0/users/132624108b4646ce8eb139e911623cae/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.104209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2198797-c37c-4912-90cb-ebe34dec4f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fca4ba244fc415e95e3ecac30e9b5a0, user_id=132624108b4646ce8eb139e911623cae, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:04.106905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2198797-c37c-4912-90cb-ebe34dec4f4c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:04.122903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1293/2627] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:03 2022] PUT /identity/v3/projects/2f712ca164cf4a70b680bda615fbd469/users/e2f284304072449ab2b5e71437458928/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:04.134213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4218-b415-40ec-b443-488a95c845ce None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.134613 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4218-b415-40ec-b443-488a95c845ce None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.134902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4218-b415-40ec-b443-488a95c845ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.160615 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b2ee4218-b415-40ec-b443-488a95c845ce None None] MFA Rules not processed for user `e2f284304072449ab2b5e71437458928`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:04.161643 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b2ee4218-b415-40ec-b443-488a95c845ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:04.204147 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1335/2628] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:04 2022] PUT /identity/v3/projects/5fca4ba244fc415e95e3ecac30e9b5a0/users/132624108b4646ce8eb139e911623cae/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:04.214394 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10bcb-d6bc-4f64-9db2-d05836ad279b None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.214692 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10bcb-d6bc-4f64-9db2-d05836ad279b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.214980 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10bcb-d6bc-4f64-9db2-d05836ad279b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.227438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1294/2629] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:04.233017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee4218-b415-40ec-b443-488a95c845ce None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:04.244570 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-4ea10bcb-d6bc-4f64-9db2-d05836ad279b None None] MFA Rules not processed for user `132624108b4646ce8eb139e911623cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:04.245782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4ea10bcb-d6bc-4f64-9db2-d05836ad279b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:04.295179 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee4218-b415-40ec-b443-488a95c845ce None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:04.314059 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1336/2630] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:04.347029 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10bcb-d6bc-4f64-9db2-d05836ad279b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:04.349409 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4ea10bcb-d6bc-4f64-9db2-d05836ad279b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:04.357141 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbda2d1-0528-45d1-8cfa-6ce887b8ba04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:04.357812 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbda2d1-0528-45d1-8cfa-6ce887b8ba04 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.358090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbda2d1-0528-45d1-8cfa-6ce887b8ba04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.358444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbda2d1-0528-45d1-8cfa-6ce887b8ba04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.359131 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbda2d1-0528-45d1-8cfa-6ce887b8ba04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:04.361025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbda2d1-0528-45d1-8cfa-6ce887b8ba04 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:04.405974 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10bcb-d6bc-4f64-9db2-d05836ad279b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:04.410312 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdfd8c-1321-4b14-8766-618f391adc58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:04.411148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdfd8c-1321-4b14-8766-618f391adc58 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.411379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdfd8c-1321-4b14-8766-618f391adc58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.411654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdfd8c-1321-4b14-8766-618f391adc58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.419868 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdfd8c-1321-4b14-8766-618f391adc58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:04.421287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdfd8c-1321-4b14-8766-618f391adc58 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:04.430014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1337/2631] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:04 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:04.444400 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdfd8c-1321-4b14-8766-618f391adc58 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:04.454846 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdfd8c-1321-4b14-8766-618f391adc58 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:04.460206 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df46864-a3fb-4adf-a90e-7e7987711dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:04.461192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df46864-a3fb-4adf-a90e-7e7987711dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.461485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df46864-a3fb-4adf-a90e-7e7987711dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.461771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df46864-a3fb-4adf-a90e-7e7987711dbc admin admin] PATH_INFO: `/v3/users/132624108b4646ce8eb139e911623cae` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.463078 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df46864-a3fb-4adf-a90e-7e7987711dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=132624108b4646ce8eb139e911623cae)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:04.463364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1295/2632] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:04 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:04.465260 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df46864-a3fb-4adf-a90e-7e7987711dbc admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:04.467287 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbda2d1-0528-45d1-8cfa-6ce887b8ba04 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:04.530936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbda2d1-0528-45d1-8cfa-6ce887b8ba04 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:04.536446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09037c0c-f17e-48c1-9428-93d5c3613ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:04.537167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09037c0c-f17e-48c1-9428-93d5c3613ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.537454 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09037c0c-f17e-48c1-9428-93d5c3613ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.537737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09037c0c-f17e-48c1-9428-93d5c3613ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.538459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09037c0c-f17e-48c1-9428-93d5c3613ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:04.540395 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09037c0c-f17e-48c1-9428-93d5c3613ee0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:04.695740 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1296/2633] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:04 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:04.699375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09037c0c-f17e-48c1-9428-93d5c3613ee0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:04.709319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09037c0c-f17e-48c1-9428-93d5c3613ee0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:04.713905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb613a-fbb9-4ffb-b322-0590b1671d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:04.714566 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb613a-fbb9-4ffb-b322-0590b1671d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.714856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb613a-fbb9-4ffb-b322-0590b1671d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.715139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb613a-fbb9-4ffb-b322-0590b1671d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.715865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb613a-fbb9-4ffb-b322-0590b1671d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:04.717454 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb613a-fbb9-4ffb-b322-0590b1671d31 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:04.727903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1297/2634] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:04.731797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb613a-fbb9-4ffb-b322-0590b1671d31 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:04.735771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5df46864-a3fb-4adf-a90e-7e7987711dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132624108b4646ce8eb139e911623cae'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:04.741401 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb613a-fbb9-4ffb-b322-0590b1671d31 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:04.742930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5df46864-a3fb-4adf-a90e-7e7987711dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132624108b4646ce8eb139e911623cae'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:04.746164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd36f1-7088-4596-859b-22944dccf0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:04.747066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd36f1-7088-4596-859b-22944dccf0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.747351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd36f1-7088-4596-859b-22944dccf0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.747629 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd36f1-7088-4596-859b-22944dccf0f8 admin admin] PATH_INFO: `/v3/projects/5fb3f23f18f642d5ada8705945f44dcc/users/f9226bb5459f4e949ce6f08f0a0369b1/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.765083 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd36f1-7088-4596-859b-22944dccf0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb3f23f18f642d5ada8705945f44dcc, user_id=f9226bb5459f4e949ce6f08f0a0369b1, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:04.767800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd36f1-7088-4596-859b-22944dccf0f8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:04.849647 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5df46864-a3fb-4adf-a90e-7e7987711dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132624108b4646ce8eb139e911623cae'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:04.850265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5df46864-a3fb-4adf-a90e-7e7987711dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132624108b4646ce8eb139e911623cae'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:04.862450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-5df46864-a3fb-4adf-a90e-7e7987711dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132624108b4646ce8eb139e911623cae'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:04.868429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1338/2635] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:04 2022] DELETE /identity/v3/users/132624108b4646ce8eb139e911623cae => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:04.872685 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0f58e-1178-4213-bc98-3b2ccf78d9fb None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.872979 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0f58e-1178-4213-bc98-3b2ccf78d9fb None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.873264 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0f58e-1178-4213-bc98-3b2ccf78d9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.879378 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1298/2636] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:04 2022] PUT /identity/v3/projects/5fb3f23f18f642d5ada8705945f44dcc/users/f9226bb5459f4e949ce6f08f0a0369b1/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:04.883331 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd36f1-7088-4596-859b-22944dccf0f8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:04.884985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-42cd36f1-7088-4596-859b-22944dccf0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:04.891768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-ced0f58e-1178-4213-bc98-3b2ccf78d9fb None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:04.892959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ced0f58e-1178-4213-bc98-3b2ccf78d9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:04.950196 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd36f1-7088-4596-859b-22944dccf0f8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:04.951566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1339/2637] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:04.955535 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aea04-523a-49a7-ba0a-c2b18dc3299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:04.955750 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aea04-523a-49a7-ba0a-c2b18dc3299e admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.955988 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aea04-523a-49a7-ba0a-c2b18dc3299e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.956272 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aea04-523a-49a7-ba0a-c2b18dc3299e admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.958229 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066aea04-523a-49a7-ba0a-c2b18dc3299e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:04.959871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066aea04-523a-49a7-ba0a-c2b18dc3299e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:04.961876 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0f58e-1178-4213-bc98-3b2ccf78d9fb None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:04.963343 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ced0f58e-1178-4213-bc98-3b2ccf78d9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:04.970385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1299/2638] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:04.974274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aea04-523a-49a7-ba0a-c2b18dc3299e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:04.984034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aea04-523a-49a7-ba0a-c2b18dc3299e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:04.988849 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a321fb-27bd-4a4a-a9d6-e6416ee12bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:04.989742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a321fb-27bd-4a4a-a9d6-e6416ee12bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:04.990034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a321fb-27bd-4a4a-a9d6-e6416ee12bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:04.990352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a321fb-27bd-4a4a-a9d6-e6416ee12bcc admin admin] PATH_INFO: `/v3/projects/5fb3f23f18f642d5ada8705945f44dcc/users/f9226bb5459f4e949ce6f08f0a0369b1/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:04.992332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a321fb-27bd-4a4a-a9d6-e6416ee12bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb3f23f18f642d5ada8705945f44dcc, user_id=f9226bb5459f4e949ce6f08f0a0369b1, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:04.995036 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a321fb-27bd-4a4a-a9d6-e6416ee12bcc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:05.005895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1300/2639] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:04 2022] PUT /identity/v3/projects/5fb3f23f18f642d5ada8705945f44dcc/users/f9226bb5459f4e949ce6f08f0a0369b1/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:05.015972 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6115c1-e2ec-424f-9900-fb868c86d7c6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:05.016265 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6115c1-e2ec-424f-9900-fb868c86d7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:05.016626 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6115c1-e2ec-424f-9900-fb868c86d7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:05.021849 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0f58e-1178-4213-bc98-3b2ccf78d9fb None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:05.043038 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1e6115c1-e2ec-424f-9900-fb868c86d7c6 None None] MFA Rules not processed for user `f9226bb5459f4e949ce6f08f0a0369b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:05.044284 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1e6115c1-e2ec-424f-9900-fb868c86d7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:05.068632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7108590-51a3-4e43-94cf-e131cb4c6bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:05.073739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7108590-51a3-4e43-94cf-e131cb4c6bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:05.073739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7108590-51a3-4e43-94cf-e131cb4c6bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:05.073739 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7108590-51a3-4e43-94cf-e131cb4c6bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:05.122985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1301/2640] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:05.138777 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6115c1-e2ec-424f-9900-fb868c86d7c6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:05.140505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1e6115c1-e2ec-424f-9900-fb868c86d7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:05.146634 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7108590-51a3-4e43-94cf-e131cb4c6bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:05.148066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7108590-51a3-4e43-94cf-e131cb4c6bc6 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:05.157616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1340/2641] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:40:05.199261 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6115c1-e2ec-424f-9900-fb868c86d7c6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:05.202956 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32cf0-f4c7-470e-9c08-83264e101393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:05.203551 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32cf0-f4c7-470e-9c08-83264e101393 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:05.203837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32cf0-f4c7-470e-9c08-83264e101393 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:05.204120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32cf0-f4c7-470e-9c08-83264e101393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:05.214672 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b32cf0-f4c7-470e-9c08-83264e101393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:05.216150 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b32cf0-f4c7-470e-9c08-83264e101393 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:05.227024 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1302/2642] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:40:05.650083 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7108590-51a3-4e43-94cf-e131cb4c6bc6 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:05.651568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-f7108590-51a3-4e43-94cf-e131cb4c6bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:05.672306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7108590-51a3-4e43-94cf-e131cb4c6bc6 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:05.677758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16a2a6-6c5f-4826-a82f-a20543f84c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:05.678728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16a2a6-6c5f-4826-a82f-a20543f84c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:05.679152 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16a2a6-6c5f-4826-a82f-a20543f84c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:05.679331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16a2a6-6c5f-4826-a82f-a20543f84c4f admin admin] PATH_INFO: `/v3/projects/5fca4ba244fc415e95e3ecac30e9b5a0` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:05.680521 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16a2a6-6c5f-4826-a82f-a20543f84c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fca4ba244fc415e95e3ecac30e9b5a0)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:05.682551 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16a2a6-6c5f-4826-a82f-a20543f84c4f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:05.791393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32cf0-f4c7-470e-9c08-83264e101393 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:05.802369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32cf0-f4c7-470e-9c08-83264e101393 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:05.807511 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e03351-7de5-437a-8c20-b774e91f068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:05.813202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03351-7de5-437a-8c20-b774e91f068a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:05.813202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03351-7de5-437a-8c20-b774e91f068a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:05.813202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03351-7de5-437a-8c20-b774e91f068a admin admin] PATH_INFO: `/v3/users/e2f284304072449ab2b5e71437458928` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:05.813202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e03351-7de5-437a-8c20-b774e91f068a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2f284304072449ab2b5e71437458928)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:05.813202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e03351-7de5-437a-8c20-b774e91f068a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:05.821901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-af16a2a6-6c5f-4826-a82f-a20543f84c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fca4ba244fc415e95e3ecac30e9b5a0', 'request_id': 'req-af16a2a6-6c5f-4826-a82f-a20543f84c4f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:05.828002 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-af16a2a6-6c5f-4826-a82f-a20543f84c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fca4ba244fc415e95e3ecac30e9b5a0', 'request_id': 'req-af16a2a6-6c5f-4826-a82f-a20543f84c4f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:05.929561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-af16a2a6-6c5f-4826-a82f-a20543f84c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fca4ba244fc415e95e3ecac30e9b5a0', 'request_id': 'req-af16a2a6-6c5f-4826-a82f-a20543f84c4f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:05.940581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-af16a2a6-6c5f-4826-a82f-a20543f84c4f admin admin] The token cache is being invalidate because project 5fca4ba244fc415e95e3ecac30e9b5a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:05.940875 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-af16a2a6-6c5f-4826-a82f-a20543f84c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:05.941675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-af16a2a6-6c5f-4826-a82f-a20543f84c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:05.943248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1341/2643] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:05 2022] DELETE /identity/v3/projects/5fca4ba244fc415e95e3ecac30e9b5a0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:05.948112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3cf3-020d-4ea1-b252-cbe068bb2ff4 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:05.948403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3cf3-020d-4ea1-b252-cbe068bb2ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:05.948718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3cf3-020d-4ea1-b252-cbe068bb2ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:05.967141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-c9ca3cf3-020d-4ea1-b252-cbe068bb2ff4 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:05.968312 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c9ca3cf3-020d-4ea1-b252-cbe068bb2ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:06.021982 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c0e03351-7de5-437a-8c20-b774e91f068a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2f284304072449ab2b5e71437458928'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:06.027943 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1342/2644] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:06.029188 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c0e03351-7de5-437a-8c20-b774e91f068a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2f284304072449ab2b5e71437458928'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:06.029857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c0e03351-7de5-437a-8c20-b774e91f068a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2f284304072449ab2b5e71437458928'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:06.030491 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c0e03351-7de5-437a-8c20-b774e91f068a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2f284304072449ab2b5e71437458928'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:06.036964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82590f-705f-4af9-8371-10b55c92d91d None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:06.037260 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82590f-705f-4af9-8371-10b55c92d91d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:06.041040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82590f-705f-4af9-8371-10b55c92d91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:06.043311 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c0e03351-7de5-437a-8c20-b774e91f068a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2f284304072449ab2b5e71437458928'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:06.055235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-bc82590f-705f-4af9-8371-10b55c92d91d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:06.056426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-bc82590f-705f-4af9-8371-10b55c92d91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:06.064489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1343/2645] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:06.069024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82590f-705f-4af9-8371-10b55c92d91d None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:06.077471 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82590f-705f-4af9-8371-10b55c92d91d None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:06.082589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37628c83-dcdb-4ace-91eb-a374be509048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:06.083299 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37628c83-dcdb-4ace-91eb-a374be509048 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:06.083564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37628c83-dcdb-4ace-91eb-a374be509048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:06.083836 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37628c83-dcdb-4ace-91eb-a374be509048 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:06.084569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37628c83-dcdb-4ace-91eb-a374be509048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:40:06.084874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37628c83-dcdb-4ace-91eb-a374be509048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:06.086474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37628c83-dcdb-4ace-91eb-a374be509048 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:06.097592 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1344/2646] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:40:06.101810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37628c83-dcdb-4ace-91eb-a374be509048 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:06.111185 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37628c83-dcdb-4ace-91eb-a374be509048 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:06.116256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7430022-e1da-4e7f-9721-13f0f35ded26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:06.116933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7430022-e1da-4e7f-9721-13f0f35ded26 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:06.117212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7430022-e1da-4e7f-9721-13f0f35ded26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:06.117587 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7430022-e1da-4e7f-9721-13f0f35ded26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:06.118253 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7430022-e1da-4e7f-9721-13f0f35ded26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:06.120109 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7430022-e1da-4e7f-9721-13f0f35ded26 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:06.136481 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1303/2647] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:05 2022] DELETE /identity/v3/users/e2f284304072449ab2b5e71437458928 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:06.140750 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a655d-42d7-4320-a986-4c8d8e262a0b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:06.141067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a655d-42d7-4320-a986-4c8d8e262a0b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:06.141353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a655d-42d7-4320-a986-4c8d8e262a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:06.158576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-726a655d-42d7-4320-a986-4c8d8e262a0b None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:06.159800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-726a655d-42d7-4320-a986-4c8d8e262a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:06.215425 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1345/2648] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:06 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:06.219034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1304/2649] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:06.219486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7430022-e1da-4e7f-9721-13f0f35ded26 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:06.233209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a655d-42d7-4320-a986-4c8d8e262a0b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:06.234594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-726a655d-42d7-4320-a986-4c8d8e262a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:06.280686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7430022-e1da-4e7f-9721-13f0f35ded26 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:06.285851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2aae4-f5d6-4b4e-b4f4-c15d8108545d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:06.286633 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2aae4-f5d6-4b4e-b4f4-c15d8108545d admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:06.286915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2aae4-f5d6-4b4e-b4f4-c15d8108545d admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:06.287193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2aae4-f5d6-4b4e-b4f4-c15d8108545d admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:06.287882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2aae4-f5d6-4b4e-b4f4-c15d8108545d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:06.290050 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2aae4-f5d6-4b4e-b4f4-c15d8108545d admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:06.291188 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a655d-42d7-4320-a986-4c8d8e262a0b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:06.338512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44e9b-3a29-46e5-9311-a3aff057c49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:06.339162 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44e9b-3a29-46e5-9311-a3aff057c49a service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:06.339445 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44e9b-3a29-46e5-9311-a3aff057c49a service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:06.339738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44e9b-3a29-46e5-9311-a3aff057c49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:06.349202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44e9b-3a29-46e5-9311-a3aff057c49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:06.350662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44e9b-3a29-46e5-9311-a3aff057c49a service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:06.360113 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1305/2650] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:40:06.415404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1346/2651] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:06 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:06.419460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44e9b-3a29-46e5-9311-a3aff057c49a service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:06.429809 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44e9b-3a29-46e5-9311-a3aff057c49a service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:06.434548 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d627ba-e440-4e19-8c16-36705730490c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:06.435458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d627ba-e440-4e19-8c16-36705730490c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:06.435737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d627ba-e440-4e19-8c16-36705730490c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:06.436010 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d627ba-e440-4e19-8c16-36705730490c admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:06.436748 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d627ba-e440-4e19-8c16-36705730490c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:06.438478 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d627ba-e440-4e19-8c16-36705730490c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:06.452101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1306/2652] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:06.453333 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2aae4-f5d6-4b4e-b4f4-c15d8108545d admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:06.463348 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2aae4-f5d6-4b4e-b4f4-c15d8108545d admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:06.468131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdca14-3f65-47fd-8827-e4e217df8512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:06.468792 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdca14-3f65-47fd-8827-e4e217df8512 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:06.469100 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdca14-3f65-47fd-8827-e4e217df8512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:06.469379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdca14-3f65-47fd-8827-e4e217df8512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:06.470106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acdca14-3f65-47fd-8827-e4e217df8512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:06.471774 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acdca14-3f65-47fd-8827-e4e217df8512 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:06.482476 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1347/2653] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:40:06.486433 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d627ba-e440-4e19-8c16-36705730490c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:06.497026 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d627ba-e440-4e19-8c16-36705730490c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:06.501636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805373d-b526-4849-b61f-d38bb6779b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:06.502536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805373d-b526-4849-b61f-d38bb6779b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:06.502819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805373d-b526-4849-b61f-d38bb6779b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:06.509150 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805373d-b526-4849-b61f-d38bb6779b80 admin admin] PATH_INFO: `/v3/projects/74f3fb6ef54042ce8e4de1c6fd3ff54c/users/c2e882fa185247da8eb48153f0361679/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:06.517687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805373d-b526-4849-b61f-d38bb6779b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f3fb6ef54042ce8e4de1c6fd3ff54c, user_id=c2e882fa185247da8eb48153f0361679, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:06.520426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805373d-b526-4849-b61f-d38bb6779b80 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:06.638402 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1307/2654] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:06 2022] PUT /identity/v3/projects/74f3fb6ef54042ce8e4de1c6fd3ff54c/users/c2e882fa185247da8eb48153f0361679/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:06.650274 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d7c8b-1ab7-48c6-8b21-96a600416a3d None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:06.650812 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d7c8b-1ab7-48c6-8b21-96a600416a3d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:06.650933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d7c8b-1ab7-48c6-8b21-96a600416a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:06.677932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-8f6d7c8b-1ab7-48c6-8b21-96a600416a3d None None] MFA Rules not processed for user `c2e882fa185247da8eb48153f0361679`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:06.679212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8f6d7c8b-1ab7-48c6-8b21-96a600416a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:06.742015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1348/2655] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:06.746516 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805373d-b526-4849-b61f-d38bb6779b80 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:06.808177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805373d-b526-4849-b61f-d38bb6779b80 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:06.813168 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5bc5d-b7fd-4522-b0f3-9617f0f8576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:06.813775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5bc5d-b7fd-4522-b0f3-9617f0f8576b admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:06.814061 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5bc5d-b7fd-4522-b0f3-9617f0f8576b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:06.814364 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5bc5d-b7fd-4522-b0f3-9617f0f8576b admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:06.815058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5bc5d-b7fd-4522-b0f3-9617f0f8576b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:06.817472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5bc5d-b7fd-4522-b0f3-9617f0f8576b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:06.869095 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d7c8b-1ab7-48c6-8b21-96a600416a3d None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:06.870624 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8f6d7c8b-1ab7-48c6-8b21-96a600416a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:06.885888 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d7c8b-1ab7-48c6-8b21-96a600416a3d None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:06.891189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:06.892114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:06.892469 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:06.892654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] PATH_INFO: `/v3/projects/2f712ca164cf4a70b680bda615fbd469` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:06.895008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f712ca164cf4a70b680bda615fbd469)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:06.896635 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:06.948387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1308/2656] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:06 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:40:06.952316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5bc5d-b7fd-4522-b0f3-9617f0f8576b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:07.015350 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5bc5d-b7fd-4522-b0f3-9617f0f8576b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:07.020764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73259af-0496-4c7a-82c9-c3a7d08a1f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:07.021430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73259af-0496-4c7a-82c9-c3a7d08a1f9a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:07.021716 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73259af-0496-4c7a-82c9-c3a7d08a1f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:07.021997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73259af-0496-4c7a-82c9-c3a7d08a1f9a admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:07.022723 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73259af-0496-4c7a-82c9-c3a7d08a1f9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:07.024636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73259af-0496-4c7a-82c9-c3a7d08a1f9a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:07.058137 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f712ca164cf4a70b680bda615fbd469', 'request_id': 'req-744432fa-0305-4136-a5c0-f718345662ec'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:07.065435 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f712ca164cf4a70b680bda615fbd469', 'request_id': 'req-744432fa-0305-4136-a5c0-f718345662ec'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:07.118785 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1309/2657] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:06 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:40:07.122737 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73259af-0496-4c7a-82c9-c3a7d08a1f9a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:07.132695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73259af-0496-4c7a-82c9-c3a7d08a1f9a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:07.187222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9399d3-cf54-4a9d-9a15-76c189fb77ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:07.187867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9399d3-cf54-4a9d-9a15-76c189fb77ac admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:07.188155 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9399d3-cf54-4a9d-9a15-76c189fb77ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:07.188437 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9399d3-cf54-4a9d-9a15-76c189fb77ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:07.189157 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9399d3-cf54-4a9d-9a15-76c189fb77ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:07.190782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9399d3-cf54-4a9d-9a15-76c189fb77ac admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:07.198219 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f712ca164cf4a70b680bda615fbd469', 'request_id': 'req-744432fa-0305-4136-a5c0-f718345662ec'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:07.202532 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1310/2658] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:07.206647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9399d3-cf54-4a9d-9a15-76c189fb77ac admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:07.212366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] The token cache is being invalidate because project 2f712ca164cf4a70b680bda615fbd469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:07.214972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:07.214972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:07.214972 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1349/2659] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:06 2022] DELETE /identity/v3/projects/2f712ca164cf4a70b680bda615fbd469 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:07.217843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9399d3-cf54-4a9d-9a15-76c189fb77ac admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:07.218663 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:07.219965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:07.222684 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fcc27-80ac-4311-9bf8-d99d340f97b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:07.223339 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fcc27-80ac-4311-9bf8-d99d340f97b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:07.223656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fcc27-80ac-4311-9bf8-d99d340f97b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:07.223937 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fcc27-80ac-4311-9bf8-d99d340f97b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:07.224682 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fcc27-80ac-4311-9bf8-d99d340f97b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:07.226347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fcc27-80ac-4311-9bf8-d99d340f97b6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:07.232429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744432fa-0305-4136-a5c0-f718345662ec admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:07.236517 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1311/2660] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:07.237331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:07.238391 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:07.238683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:07.238965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] PATH_INFO: `/v3/users/f9226bb5459f4e949ce6f08f0a0369b1` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:07.240179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9226bb5459f4e949ce6f08f0a0369b1)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:07.240655 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fcc27-80ac-4311-9bf8-d99d340f97b6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:07.242148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:07.242373 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5f7fcc27-80ac-4311-9bf8-d99d340f97b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:07.255342 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fcc27-80ac-4311-9bf8-d99d340f97b6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:07.260142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a07f7e-645b-481d-bc8b-2cf24b46632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:07.261023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a07f7e-645b-481d-bc8b-2cf24b46632e admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:07.261312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a07f7e-645b-481d-bc8b-2cf24b46632e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:07.261594 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a07f7e-645b-481d-bc8b-2cf24b46632e admin admin] PATH_INFO: `/v3/projects/2bc456df574945159b2faa3883adb1fb/users/0ebf96f8cf1f4c0b8ce73ddcae50ce12/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:07.276713 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a07f7e-645b-481d-bc8b-2cf24b46632e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc456df574945159b2faa3883adb1fb, user_id=0ebf96f8cf1f4c0b8ce73ddcae50ce12, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:07.279451 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a07f7e-645b-481d-bc8b-2cf24b46632e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:07.369006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1312/2661] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:07 2022] PUT /identity/v3/projects/2bc456df574945159b2faa3883adb1fb/users/0ebf96f8cf1f4c0b8ce73ddcae50ce12/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:07.380033 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c6ef2-b52d-47aa-9868-b9fdfea14ba5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:07.380324 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c6ef2-b52d-47aa-9868-b9fdfea14ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:07.380611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c6ef2-b52d-47aa-9868-b9fdfea14ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:07.404685 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9226bb5459f4e949ce6f08f0a0369b1'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:07.406683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-981c6ef2-b52d-47aa-9868-b9fdfea14ba5 None None] MFA Rules not processed for user `0ebf96f8cf1f4c0b8ce73ddcae50ce12`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:07.407879 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-981c6ef2-b52d-47aa-9868-b9fdfea14ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:07.412446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9226bb5459f4e949ce6f08f0a0369b1'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:07.472405 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1313/2662] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:07.476844 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9226bb5459f4e949ce6f08f0a0369b1'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:07.477041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c6ef2-b52d-47aa-9868-b9fdfea14ba5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:07.477530 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9226bb5459f4e949ce6f08f0a0369b1'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:07.490768 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9226bb5459f4e949ce6f08f0a0369b1'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:07.496740 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1350/2663] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:07 2022] DELETE /identity/v3/users/f9226bb5459f4e949ce6f08f0a0369b1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:07.594123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c6ef2-b52d-47aa-9868-b9fdfea14ba5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:07.649450 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640214f-e755-44f8-b7e0-16d2167e1020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:07.650154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640214f-e755-44f8-b7e0-16d2167e1020 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:07.650474 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640214f-e755-44f8-b7e0-16d2167e1020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:07.650759 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640214f-e755-44f8-b7e0-16d2167e1020 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:07.651446 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640214f-e755-44f8-b7e0-16d2167e1020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:07.653351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640214f-e755-44f8-b7e0-16d2167e1020 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:07.774568 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1314/2664] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:07 2022] POST /identity/v3/projects => generated 375 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:07.775726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:07.777144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:07.790912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c0093-7b91-4950-8d41-a7206d1127ad admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:07.846474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5d88a-8cb0-48cc-a979-19b6702357af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:07.847650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d88a-8cb0-48cc-a979-19b6702357af admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:07.847973 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d88a-8cb0-48cc-a979-19b6702357af admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:07.848249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d88a-8cb0-48cc-a979-19b6702357af admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:07.848939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5d88a-8cb0-48cc-a979-19b6702357af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:07.850865 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5d88a-8cb0-48cc-a979-19b6702357af admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:07.897118 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640214f-e755-44f8-b7e0-16d2167e1020 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:07.899004 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3640214f-e755-44f8-b7e0-16d2167e1020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:07.912798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640214f-e755-44f8-b7e0-16d2167e1020 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:07.918371 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea2819-c02a-4499-9191-c957a95dcebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:07.919349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea2819-c02a-4499-9191-c957a95dcebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:07.919639 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea2819-c02a-4499-9191-c957a95dcebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:07.919967 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea2819-c02a-4499-9191-c957a95dcebe admin admin] PATH_INFO: `/v3/projects/5fb3f23f18f642d5ada8705945f44dcc` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:07.921356 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea2819-c02a-4499-9191-c957a95dcebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb3f23f18f642d5ada8705945f44dcc)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:07.923193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea2819-c02a-4499-9191-c957a95dcebe admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:07.927628 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1351/2665] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:07 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:07.930204 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5d88a-8cb0-48cc-a979-19b6702357af admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:07.940371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5d88a-8cb0-48cc-a979-19b6702357af admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:07.945181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be2a39-56ac-41d2-8fb1-2e9b4e33b86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:07.945840 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be2a39-56ac-41d2-8fb1-2e9b4e33b86e admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:07.946128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be2a39-56ac-41d2-8fb1-2e9b4e33b86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:07.946448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be2a39-56ac-41d2-8fb1-2e9b4e33b86e admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:07.947181 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be2a39-56ac-41d2-8fb1-2e9b4e33b86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:07.948772 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be2a39-56ac-41d2-8fb1-2e9b4e33b86e admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:07.959205 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1352/2666] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:07.963288 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be2a39-56ac-41d2-8fb1-2e9b4e33b86e admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:07.973313 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be2a39-56ac-41d2-8fb1-2e9b4e33b86e admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:07.978890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df745eb6-c057-4c37-b6af-2aab424c0378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:07.979020 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df745eb6-c057-4c37-b6af-2aab424c0378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:07.979246 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df745eb6-c057-4c37-b6af-2aab424c0378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:07.979524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df745eb6-c057-4c37-b6af-2aab424c0378 admin admin] PATH_INFO: `/v3/projects/3385137c90684145890e489c67c5d912/users/bb2742a3e135404b9f0621e5a7d34625/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:07.994886 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df745eb6-c057-4c37-b6af-2aab424c0378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3385137c90684145890e489c67c5d912, user_id=bb2742a3e135404b9f0621e5a7d34625, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:07.997523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df745eb6-c057-4c37-b6af-2aab424c0378 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:08.055978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1353/2667] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:07 2022] PUT /identity/v3/projects/3385137c90684145890e489c67c5d912/users/bb2742a3e135404b9f0621e5a7d34625/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:08.059801 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df745eb6-c057-4c37-b6af-2aab424c0378 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:08.063756 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-84ea2819-c02a-4499-9191-c957a95dcebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb3f23f18f642d5ada8705945f44dcc', 'request_id': 'req-84ea2819-c02a-4499-9191-c957a95dcebe'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:08.070814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-84ea2819-c02a-4499-9191-c957a95dcebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb3f23f18f642d5ada8705945f44dcc', 'request_id': 'req-84ea2819-c02a-4499-9191-c957a95dcebe'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:08.121196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df745eb6-c057-4c37-b6af-2aab424c0378 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:08.145779 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-84ea2819-c02a-4499-9191-c957a95dcebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb3f23f18f642d5ada8705945f44dcc', 'request_id': 'req-84ea2819-c02a-4499-9191-c957a95dcebe'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:08.156932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-84ea2819-c02a-4499-9191-c957a95dcebe admin admin] The token cache is being invalidate because project 5fb3f23f18f642d5ada8705945f44dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:08.157150 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-84ea2819-c02a-4499-9191-c957a95dcebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:08.157822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-84ea2819-c02a-4499-9191-c957a95dcebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:08.159426 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1315/2668] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:07 2022] DELETE /identity/v3/projects/5fb3f23f18f642d5ada8705945f44dcc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:08.164904 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a94555-169c-4f41-95bc-79cf51d94ba1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:08.165193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a94555-169c-4f41-95bc-79cf51d94ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:08.165478 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a94555-169c-4f41-95bc-79cf51d94ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:08.177187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a288e-582d-4d98-8e3c-153e219f11e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:08.177870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a288e-582d-4d98-8e3c-153e219f11e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:08.178158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a288e-582d-4d98-8e3c-153e219f11e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:08.178475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a288e-582d-4d98-8e3c-153e219f11e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:08.179210 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a288e-582d-4d98-8e3c-153e219f11e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:08.180859 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a288e-582d-4d98-8e3c-153e219f11e2 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:08.183117 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-24a94555-169c-4f41-95bc-79cf51d94ba1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:08.184443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-24a94555-169c-4f41-95bc-79cf51d94ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:08.190977 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1354/2669] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:08.193283 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1316/2670] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:08.199232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a288e-582d-4d98-8e3c-153e219f11e2 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:08.200910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a3d03-ef35-4fac-b039-f0f7bec058f9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:08.201045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9a4a288e-582d-4d98-8e3c-153e219f11e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:08.201336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a3d03-ef35-4fac-b039-f0f7bec058f9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:08.201693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a3d03-ef35-4fac-b039-f0f7bec058f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:08.213675 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a288e-582d-4d98-8e3c-153e219f11e2 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:08.218213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455d92a-3686-467f-af92-72334b49c818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:08.219115 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455d92a-3686-467f-af92-72334b49c818 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:08.219394 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455d92a-3686-467f-af92-72334b49c818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:08.219672 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455d92a-3686-467f-af92-72334b49c818 admin admin] PATH_INFO: `/v3/projects/3385137c90684145890e489c67c5d912/users/bb2742a3e135404b9f0621e5a7d34625/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:08.219848 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c72a3d03-ef35-4fac-b039-f0f7bec058f9 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:08.221026 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c72a3d03-ef35-4fac-b039-f0f7bec058f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:08.221570 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455d92a-3686-467f-af92-72334b49c818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3385137c90684145890e489c67c5d912, user_id=bb2742a3e135404b9f0621e5a7d34625, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:08.225019 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455d92a-3686-467f-af92-72334b49c818 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:08.230100 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1317/2671] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:08.234342 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a3d03-ef35-4fac-b039-f0f7bec058f9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:08.235175 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1355/2672] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:08 2022] PUT /identity/v3/projects/3385137c90684145890e489c67c5d912/users/bb2742a3e135404b9f0621e5a7d34625/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:08.243781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a3d03-ef35-4fac-b039-f0f7bec058f9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:08.246243 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19af28-6437-45fe-bee0-5b1a7be01307 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:08.246581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19af28-6437-45fe-bee0-5b1a7be01307 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:08.246905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19af28-6437-45fe-bee0-5b1a7be01307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:08.273553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-1f19af28-6437-45fe-bee0-5b1a7be01307 None None] MFA Rules not processed for user `bb2742a3e135404b9f0621e5a7d34625`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:08.274789 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1f19af28-6437-45fe-bee0-5b1a7be01307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:08.300189 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd703735-7923-41fb-a006-fb2b76d45172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:08.301449 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd703735-7923-41fb-a006-fb2b76d45172 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:08.301736 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd703735-7923-41fb-a006-fb2b76d45172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:08.302017 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd703735-7923-41fb-a006-fb2b76d45172 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:08.302784 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd703735-7923-41fb-a006-fb2b76d45172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:40:08.303094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd703735-7923-41fb-a006-fb2b76d45172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:08.304685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd703735-7923-41fb-a006-fb2b76d45172 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:08.320250 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1318/2673] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:40:08.321174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd703735-7923-41fb-a006-fb2b76d45172 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:08.330503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd703735-7923-41fb-a006-fb2b76d45172 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:08.336347 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e333dc-090e-4210-8c21-277d5d1d3db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:08.337015 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e333dc-090e-4210-8c21-277d5d1d3db8 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:08.337768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e333dc-090e-4210-8c21-277d5d1d3db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:08.337768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e333dc-090e-4210-8c21-277d5d1d3db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:08.338238 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e333dc-090e-4210-8c21-277d5d1d3db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:08.340143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e333dc-090e-4210-8c21-277d5d1d3db8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:08.345926 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1356/2674] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:08.358145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19af28-6437-45fe-bee0-5b1a7be01307 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:08.359560 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1f19af28-6437-45fe-bee0-5b1a7be01307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:08.414422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19af28-6437-45fe-bee0-5b1a7be01307 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:08.418189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27423b-3234-4323-b7b7-246c5d989fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:08.418877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27423b-3234-4323-b7b7-246c5d989fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:08.419167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27423b-3234-4323-b7b7-246c5d989fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:08.419513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27423b-3234-4323-b7b7-246c5d989fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:08.421340 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ee27423b-3234-4323-b7b7-246c5d989fc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:08.446107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1319/2675] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:08 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:08.450190 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e333dc-090e-4210-8c21-277d5d1d3db8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:08.480641 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27423b-3234-4323-b7b7-246c5d989fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:08.482191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27423b-3234-4323-b7b7-246c5d989fc1 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:08.492132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1357/2676] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:40:08.514090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e333dc-090e-4210-8c21-277d5d1d3db8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:08.518992 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bde40b-8b4f-4846-94ce-6a2f38dd0b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:08.520330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bde40b-8b4f-4846-94ce-6a2f38dd0b69 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:08.520621 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bde40b-8b4f-4846-94ce-6a2f38dd0b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:08.520906 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bde40b-8b4f-4846-94ce-6a2f38dd0b69 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:08.521671 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bde40b-8b4f-4846-94ce-6a2f38dd0b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:08.523650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bde40b-8b4f-4846-94ce-6a2f38dd0b69 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:08.690264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1320/2677] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:08 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:08.696594 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27423b-3234-4323-b7b7-246c5d989fc1 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:08.708032 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27423b-3234-4323-b7b7-246c5d989fc1 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:08.712887 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f4551-34ca-4741-8226-744206585872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:08.713581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f4551-34ca-4741-8226-744206585872 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:08.713868 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f4551-34ca-4741-8226-744206585872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:08.714142 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f4551-34ca-4741-8226-744206585872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:08.714929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f4551-34ca-4741-8226-744206585872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:08.716501 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f4551-34ca-4741-8226-744206585872 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:08.726500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1358/2678] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:40:08.730655 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bde40b-8b4f-4846-94ce-6a2f38dd0b69 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:08.740932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bde40b-8b4f-4846-94ce-6a2f38dd0b69 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:08.745656 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff336b03-f32f-468f-b33d-fb8364b252a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:08.746335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff336b03-f32f-468f-b33d-fb8364b252a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:08.746621 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff336b03-f32f-468f-b33d-fb8364b252a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:08.746902 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff336b03-f32f-468f-b33d-fb8364b252a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:08.747621 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff336b03-f32f-468f-b33d-fb8364b252a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:08.749265 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff336b03-f32f-468f-b33d-fb8364b252a8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:08.760698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1321/2679] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:08.771505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f4551-34ca-4741-8226-744206585872 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:08.781910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f4551-34ca-4741-8226-744206585872 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:08.786921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678f863-86d5-441e-b4a2-8a02528eb72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:08.787804 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678f863-86d5-441e-b4a2-8a02528eb72b admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:08.788086 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678f863-86d5-441e-b4a2-8a02528eb72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:08.788362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678f863-86d5-441e-b4a2-8a02528eb72b admin admin] PATH_INFO: `/v3/projects/1d926cf4c2ed494caab20b2a7958c614/users/7c8c8e6ae7994be8a24e50f1fc70762f/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:08.804757 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678f863-86d5-441e-b4a2-8a02528eb72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d926cf4c2ed494caab20b2a7958c614, user_id=7c8c8e6ae7994be8a24e50f1fc70762f, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:08.807922 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678f863-86d5-441e-b4a2-8a02528eb72b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:08.907169 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1359/2680] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:08 2022] PUT /identity/v3/projects/1d926cf4c2ed494caab20b2a7958c614/users/7c8c8e6ae7994be8a24e50f1fc70762f/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:08.913040 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7340612-db60-4eb4-91ba-86cbecce05cf None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:08.913509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7340612-db60-4eb4-91ba-86cbecce05cf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:08.913607 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7340612-db60-4eb4-91ba-86cbecce05cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:08.931549 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d7340612-db60-4eb4-91ba-86cbecce05cf None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:08.932811 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d7340612-db60-4eb4-91ba-86cbecce05cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:08.992760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1322/2681] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:09.002187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678f863-86d5-441e-b4a2-8a02528eb72b admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:09.004533 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a678f863-86d5-441e-b4a2-8a02528eb72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:09.060097 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678f863-86d5-441e-b4a2-8a02528eb72b admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:09.063710 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9f57d-2df4-4780-89a2-afee0e2029fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:09.064350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9f57d-2df4-4780-89a2-afee0e2029fd service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:09.064627 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9f57d-2df4-4780-89a2-afee0e2029fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:09.064899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9f57d-2df4-4780-89a2-afee0e2029fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:09.073924 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9f57d-2df4-4780-89a2-afee0e2029fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:09.075368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9f57d-2df4-4780-89a2-afee0e2029fd service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:09.085265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1360/2682] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:10.462565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85923276-34d3-41cd-ac67-e774e11f4b39 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:10.463052 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85923276-34d3-41cd-ac67-e774e11f4b39 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:10.463401 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85923276-34d3-41cd-ac67-e774e11f4b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:10.492797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-85923276-34d3-41cd-ac67-e774e11f4b39 None None] MFA Rules not processed for user `7c8c8e6ae7994be8a24e50f1fc70762f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:10.494211 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-85923276-34d3-41cd-ac67-e774e11f4b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:10.572507 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1323/2683] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:10.577366 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9f57d-2df4-4780-89a2-afee0e2029fd service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:10.588893 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9f57d-2df4-4780-89a2-afee0e2029fd service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:10.594165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575b526-bbc8-49f4-b93f-eebcd5851f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:10.594912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575b526-bbc8-49f4-b93f-eebcd5851f07 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:10.595203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575b526-bbc8-49f4-b93f-eebcd5851f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:10.595485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575b526-bbc8-49f4-b93f-eebcd5851f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:10.596190 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575b526-bbc8-49f4-b93f-eebcd5851f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:10.598941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575b526-bbc8-49f4-b93f-eebcd5851f07 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:10.619734 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85923276-34d3-41cd-ac67-e774e11f4b39 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:10.621111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-85923276-34d3-41cd-ac67-e774e11f4b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:10.677555 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85923276-34d3-41cd-ac67-e774e11f4b39 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:10.681152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74066a3-12a9-41ef-be95-af771de3d3eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:10.681788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74066a3-12a9-41ef-be95-af771de3d3eb service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:10.682075 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74066a3-12a9-41ef-be95-af771de3d3eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:10.682408 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74066a3-12a9-41ef-be95-af771de3d3eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:10.684142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b74066a3-12a9-41ef-be95-af771de3d3eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:10.724683 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1361/2684] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:10 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:40:10.728444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575b526-bbc8-49f4-b93f-eebcd5851f07 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:10.743277 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74066a3-12a9-41ef-be95-af771de3d3eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:10.744728 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74066a3-12a9-41ef-be95-af771de3d3eb service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:10.758353 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1324/2685] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:40:10.791028 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575b526-bbc8-49f4-b93f-eebcd5851f07 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:10.795910 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f62c6-b54d-4b36-b58b-37d9c8114404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:10.796581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f62c6-b54d-4b36-b58b-37d9c8114404 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:10.796866 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f62c6-b54d-4b36-b58b-37d9c8114404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:10.797144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f62c6-b54d-4b36-b58b-37d9c8114404 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:10.797829 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f62c6-b54d-4b36-b58b-37d9c8114404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:10.799769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f62c6-b54d-4b36-b58b-37d9c8114404 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:10.959347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1362/2686] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:10 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:10.963345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74066a3-12a9-41ef-be95-af771de3d3eb service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:10.974005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74066a3-12a9-41ef-be95-af771de3d3eb service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:10.978649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac68a78-f829-4ad2-a1ca-50a3a0be07f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:10.979242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac68a78-f829-4ad2-a1ca-50a3a0be07f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:10.979518 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac68a78-f829-4ad2-a1ca-50a3a0be07f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:10.979793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac68a78-f829-4ad2-a1ca-50a3a0be07f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:10.980497 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac68a78-f829-4ad2-a1ca-50a3a0be07f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:10.982067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac68a78-f829-4ad2-a1ca-50a3a0be07f1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:10.992241 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1325/2687] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:40:10.996420 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f62c6-b54d-4b36-b58b-37d9c8114404 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:11.007219 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f62c6-b54d-4b36-b58b-37d9c8114404 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:11.011800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199d21d-8c22-41c3-8a1b-7460c45375ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:11.012682 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199d21d-8c22-41c3-8a1b-7460c45375ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:11.012962 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199d21d-8c22-41c3-8a1b-7460c45375ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:11.013237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199d21d-8c22-41c3-8a1b-7460c45375ea admin admin] PATH_INFO: `/v3/projects/fe021c2bc15d4f9a8cf782dedbd808d2/users/3ef0c145c477480a9663955680c74c41/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:11.028308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199d21d-8c22-41c3-8a1b-7460c45375ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe021c2bc15d4f9a8cf782dedbd808d2, user_id=3ef0c145c477480a9663955680c74c41, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:11.037897 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199d21d-8c22-41c3-8a1b-7460c45375ea admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:11.185758 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1363/2688] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:10 2022] PUT /identity/v3/projects/fe021c2bc15d4f9a8cf782dedbd808d2/users/3ef0c145c477480a9663955680c74c41/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:11.189644 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac68a78-f829-4ad2-a1ca-50a3a0be07f1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:11.200298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac68a78-f829-4ad2-a1ca-50a3a0be07f1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:11.254062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757767b5-28f4-46cf-9955-d6c0bbd146fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:11.254690 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757767b5-28f4-46cf-9955-d6c0bbd146fc admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:11.254968 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757767b5-28f4-46cf-9955-d6c0bbd146fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:11.255243 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757767b5-28f4-46cf-9955-d6c0bbd146fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:11.256020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757767b5-28f4-46cf-9955-d6c0bbd146fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:11.257603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757767b5-28f4-46cf-9955-d6c0bbd146fc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:11.267367 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1326/2689] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:40:11.271517 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199d21d-8c22-41c3-8a1b-7460c45375ea admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:11.281730 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199d21d-8c22-41c3-8a1b-7460c45375ea admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:11.286702 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7436e-96b5-4ed5-934c-d3df385d25b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:11.287570 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7436e-96b5-4ed5-934c-d3df385d25b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:11.287854 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7436e-96b5-4ed5-934c-d3df385d25b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:11.288134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7436e-96b5-4ed5-934c-d3df385d25b6 admin admin] PATH_INFO: `/v3/projects/fe021c2bc15d4f9a8cf782dedbd808d2/users/3ef0c145c477480a9663955680c74c41/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:11.290125 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7436e-96b5-4ed5-934c-d3df385d25b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe021c2bc15d4f9a8cf782dedbd808d2, user_id=3ef0c145c477480a9663955680c74c41, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:11.292834 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7436e-96b5-4ed5-934c-d3df385d25b6 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:11.303392 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1364/2690] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:11 2022] PUT /identity/v3/projects/fe021c2bc15d4f9a8cf782dedbd808d2/users/3ef0c145c477480a9663955680c74c41/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:12.600101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757767b5-28f4-46cf-9955-d6c0bbd146fc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:12.657532 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757767b5-28f4-46cf-9955-d6c0bbd146fc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:12.673931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa0ed-bf6e-465c-9701-79513d86f937 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:12.673931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa0ed-bf6e-465c-9701-79513d86f937 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:12.674531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa0ed-bf6e-465c-9701-79513d86f937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:12.702882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-cc4aa0ed-bf6e-465c-9701-79513d86f937 None None] MFA Rules not processed for user `3ef0c145c477480a9663955680c74c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:12.704161 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-cc4aa0ed-bf6e-465c-9701-79513d86f937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:12.711176 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ea410-6879-44d0-a968-39fccee68f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:12.711835 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ea410-6879-44d0-a968-39fccee68f6e service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:12.712174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ea410-6879-44d0-a968-39fccee68f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:12.712460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ea410-6879-44d0-a968-39fccee68f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:12.783222 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1365/2691] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:12 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:12.785844 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ea410-6879-44d0-a968-39fccee68f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:12.787335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ea410-6879-44d0-a968-39fccee68f6e service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:12.794183 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa0ed-bf6e-465c-9701-79513d86f937 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:12.797337 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1327/2692] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:12.804786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa0ed-bf6e-465c-9701-79513d86f937 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:12.808407 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf73b0-cc90-4553-a9be-b1a5522a8361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:12.809058 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf73b0-cc90-4553-a9be-b1a5522a8361 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:12.809343 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf73b0-cc90-4553-a9be-b1a5522a8361 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:12.809620 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf73b0-cc90-4553-a9be-b1a5522a8361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:12.867139 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf73b0-cc90-4553-a9be-b1a5522a8361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:12.868608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf73b0-cc90-4553-a9be-b1a5522a8361 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:12.877389 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1366/2693] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:40:14.702715 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ea410-6879-44d0-a968-39fccee68f6e service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:14.711388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ea410-6879-44d0-a968-39fccee68f6e service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:14.715055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a817b-bb74-445f-8d39-8345cfb141e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:14.715686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a817b-bb74-445f-8d39-8345cfb141e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:14.715974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a817b-bb74-445f-8d39-8345cfb141e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:14.716254 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a817b-bb74-445f-8d39-8345cfb141e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:14.725799 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a817b-bb74-445f-8d39-8345cfb141e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:14.727278 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a817b-bb74-445f-8d39-8345cfb141e1 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:14.736567 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1328/2694] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:17.767413 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf73b0-cc90-4553-a9be-b1a5522a8361 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:17.824608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf73b0-cc90-4553-a9be-b1a5522a8361 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:17.829145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:17.830012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:17.830327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:17.830613 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] PATH_INFO: `/v3/users/c2e882fa185247da8eb48153f0361679` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:17.832544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e882fa185247da8eb48153f0361679)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:17.834476 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:17.998970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e882fa185247da8eb48153f0361679'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:18.006880 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e882fa185247da8eb48153f0361679'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:18.122563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e882fa185247da8eb48153f0361679'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:18.123197 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e882fa185247da8eb48153f0361679'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:18.136405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e882fa185247da8eb48153f0361679'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:18.142261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1367/2695] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:17 2022] DELETE /identity/v3/users/c2e882fa185247da8eb48153f0361679 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:18.146916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a87677-ce8b-4dab-84f6-b5a1c581300c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:18.147402 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a87677-ce8b-4dab-84f6-b5a1c581300c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:18.147521 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a87677-ce8b-4dab-84f6-b5a1c581300c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:18.165346 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a7a87677-ce8b-4dab-84f6-b5a1c581300c None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:18.166581 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a7a87677-ce8b-4dab-84f6-b5a1c581300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:18.229649 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1329/2696] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:18.239460 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:18.240868 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:18.296732 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18a306-b64e-43cf-a216-c17605fde5fe admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:18.300305 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc615a1-f5ba-4de9-b6bf-7307e5dc2686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:18.300946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc615a1-f5ba-4de9-b6bf-7307e5dc2686 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:18.301228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc615a1-f5ba-4de9-b6bf-7307e5dc2686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:18.301504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc615a1-f5ba-4de9-b6bf-7307e5dc2686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:18.310699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc615a1-f5ba-4de9-b6bf-7307e5dc2686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:18.312109 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc615a1-f5ba-4de9-b6bf-7307e5dc2686 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:18.321902 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1368/2697] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:18.799841 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a87677-ce8b-4dab-84f6-b5a1c581300c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:18.802043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a7a87677-ce8b-4dab-84f6-b5a1c581300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:18.816800 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a87677-ce8b-4dab-84f6-b5a1c581300c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:18.821891 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:18.822960 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:18.823381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:18.823788 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] PATH_INFO: `/v3/projects/74f3fb6ef54042ce8e4de1c6fd3ff54c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:18.825154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f3fb6ef54042ce8e4de1c6fd3ff54c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:18.828041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:18.962220 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f3fb6ef54042ce8e4de1c6fd3ff54c', 'request_id': 'req-3329ed6a-b191-4e9e-abdb-0786a75a85ca'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:18.968361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f3fb6ef54042ce8e4de1c6fd3ff54c', 'request_id': 'req-3329ed6a-b191-4e9e-abdb-0786a75a85ca'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:19.043773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f3fb6ef54042ce8e4de1c6fd3ff54c', 'request_id': 'req-3329ed6a-b191-4e9e-abdb-0786a75a85ca'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:19.054225 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] The token cache is being invalidate because project 74f3fb6ef54042ce8e4de1c6fd3ff54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:19.054632 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:19.055244 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:19.057896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1330/2698] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:18 2022] DELETE /identity/v3/projects/74f3fb6ef54042ce8e4de1c6fd3ff54c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:19.061116 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc615a1-f5ba-4de9-b6bf-7307e5dc2686 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:19.071449 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc615a1-f5ba-4de9-b6bf-7307e5dc2686 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:19.125364 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:19.126248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:19.126571 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:19.126854 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] PATH_INFO: `/v3/users/0ebf96f8cf1f4c0b8ce73ddcae50ce12` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:19.128041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebf96f8cf1f4c0b8ce73ddcae50ce12)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:19.130553 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:19.347751 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebf96f8cf1f4c0b8ce73ddcae50ce12'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:19.354268 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebf96f8cf1f4c0b8ce73ddcae50ce12'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:19.443975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebf96f8cf1f4c0b8ce73ddcae50ce12'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:19.444602 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebf96f8cf1f4c0b8ce73ddcae50ce12'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:19.457578 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebf96f8cf1f4c0b8ce73ddcae50ce12'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:19.463828 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1369/2699] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:19 2022] DELETE /identity/v3/users/0ebf96f8cf1f4c0b8ce73ddcae50ce12 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:19.897006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:19.898496 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:19.912154 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329ed6a-b191-4e9e-abdb-0786a75a85ca admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:19.976174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:19.977056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:19.977345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:19.977664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] PATH_INFO: `/v3/projects/2bc456df574945159b2faa3883adb1fb` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:19.978901 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc456df574945159b2faa3883adb1fb)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:19.980904 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:20.107535 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc456df574945159b2faa3883adb1fb', 'request_id': 'req-677f4d50-0b4b-438d-9783-6f2fdf950435'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:20.114423 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc456df574945159b2faa3883adb1fb', 'request_id': 'req-677f4d50-0b4b-438d-9783-6f2fdf950435'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:20.236726 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc456df574945159b2faa3883adb1fb', 'request_id': 'req-677f4d50-0b4b-438d-9783-6f2fdf950435'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:20.248528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] The token cache is being invalidate because project 2bc456df574945159b2faa3883adb1fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:20.248817 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:20.249520 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:20.251099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1331/2700] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:19 2022] DELETE /identity/v3/projects/2bc456df574945159b2faa3883adb1fb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:20.255089 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:20.256554 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:20.270133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0367-70c2-4af1-8559-23fab4d0fe88 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:20.325285 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5cb76-01fd-43d8-a5c4-eac969a7ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:20.326167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5cb76-01fd-43d8-a5c4-eac969a7ad49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:20.326485 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5cb76-01fd-43d8-a5c4-eac969a7ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:20.326771 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5cb76-01fd-43d8-a5c4-eac969a7ad49 admin admin] PATH_INFO: `/v3/users/bb2742a3e135404b9f0621e5a7d34625` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:20.327959 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5cb76-01fd-43d8-a5c4-eac969a7ad49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2742a3e135404b9f0621e5a7d34625)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:20.329939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5cb76-01fd-43d8-a5c4-eac969a7ad49 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:20.514833 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-b0c5cb76-01fd-43d8-a5c4-eac969a7ad49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2742a3e135404b9f0621e5a7d34625'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:20.522439 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-b0c5cb76-01fd-43d8-a5c4-eac969a7ad49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2742a3e135404b9f0621e5a7d34625'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:20.603716 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-b0c5cb76-01fd-43d8-a5c4-eac969a7ad49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2742a3e135404b9f0621e5a7d34625'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:20.604343 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-b0c5cb76-01fd-43d8-a5c4-eac969a7ad49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2742a3e135404b9f0621e5a7d34625'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:20.616744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-b0c5cb76-01fd-43d8-a5c4-eac969a7ad49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2742a3e135404b9f0621e5a7d34625'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:20.622816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1370/2701] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:20 2022] DELETE /identity/v3/users/bb2742a3e135404b9f0621e5a7d34625 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:21.044042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:21.049516 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:21.060769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f4d50-0b4b-438d-9783-6f2fdf950435 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:21.125305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2d003-2940-4c56-b328-922ff25d366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:21.126158 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2d003-2940-4c56-b328-922ff25d366e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:21.126471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2d003-2940-4c56-b328-922ff25d366e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:21.126748 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2d003-2940-4c56-b328-922ff25d366e admin admin] PATH_INFO: `/v3/projects/3385137c90684145890e489c67c5d912` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:21.128047 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2d003-2940-4c56-b328-922ff25d366e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3385137c90684145890e489c67c5d912)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:21.130667 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2d003-2940-4c56-b328-922ff25d366e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:21.276110 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f5e2d003-2940-4c56-b328-922ff25d366e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3385137c90684145890e489c67c5d912', 'request_id': 'req-f5e2d003-2940-4c56-b328-922ff25d366e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:21.282146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f5e2d003-2940-4c56-b328-922ff25d366e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3385137c90684145890e489c67c5d912', 'request_id': 'req-f5e2d003-2940-4c56-b328-922ff25d366e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:21.390774 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f5e2d003-2940-4c56-b328-922ff25d366e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3385137c90684145890e489c67c5d912', 'request_id': 'req-f5e2d003-2940-4c56-b328-922ff25d366e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:21.401376 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f5e2d003-2940-4c56-b328-922ff25d366e admin admin] The token cache is being invalidate because project 3385137c90684145890e489c67c5d912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:21.401661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f5e2d003-2940-4c56-b328-922ff25d366e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:21.402304 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f5e2d003-2940-4c56-b328-922ff25d366e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:21.403881 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1332/2702] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:21 2022] DELETE /identity/v3/projects/3385137c90684145890e489c67c5d912 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:21.408723 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3089f-9ce9-466e-93de-84b903ebc251 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:21.409179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3089f-9ce9-466e-93de-84b903ebc251 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:21.409292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3089f-9ce9-466e-93de-84b903ebc251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:21.429594 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-33c3089f-9ce9-466e-93de-84b903ebc251 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:21.430857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-33c3089f-9ce9-466e-93de-84b903ebc251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:21.493888 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1371/2703] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:21.500905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1351e-c668-4c50-868d-5e508e5e2fbf None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:21.501201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1351e-c668-4c50-868d-5e508e5e2fbf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:21.501483 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1351e-c668-4c50-868d-5e508e5e2fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:21.520399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d6f1351e-c668-4c50-868d-5e508e5e2fbf None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:21.521623 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d6f1351e-c668-4c50-868d-5e508e5e2fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:21.530167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1333/2704] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:21.534951 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3089f-9ce9-466e-93de-84b903ebc251 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:21.544689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3089f-9ce9-466e-93de-84b903ebc251 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:21.549332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858cb81-3f40-4de3-b21e-a0e27e64f4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:21.550064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858cb81-3f40-4de3-b21e-a0e27e64f4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:21.550923 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858cb81-3f40-4de3-b21e-a0e27e64f4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:21.551281 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858cb81-3f40-4de3-b21e-a0e27e64f4a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:21.552012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858cb81-3f40-4de3-b21e-a0e27e64f4a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:40:21.552326 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858cb81-3f40-4de3-b21e-a0e27e64f4a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:21.553932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858cb81-3f40-4de3-b21e-a0e27e64f4a6 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:21.565890 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1372/2705] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:40:21.570614 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1351e-c668-4c50-868d-5e508e5e2fbf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:21.579682 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1351e-c668-4c50-868d-5e508e5e2fbf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:21.584985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8263a0-abe8-4250-868b-9b0d8fb7b140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:21.585635 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8263a0-abe8-4250-868b-9b0d8fb7b140 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:21.585920 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8263a0-abe8-4250-868b-9b0d8fb7b140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:21.586197 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8263a0-abe8-4250-868b-9b0d8fb7b140 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:21.586922 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8263a0-abe8-4250-868b-9b0d8fb7b140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:21.588861 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8263a0-abe8-4250-868b-9b0d8fb7b140 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:21.696831 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1334/2706] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:21 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:40:21.700769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858cb81-3f40-4de3-b21e-a0e27e64f4a6 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:21.711066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858cb81-3f40-4de3-b21e-a0e27e64f4a6 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:21.764234 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c942b85-b117-4eae-ba8a-813aa9126ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:21.764912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c942b85-b117-4eae-ba8a-813aa9126ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:21.765193 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c942b85-b117-4eae-ba8a-813aa9126ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:21.765467 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c942b85-b117-4eae-ba8a-813aa9126ff6 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:21.766266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c942b85-b117-4eae-ba8a-813aa9126ff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:21.768255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c942b85-b117-4eae-ba8a-813aa9126ff6 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:21.867131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1373/2707] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:21 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:40:21.871335 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8263a0-abe8-4250-868b-9b0d8fb7b140 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:21.881991 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8263a0-abe8-4250-868b-9b0d8fb7b140 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:21.886877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98265f-e6fa-463f-b86d-c42135792306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:21.887540 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98265f-e6fa-463f-b86d-c42135792306 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:21.887828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98265f-e6fa-463f-b86d-c42135792306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:21.888158 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98265f-e6fa-463f-b86d-c42135792306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:21.888878 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98265f-e6fa-463f-b86d-c42135792306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:21.890521 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98265f-e6fa-463f-b86d-c42135792306 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:21.902111 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1335/2708] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:21.906057 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c942b85-b117-4eae-ba8a-813aa9126ff6 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:21.916574 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c942b85-b117-4eae-ba8a-813aa9126ff6 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:21.921262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005f709-77cd-49c0-ac05-f55b89b0a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:21.921923 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005f709-77cd-49c0-ac05-f55b89b0a6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:21.922207 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005f709-77cd-49c0-ac05-f55b89b0a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:21.922522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005f709-77cd-49c0-ac05-f55b89b0a6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:21.923243 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005f709-77cd-49c0-ac05-f55b89b0a6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:21.924818 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005f709-77cd-49c0-ac05-f55b89b0a6a8 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:21.934810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1374/2709] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:21.939117 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98265f-e6fa-463f-b86d-c42135792306 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:21.954973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98265f-e6fa-463f-b86d-c42135792306 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:21.954973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba4157-04e1-4330-8cf1-011e7230e4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:21.954973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba4157-04e1-4330-8cf1-011e7230e4b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:21.954973 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba4157-04e1-4330-8cf1-011e7230e4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:21.955403 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba4157-04e1-4330-8cf1-011e7230e4b5 admin admin] PATH_INFO: `/v3/projects/32ee431b8dfe4c389c578aa6cb26e9c0/users/6cafc52efb4a4b3d85e5c64fa2512361/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:21.969838 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba4157-04e1-4330-8cf1-011e7230e4b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ee431b8dfe4c389c578aa6cb26e9c0, user_id=6cafc52efb4a4b3d85e5c64fa2512361, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:21.973081 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba4157-04e1-4330-8cf1-011e7230e4b5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:22.232829 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1336/2710] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:21 2022] PUT /identity/v3/projects/32ee431b8dfe4c389c578aa6cb26e9c0/users/6cafc52efb4a4b3d85e5c64fa2512361/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:22.244544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c641b-d76f-40f7-ae5e-068c6c5a2bf3 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:22.244837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c641b-d76f-40f7-ae5e-068c6c5a2bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:22.245119 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c641b-d76f-40f7-ae5e-068c6c5a2bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:22.272256 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-335c641b-d76f-40f7-ae5e-068c6c5a2bf3 None None] MFA Rules not processed for user `6cafc52efb4a4b3d85e5c64fa2512361`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:22.273455 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-335c641b-d76f-40f7-ae5e-068c6c5a2bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:22.336085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1375/2711] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:22.346860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba4157-04e1-4330-8cf1-011e7230e4b5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:22.348529 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-29ba4157-04e1-4330-8cf1-011e7230e4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:22.404556 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba4157-04e1-4330-8cf1-011e7230e4b5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:22.408289 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f89e00-31e1-4698-9452-2834e88d86fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:22.408925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f89e00-31e1-4698-9452-2834e88d86fa service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:22.409213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f89e00-31e1-4698-9452-2834e88d86fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:22.409532 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f89e00-31e1-4698-9452-2834e88d86fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:22.417615 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f89e00-31e1-4698-9452-2834e88d86fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:22.419101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f89e00-31e1-4698-9452-2834e88d86fa service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:22.428691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1337/2712] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:30.760558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c641b-d76f-40f7-ae5e-068c6c5a2bf3 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:30.762065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-335c641b-d76f-40f7-ae5e-068c6c5a2bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:30.832945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c641b-d76f-40f7-ae5e-068c6c5a2bf3 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:30.837654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:30.838590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:30.838873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:30.839149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] PATH_INFO: `/v3/users/7c8c8e6ae7994be8a24e50f1fc70762f` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:30.840328 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8c8e6ae7994be8a24e50f1fc70762f)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:30.842423 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:31.055564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8c8e6ae7994be8a24e50f1fc70762f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:31.062308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8c8e6ae7994be8a24e50f1fc70762f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:31.133248 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8c8e6ae7994be8a24e50f1fc70762f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:31.133988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8c8e6ae7994be8a24e50f1fc70762f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:31.146735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8c8e6ae7994be8a24e50f1fc70762f'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:31.152637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1376/2713] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:30 2022] DELETE /identity/v3/users/7c8c8e6ae7994be8a24e50f1fc70762f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:31.406867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f89e00-31e1-4698-9452-2834e88d86fa service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:31.419162 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f89e00-31e1-4698-9452-2834e88d86fa service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:31.476593 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:31.477464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:31.477741 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:31.478016 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] PATH_INFO: `/v3/projects/1d926cf4c2ed494caab20b2a7958c614` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:31.479220 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d926cf4c2ed494caab20b2a7958c614)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:31.481161 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:31.620505 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d926cf4c2ed494caab20b2a7958c614', 'request_id': 'req-ac96e576-c4a1-4994-9d91-28765518d732'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:31.626493 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d926cf4c2ed494caab20b2a7958c614', 'request_id': 'req-ac96e576-c4a1-4994-9d91-28765518d732'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:31.723961 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d926cf4c2ed494caab20b2a7958c614', 'request_id': 'req-ac96e576-c4a1-4994-9d91-28765518d732'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:31.736825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] The token cache is being invalidate because project 1d926cf4c2ed494caab20b2a7958c614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:31.742557 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:31.742557 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:31.742557 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1338/2714] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:31 2022] DELETE /identity/v3/projects/1d926cf4c2ed494caab20b2a7958c614 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:31.744477 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:31.745896 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:31.760877 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a807e1b-dbf6-487c-8ee2-67bee33f4648 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:31.815925 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ab2d1-0f0e-4fb2-9ba5-c3b1253798a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:31.816807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab2d1-0f0e-4fb2-9ba5-c3b1253798a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:31.817095 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab2d1-0f0e-4fb2-9ba5-c3b1253798a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:31.817373 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab2d1-0f0e-4fb2-9ba5-c3b1253798a3 admin admin] PATH_INFO: `/v3/users/3ef0c145c477480a9663955680c74c41` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:31.818604 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ab2d1-0f0e-4fb2-9ba5-c3b1253798a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef0c145c477480a9663955680c74c41)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:31.820507 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ab2d1-0f0e-4fb2-9ba5-c3b1253798a3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:32.086861 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1b1ab2d1-0f0e-4fb2-9ba5-c3b1253798a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef0c145c477480a9663955680c74c41'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:32.093762 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1b1ab2d1-0f0e-4fb2-9ba5-c3b1253798a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef0c145c477480a9663955680c74c41'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:32.209407 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1b1ab2d1-0f0e-4fb2-9ba5-c3b1253798a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef0c145c477480a9663955680c74c41'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:32.209979 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1b1ab2d1-0f0e-4fb2-9ba5-c3b1253798a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef0c145c477480a9663955680c74c41'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:32.223014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1b1ab2d1-0f0e-4fb2-9ba5-c3b1253798a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef0c145c477480a9663955680c74c41'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:32.229075 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1377/2715] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:31 2022] DELETE /identity/v3/users/3ef0c145c477480a9663955680c74c41 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:32.495389 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:32.496953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:32.516043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96e576-c4a1-4994-9d91-28765518d732 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:32.574643 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d20e73-0e6e-4047-bd2c-87d2846b7a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:32.575518 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d20e73-0e6e-4047-bd2c-87d2846b7a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:32.575803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d20e73-0e6e-4047-bd2c-87d2846b7a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:32.576078 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d20e73-0e6e-4047-bd2c-87d2846b7a63 admin admin] PATH_INFO: `/v3/projects/fe021c2bc15d4f9a8cf782dedbd808d2` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:32.577309 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d20e73-0e6e-4047-bd2c-87d2846b7a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe021c2bc15d4f9a8cf782dedbd808d2)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:32.579447 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d20e73-0e6e-4047-bd2c-87d2846b7a63 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:32.701393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-38d20e73-0e6e-4047-bd2c-87d2846b7a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe021c2bc15d4f9a8cf782dedbd808d2', 'request_id': 'req-38d20e73-0e6e-4047-bd2c-87d2846b7a63'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:32.708995 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-38d20e73-0e6e-4047-bd2c-87d2846b7a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe021c2bc15d4f9a8cf782dedbd808d2', 'request_id': 'req-38d20e73-0e6e-4047-bd2c-87d2846b7a63'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:32.861147 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-38d20e73-0e6e-4047-bd2c-87d2846b7a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe021c2bc15d4f9a8cf782dedbd808d2', 'request_id': 'req-38d20e73-0e6e-4047-bd2c-87d2846b7a63'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:32.872640 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-38d20e73-0e6e-4047-bd2c-87d2846b7a63 admin admin] The token cache is being invalidate because project fe021c2bc15d4f9a8cf782dedbd808d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:32.872929 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-38d20e73-0e6e-4047-bd2c-87d2846b7a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:32.873597 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-38d20e73-0e6e-4047-bd2c-87d2846b7a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:32.875438 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1339/2716] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:32 2022] DELETE /identity/v3/projects/fe021c2bc15d4f9a8cf782dedbd808d2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:32.880896 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6cf16-e507-4033-b48b-d2b8df56c217 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:32.881444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6cf16-e507-4033-b48b-d2b8df56c217 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:32.881444 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6cf16-e507-4033-b48b-d2b8df56c217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:32.900478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-95f6cf16-e507-4033-b48b-d2b8df56c217 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:32.901711 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-95f6cf16-e507-4033-b48b-d2b8df56c217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:32.973638 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1378/2717] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:32.983050 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d19bf-6ee6-4a9b-a9ca-d4726a7a10a4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:32.983403 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d19bf-6ee6-4a9b-a9ca-d4726a7a10a4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:32.983803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d19bf-6ee6-4a9b-a9ca-d4726a7a10a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:33.005668 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3c9d19bf-6ee6-4a9b-a9ca-d4726a7a10a4 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:33.006963 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3c9d19bf-6ee6-4a9b-a9ca-d4726a7a10a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:33.015304 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1340/2718] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:33.020027 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6cf16-e507-4033-b48b-d2b8df56c217 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:33.032765 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6cf16-e507-4033-b48b-d2b8df56c217 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:33.036128 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4ba2e-54d1-453e-8a2c-655f4fab9584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:33.036819 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4ba2e-54d1-453e-8a2c-655f4fab9584 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:33.037102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4ba2e-54d1-453e-8a2c-655f4fab9584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:33.037379 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4ba2e-54d1-453e-8a2c-655f4fab9584 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:33.038180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4ba2e-54d1-453e-8a2c-655f4fab9584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:40:33.038544 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4ba2e-54d1-453e-8a2c-655f4fab9584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:33.040160 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4ba2e-54d1-453e-8a2c-655f4fab9584 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:33.053833 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1379/2719] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:40:33.058245 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d19bf-6ee6-4a9b-a9ca-d4726a7a10a4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:33.069586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d19bf-6ee6-4a9b-a9ca-d4726a7a10a4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:33.074760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dc66b-9fe5-4603-afa5-2f68c0647ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:33.075456 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dc66b-9fe5-4603-afa5-2f68c0647ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:33.075747 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dc66b-9fe5-4603-afa5-2f68c0647ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:33.076028 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dc66b-9fe5-4603-afa5-2f68c0647ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:33.076744 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dc66b-9fe5-4603-afa5-2f68c0647ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:33.078765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dc66b-9fe5-4603-afa5-2f68c0647ba9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:33.272889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1341/2720] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:33 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:33.273828 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4ba2e-54d1-453e-8a2c-655f4fab9584 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:33.286421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4ba2e-54d1-453e-8a2c-655f4fab9584 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:33.354127 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b77941-1c0c-4378-84ff-0b5147d6bd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:33.354845 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b77941-1c0c-4378-84ff-0b5147d6bd75 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:33.355148 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b77941-1c0c-4378-84ff-0b5147d6bd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:33.355403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b77941-1c0c-4378-84ff-0b5147d6bd75 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:33.356107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b77941-1c0c-4378-84ff-0b5147d6bd75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:33.358917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b77941-1c0c-4378-84ff-0b5147d6bd75 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:33.544092 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1380/2721] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:33 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:40:33.548336 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dc66b-9fe5-4603-afa5-2f68c0647ba9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:33.563866 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dc66b-9fe5-4603-afa5-2f68c0647ba9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:33.574466 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395a64b-bdac-436e-8748-b922368214dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:33.575151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395a64b-bdac-436e-8748-b922368214dd admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:33.575436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395a64b-bdac-436e-8748-b922368214dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:33.575714 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395a64b-bdac-436e-8748-b922368214dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:33.576443 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395a64b-bdac-436e-8748-b922368214dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:33.578042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395a64b-bdac-436e-8748-b922368214dd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:33.589528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1342/2722] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:40:33.597543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b77941-1c0c-4378-84ff-0b5147d6bd75 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:33.608874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b77941-1c0c-4378-84ff-0b5147d6bd75 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:33.617622 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fa009-999c-46b7-a776-a6fc7f518c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:33.618449 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa009-999c-46b7-a776-a6fc7f518c46 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:33.618798 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa009-999c-46b7-a776-a6fc7f518c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:33.619134 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa009-999c-46b7-a776-a6fc7f518c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:33.619881 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fa009-999c-46b7-a776-a6fc7f518c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:33.621576 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fa009-999c-46b7-a776-a6fc7f518c46 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:33.634126 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1381/2723] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:40:33.641943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395a64b-bdac-436e-8748-b922368214dd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:33.653127 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395a64b-bdac-436e-8748-b922368214dd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:33.657795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ff0dd-8938-448f-b118-e1b871a6bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:33.658702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ff0dd-8938-448f-b118-e1b871a6bb5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:33.658986 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ff0dd-8938-448f-b118-e1b871a6bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:33.659909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ff0dd-8938-448f-b118-e1b871a6bb5d admin admin] PATH_INFO: `/v3/projects/b8cfb967407b4225b01bdbea3dd2cd67/users/6b029ce9bd394d40b057c16d2902c78c/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:33.674890 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ff0dd-8938-448f-b118-e1b871a6bb5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8cfb967407b4225b01bdbea3dd2cd67, user_id=6b029ce9bd394d40b057c16d2902c78c, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:33.677768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ff0dd-8938-448f-b118-e1b871a6bb5d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:33.755439 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1343/2724] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:33 2022] PUT /identity/v3/projects/b8cfb967407b4225b01bdbea3dd2cd67/users/6b029ce9bd394d40b057c16d2902c78c/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:33.766014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7755e9-5bec-4336-94d9-29f1c5e81a76 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:33.766474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7755e9-5bec-4336-94d9-29f1c5e81a76 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:33.766891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7755e9-5bec-4336-94d9-29f1c5e81a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:33.797904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-5f7755e9-5bec-4336-94d9-29f1c5e81a76 None None] MFA Rules not processed for user `6b029ce9bd394d40b057c16d2902c78c`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:33.799272 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-5f7755e9-5bec-4336-94d9-29f1c5e81a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:33.868267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1382/2725] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:33.879617 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ff0dd-8938-448f-b118-e1b871a6bb5d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:33.881410 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7b0ff0dd-8938-448f-b118-e1b871a6bb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:33.940871 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ff0dd-8938-448f-b118-e1b871a6bb5d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:33.944629 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eba458-b5ca-4446-a0b8-92b07324f4b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:33.945281 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eba458-b5ca-4446-a0b8-92b07324f4b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:33.945565 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eba458-b5ca-4446-a0b8-92b07324f4b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:33.945842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eba458-b5ca-4446-a0b8-92b07324f4b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:33.954560 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eba458-b5ca-4446-a0b8-92b07324f4b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:33.958092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eba458-b5ca-4446-a0b8-92b07324f4b2 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:33.968803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1344/2726] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:33.990235 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7755e9-5bec-4336-94d9-29f1c5e81a76 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:34.031531 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eba458-b5ca-4446-a0b8-92b07324f4b2 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:34.033024 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-37eba458-b5ca-4446-a0b8-92b07324f4b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:34.061535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7755e9-5bec-4336-94d9-29f1c5e81a76 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:34.068597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b62bf-adde-4c66-b38f-30d8dd31d1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:34.069479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b62bf-adde-4c66-b38f-30d8dd31d1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:34.069790 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b62bf-adde-4c66-b38f-30d8dd31d1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:34.070066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b62bf-adde-4c66-b38f-30d8dd31d1c3 admin admin] PATH_INFO: `/v3/users/6b029ce9bd394d40b057c16d2902c78c` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:34.073687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b62bf-adde-4c66-b38f-30d8dd31d1c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b029ce9bd394d40b057c16d2902c78c)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:34.075654 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b62bf-adde-4c66-b38f-30d8dd31d1c3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:34.112679 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eba458-b5ca-4446-a0b8-92b07324f4b2 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:34.117214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b45342-f8c2-47de-a1a4-d6eb528a1d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:34.118089 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45342-f8c2-47de-a1a4-d6eb528a1d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:34.118414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45342-f8c2-47de-a1a4-d6eb528a1d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:34.118694 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45342-f8c2-47de-a1a4-d6eb528a1d6a admin admin] PATH_INFO: `/v3/users/6cafc52efb4a4b3d85e5c64fa2512361` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:34.119905 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b45342-f8c2-47de-a1a4-d6eb528a1d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cafc52efb4a4b3d85e5c64fa2512361)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:34.121864 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b45342-f8c2-47de-a1a4-d6eb528a1d6a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:34.350234 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8b2b62bf-adde-4c66-b38f-30d8dd31d1c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b029ce9bd394d40b057c16d2902c78c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:34.354101 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-78b45342-f8c2-47de-a1a4-d6eb528a1d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cafc52efb4a4b3d85e5c64fa2512361'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:34.359114 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8b2b62bf-adde-4c66-b38f-30d8dd31d1c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b029ce9bd394d40b057c16d2902c78c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:34.361541 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-78b45342-f8c2-47de-a1a4-d6eb528a1d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cafc52efb4a4b3d85e5c64fa2512361'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:34.362339 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-78b45342-f8c2-47de-a1a4-d6eb528a1d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cafc52efb4a4b3d85e5c64fa2512361'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:34.363990 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-78b45342-f8c2-47de-a1a4-d6eb528a1d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cafc52efb4a4b3d85e5c64fa2512361'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:34.376916 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-78b45342-f8c2-47de-a1a4-d6eb528a1d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cafc52efb4a4b3d85e5c64fa2512361'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:34.466689 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8b2b62bf-adde-4c66-b38f-30d8dd31d1c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b029ce9bd394d40b057c16d2902c78c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:34.467320 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8b2b62bf-adde-4c66-b38f-30d8dd31d1c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b029ce9bd394d40b057c16d2902c78c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:34.481034 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-8b2b62bf-adde-4c66-b38f-30d8dd31d1c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b029ce9bd394d40b057c16d2902c78c'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:34.488289 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1383/2727] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:33 2022] DELETE /identity/v3/users/6b029ce9bd394d40b057c16d2902c78c => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:34.492806 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebf5f4-4218-4de2-a067-8aa5e1374579 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:34.493096 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebf5f4-4218-4de2-a067-8aa5e1374579 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:34.493386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebf5f4-4218-4de2-a067-8aa5e1374579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:34.512736 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-eaebf5f4-4218-4de2-a067-8aa5e1374579 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:34.514086 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-eaebf5f4-4218-4de2-a067-8aa5e1374579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:34.573978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1384/2728] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:34.584816 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebf5f4-4218-4de2-a067-8aa5e1374579 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:34.586238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-eaebf5f4-4218-4de2-a067-8aa5e1374579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:34.604296 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1345/2729] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:34 2022] DELETE /identity/v3/users/6cafc52efb4a4b3d85e5c64fa2512361 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:34.611589 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd9ae7-7c7b-49a1-bae0-24939c04ecff None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:34.611887 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd9ae7-7c7b-49a1-bae0-24939c04ecff None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:34.612192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd9ae7-7c7b-49a1-bae0-24939c04ecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:34.629062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b4fd9ae7-7c7b-49a1-bae0-24939c04ecff None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:34.630290 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b4fd9ae7-7c7b-49a1-bae0-24939c04ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:34.647511 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebf5f4-4218-4de2-a067-8aa5e1374579 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:34.700842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1346/2730] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:34.701077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8a768-7adf-4cd7-ad6a-6641d7b62b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:34.701764 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8a768-7adf-4cd7-ad6a-6641d7b62b3a service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:34.702047 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8a768-7adf-4cd7-ad6a-6641d7b62b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:34.702422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8a768-7adf-4cd7-ad6a-6641d7b62b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:34.712687 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd9ae7-7c7b-49a1-bae0-24939c04ecff None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:34.717079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8a768-7adf-4cd7-ad6a-6641d7b62b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:34.717079 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8a768-7adf-4cd7-ad6a-6641d7b62b3a service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:34.723469 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd9ae7-7c7b-49a1-bae0-24939c04ecff None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:34.724904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1385/2731] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:40:34.728899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae8cfc-d3d8-410b-a778-59e73fd61076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:34.729576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae8cfc-d3d8-410b-a778-59e73fd61076 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:34.729856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae8cfc-d3d8-410b-a778-59e73fd61076 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:34.730128 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae8cfc-d3d8-410b-a778-59e73fd61076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:34.739792 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae8cfc-d3d8-410b-a778-59e73fd61076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:34.741213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae8cfc-d3d8-410b-a778-59e73fd61076 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:34.751909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1347/2732] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:40:35.268189 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8a768-7adf-4cd7-ad6a-6641d7b62b3a service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:35.274131 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-74e8a768-7adf-4cd7-ad6a-6641d7b62b3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:35.293509 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8a768-7adf-4cd7-ad6a-6641d7b62b3a service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:35.298962 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1aa0b-442e-4240-8045-4aa968e55032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:35.308832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1aa0b-442e-4240-8045-4aa968e55032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:35.308832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1aa0b-442e-4240-8045-4aa968e55032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:35.308832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1aa0b-442e-4240-8045-4aa968e55032 admin admin] PATH_INFO: `/v3/projects/32ee431b8dfe4c389c578aa6cb26e9c0` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:35.308832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1aa0b-442e-4240-8045-4aa968e55032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ee431b8dfe4c389c578aa6cb26e9c0)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:35.308832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1aa0b-442e-4240-8045-4aa968e55032 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:35.366547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae8cfc-d3d8-410b-a778-59e73fd61076 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:35.368176 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-48ae8cfc-d3d8-410b-a778-59e73fd61076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:35.383870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae8cfc-d3d8-410b-a778-59e73fd61076 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:35.388598 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb73dc7-073a-48c8-9886-842fe147e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:35.389430 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb73dc7-073a-48c8-9886-842fe147e591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:35.389720 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb73dc7-073a-48c8-9886-842fe147e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:35.389997 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb73dc7-073a-48c8-9886-842fe147e591 admin admin] PATH_INFO: `/v3/projects/b8cfb967407b4225b01bdbea3dd2cd67` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:35.391213 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb73dc7-073a-48c8-9886-842fe147e591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8cfb967407b4225b01bdbea3dd2cd67)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:35.393179 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb73dc7-073a-48c8-9886-842fe147e591 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:35.418171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c4b1aa0b-442e-4240-8045-4aa968e55032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ee431b8dfe4c389c578aa6cb26e9c0', 'request_id': 'req-c4b1aa0b-442e-4240-8045-4aa968e55032'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:35.425327 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c4b1aa0b-442e-4240-8045-4aa968e55032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ee431b8dfe4c389c578aa6cb26e9c0', 'request_id': 'req-c4b1aa0b-442e-4240-8045-4aa968e55032'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:35.524455 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-acb73dc7-073a-48c8-9886-842fe147e591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8cfb967407b4225b01bdbea3dd2cd67', 'request_id': 'req-acb73dc7-073a-48c8-9886-842fe147e591'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:35.529426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c4b1aa0b-442e-4240-8045-4aa968e55032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ee431b8dfe4c389c578aa6cb26e9c0', 'request_id': 'req-c4b1aa0b-442e-4240-8045-4aa968e55032'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:35.530556 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-acb73dc7-073a-48c8-9886-842fe147e591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8cfb967407b4225b01bdbea3dd2cd67', 'request_id': 'req-acb73dc7-073a-48c8-9886-842fe147e591'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:35.541538 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c4b1aa0b-442e-4240-8045-4aa968e55032 admin admin] The token cache is being invalidate because project 32ee431b8dfe4c389c578aa6cb26e9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:35.541826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c4b1aa0b-442e-4240-8045-4aa968e55032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:35.542495 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-c4b1aa0b-442e-4240-8045-4aa968e55032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:35.544036 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1386/2733] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:35 2022] DELETE /identity/v3/projects/32ee431b8dfe4c389c578aa6cb26e9c0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:35.621402 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-acb73dc7-073a-48c8-9886-842fe147e591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8cfb967407b4225b01bdbea3dd2cd67', 'request_id': 'req-acb73dc7-073a-48c8-9886-842fe147e591'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:35.634120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-acb73dc7-073a-48c8-9886-842fe147e591 admin admin] The token cache is being invalidate because project b8cfb967407b4225b01bdbea3dd2cd67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:35.634596 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-acb73dc7-073a-48c8-9886-842fe147e591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:35.635484 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-acb73dc7-073a-48c8-9886-842fe147e591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:35.637163 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1348/2734] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:35 2022] DELETE /identity/v3/projects/b8cfb967407b4225b01bdbea3dd2cd67 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:35.642271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62738956-4bd7-4219-85c7-6f0d64e58dda None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:35.642705 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62738956-4bd7-4219-85c7-6f0d64e58dda None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:35.643048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62738956-4bd7-4219-85c7-6f0d64e58dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:35.664369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-62738956-4bd7-4219-85c7-6f0d64e58dda None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:35.665597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-62738956-4bd7-4219-85c7-6f0d64e58dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:35.737871 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1387/2735] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:35.746246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003380ed-27b0-4ec2-8e43-29d1027ee1fa None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:35.746597 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003380ed-27b0-4ec2-8e43-29d1027ee1fa None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:35.746883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003380ed-27b0-4ec2-8e43-29d1027ee1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:35.768305 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-003380ed-27b0-4ec2-8e43-29d1027ee1fa None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:35.770981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-003380ed-27b0-4ec2-8e43-29d1027ee1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:35.782810 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1349/2736] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:35.787588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62738956-4bd7-4219-85c7-6f0d64e58dda None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:35.798238 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62738956-4bd7-4219-85c7-6f0d64e58dda None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:35.803383 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6041d-4bd0-4215-9eb7-99c461f02cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:35.804074 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6041d-4bd0-4215-9eb7-99c461f02cef admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:35.804388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6041d-4bd0-4215-9eb7-99c461f02cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:35.804663 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6041d-4bd0-4215-9eb7-99c461f02cef admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:35.805451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6041d-4bd0-4215-9eb7-99c461f02cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:40:35.805738 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6041d-4bd0-4215-9eb7-99c461f02cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:35.807372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6041d-4bd0-4215-9eb7-99c461f02cef admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:35.820380 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1388/2737] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:40:35.832819 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003380ed-27b0-4ec2-8e43-29d1027ee1fa None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:35.842248 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003380ed-27b0-4ec2-8e43-29d1027ee1fa None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:35.846999 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73bdd5-9c4d-4448-9136-4889ccd99785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:35.847769 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73bdd5-9c4d-4448-9136-4889ccd99785 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:35.848055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73bdd5-9c4d-4448-9136-4889ccd99785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:35.848332 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73bdd5-9c4d-4448-9136-4889ccd99785 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:35.849016 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73bdd5-9c4d-4448-9136-4889ccd99785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:35.850942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73bdd5-9c4d-4448-9136-4889ccd99785 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:35.974837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1350/2738] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:35 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:40:35.978985 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6041d-4bd0-4215-9eb7-99c461f02cef admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:35.990067 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6041d-4bd0-4215-9eb7-99c461f02cef admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:36.046632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f681d-5a83-415f-b0fc-54b869d114ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:36.047298 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f681d-5a83-415f-b0fc-54b869d114ab admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:36.047582 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f681d-5a83-415f-b0fc-54b869d114ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:36.047855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f681d-5a83-415f-b0fc-54b869d114ab admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:36.048538 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f681d-5a83-415f-b0fc-54b869d114ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:36.051102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f681d-5a83-415f-b0fc-54b869d114ab admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:36.129686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1389/2739] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:35 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:36.133892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73bdd5-9c4d-4448-9136-4889ccd99785 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:36.144344 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73bdd5-9c4d-4448-9136-4889ccd99785 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:36.149022 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5718b-3e0b-466b-9895-f418248bc081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:36.149664 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5718b-3e0b-466b-9895-f418248bc081 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:36.149945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5718b-3e0b-466b-9895-f418248bc081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:36.150219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5718b-3e0b-466b-9895-f418248bc081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:36.154663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5718b-3e0b-466b-9895-f418248bc081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:36.154663 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5718b-3e0b-466b-9895-f418248bc081 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:36.163143 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1351/2740] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:40:36.167152 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f681d-5a83-415f-b0fc-54b869d114ab admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:36.177997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f681d-5a83-415f-b0fc-54b869d114ab admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:36.182744 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca42ed-2cdc-45b2-838f-e918afd50472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:36.183388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca42ed-2cdc-45b2-838f-e918afd50472 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:36.183672 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca42ed-2cdc-45b2-838f-e918afd50472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:36.183946 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca42ed-2cdc-45b2-838f-e918afd50472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:36.184667 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca42ed-2cdc-45b2-838f-e918afd50472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:36.186542 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca42ed-2cdc-45b2-838f-e918afd50472 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:36.197044 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1390/2741] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:40:36.201214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5718b-3e0b-466b-9895-f418248bc081 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:36.211675 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5718b-3e0b-466b-9895-f418248bc081 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:36.216393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06347f47-1a87-4803-a82e-526d1524ba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:36.217314 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06347f47-1a87-4803-a82e-526d1524ba5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:36.217624 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06347f47-1a87-4803-a82e-526d1524ba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:36.217907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06347f47-1a87-4803-a82e-526d1524ba5c admin admin] PATH_INFO: `/v3/projects/cd0c7a136297477385f6ef8679652b03/users/99d9f5aba16547e7899b44dea2fdc2fb/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:36.232628 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06347f47-1a87-4803-a82e-526d1524ba5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0c7a136297477385f6ef8679652b03, user_id=99d9f5aba16547e7899b44dea2fdc2fb, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:36.235299 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06347f47-1a87-4803-a82e-526d1524ba5c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:36.347736 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1352/2742] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:36 2022] PUT /identity/v3/projects/cd0c7a136297477385f6ef8679652b03/users/99d9f5aba16547e7899b44dea2fdc2fb/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:36.358719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970b75-ed0b-42d9-bb95-ec7174ea2ba5 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:36.359215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970b75-ed0b-42d9-bb95-ec7174ea2ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:36.359447 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970b75-ed0b-42d9-bb95-ec7174ea2ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:36.388229 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-46970b75-ed0b-42d9-bb95-ec7174ea2ba5 None None] MFA Rules not processed for user `99d9f5aba16547e7899b44dea2fdc2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:36.389453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-46970b75-ed0b-42d9-bb95-ec7174ea2ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:36.452138 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1391/2743] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:36.457174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06347f47-1a87-4803-a82e-526d1524ba5c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:36.520007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06347f47-1a87-4803-a82e-526d1524ba5c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:36.524587 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32e477-a864-49d5-b8ac-9cb504dc067a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:36.527828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32e477-a864-49d5-b8ac-9cb504dc067a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:36.527828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32e477-a864-49d5-b8ac-9cb504dc067a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:36.527828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32e477-a864-49d5-b8ac-9cb504dc067a admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:36.527828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32e477-a864-49d5-b8ac-9cb504dc067a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:36.528344 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32e477-a864-49d5-b8ac-9cb504dc067a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:36.656545 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1353/2744] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:36 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:40:36.661637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46970b75-ed0b-42d9-bb95-ec7174ea2ba5 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:36.671993 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46970b75-ed0b-42d9-bb95-ec7174ea2ba5 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:36.725896 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabc899-ae8a-479b-8bf0-1527b43fb3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:36.726590 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabc899-ae8a-479b-8bf0-1527b43fb3eb admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:36.726872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabc899-ae8a-479b-8bf0-1527b43fb3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:36.727143 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabc899-ae8a-479b-8bf0-1527b43fb3eb admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:36.727825 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabc899-ae8a-479b-8bf0-1527b43fb3eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:36.729734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabc899-ae8a-479b-8bf0-1527b43fb3eb admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:36.868085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1392/2745] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:36 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:36.869298 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32e477-a864-49d5-b8ac-9cb504dc067a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:36.880323 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32e477-a864-49d5-b8ac-9cb504dc067a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:36.885577 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef452111-6dc0-47af-9f31-ebfc38708087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:36.886234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef452111-6dc0-47af-9f31-ebfc38708087 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:36.886553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef452111-6dc0-47af-9f31-ebfc38708087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:36.886835 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef452111-6dc0-47af-9f31-ebfc38708087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:36.887552 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef452111-6dc0-47af-9f31-ebfc38708087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:36.889142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef452111-6dc0-47af-9f31-ebfc38708087 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:36.900099 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1354/2746] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:40:36.904276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabc899-ae8a-479b-8bf0-1527b43fb3eb admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:36.915368 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabc899-ae8a-479b-8bf0-1527b43fb3eb admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:36.925324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebdd9e-6b01-4d4f-998d-d8ddfc2daec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:36.925324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebdd9e-6b01-4d4f-998d-d8ddfc2daec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:36.925324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebdd9e-6b01-4d4f-998d-d8ddfc2daec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:36.925324 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebdd9e-6b01-4d4f-998d-d8ddfc2daec1 admin admin] PATH_INFO: `/v3/projects/3459dd9fd04b4c299bd7bab4fa8e8583/users/23fdab83445949f99a1341590cbdea4a/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:36.936367 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebdd9e-6b01-4d4f-998d-d8ddfc2daec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3459dd9fd04b4c299bd7bab4fa8e8583, user_id=23fdab83445949f99a1341590cbdea4a, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:36.939108 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebdd9e-6b01-4d4f-998d-d8ddfc2daec1 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:37.042209 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1393/2747] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:36 2022] PUT /identity/v3/projects/3459dd9fd04b4c299bd7bab4fa8e8583/users/23fdab83445949f99a1341590cbdea4a/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:37.046152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef452111-6dc0-47af-9f31-ebfc38708087 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:37.056118 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef452111-6dc0-47af-9f31-ebfc38708087 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:37.115414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc84e7-393f-40e7-b3fa-da54199493fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:37.116084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc84e7-393f-40e7-b3fa-da54199493fb admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:37.116369 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc84e7-393f-40e7-b3fa-da54199493fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:37.116647 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc84e7-393f-40e7-b3fa-da54199493fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:37.117359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc84e7-393f-40e7-b3fa-da54199493fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:37.119008 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc84e7-393f-40e7-b3fa-da54199493fb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:37.129793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1355/2748] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:40:37.133800 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebdd9e-6b01-4d4f-998d-d8ddfc2daec1 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:37.144687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebdd9e-6b01-4d4f-998d-d8ddfc2daec1 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:37.149483 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028dc76-a38c-4f41-bfde-94a0c900d50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:37.150386 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028dc76-a38c-4f41-bfde-94a0c900d50a admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:37.150671 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028dc76-a38c-4f41-bfde-94a0c900d50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:37.150939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028dc76-a38c-4f41-bfde-94a0c900d50a admin admin] PATH_INFO: `/v3/projects/3459dd9fd04b4c299bd7bab4fa8e8583/users/23fdab83445949f99a1341590cbdea4a/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:37.152864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028dc76-a38c-4f41-bfde-94a0c900d50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3459dd9fd04b4c299bd7bab4fa8e8583, user_id=23fdab83445949f99a1341590cbdea4a, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:37.155527 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028dc76-a38c-4f41-bfde-94a0c900d50a admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:37.165499 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1394/2749] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:37 2022] PUT /identity/v3/projects/3459dd9fd04b4c299bd7bab4fa8e8583/users/23fdab83445949f99a1341590cbdea4a/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:37.176214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a29127-d0be-4be6-9365-4918e71b8a9b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:37.176509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a29127-d0be-4be6-9365-4918e71b8a9b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:37.176825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a29127-d0be-4be6-9365-4918e71b8a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:37.203822 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-72a29127-d0be-4be6-9365-4918e71b8a9b None None] MFA Rules not processed for user `23fdab83445949f99a1341590cbdea4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:37.205062 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-72a29127-d0be-4be6-9365-4918e71b8a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:37.271631 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1356/2750] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:37.282595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028dc76-a38c-4f41-bfde-94a0c900d50a admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:37.284241 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c028dc76-a38c-4f41-bfde-94a0c900d50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:37.342145 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028dc76-a38c-4f41-bfde-94a0c900d50a admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:37.345746 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dee83-a6ad-4bb3-80a6-b034d25679b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:37.346431 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dee83-a6ad-4bb3-80a6-b034d25679b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:37.346857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dee83-a6ad-4bb3-80a6-b034d25679b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:37.347311 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dee83-a6ad-4bb3-80a6-b034d25679b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:37.401954 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54dee83-a6ad-4bb3-80a6-b034d25679b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:37.403439 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54dee83-a6ad-4bb3-80a6-b034d25679b6 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:37.412448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1395/2751] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:38.240016 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a29127-d0be-4be6-9365-4918e71b8a9b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:38.241912 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-72a29127-d0be-4be6-9365-4918e71b8a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:38.302214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a29127-d0be-4be6-9365-4918e71b8a9b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:38.305814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719affe-33ad-4740-ad86-9e5c6c0c0f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:38.306490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719affe-33ad-4740-ad86-9e5c6c0c0f97 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:38.306779 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719affe-33ad-4740-ad86-9e5c6c0c0f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:38.307058 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719affe-33ad-4740-ad86-9e5c6c0c0f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:38.308815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4719affe-33ad-4740-ad86-9e5c6c0c0f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:38.370523 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719affe-33ad-4740-ad86-9e5c6c0c0f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:38.372053 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719affe-33ad-4740-ad86-9e5c6c0c0f97 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:38.382146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1357/2752] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:40.572633 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dee83-a6ad-4bb3-80a6-b034d25679b6 service cinder] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:40.584648 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dee83-a6ad-4bb3-80a6-b034d25679b6 service cinder] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:40.590021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:40.590947 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:40.591231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:40.591503 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] PATH_INFO: `/v3/users/99d9f5aba16547e7899b44dea2fdc2fb` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:40.592688 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d9f5aba16547e7899b44dea2fdc2fb)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:40.594650 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:40.832263 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d9f5aba16547e7899b44dea2fdc2fb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:40.839939 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d9f5aba16547e7899b44dea2fdc2fb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:40.929228 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d9f5aba16547e7899b44dea2fdc2fb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:40.929870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d9f5aba16547e7899b44dea2fdc2fb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:40.943024 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d9f5aba16547e7899b44dea2fdc2fb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:40.950247 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1396/2753] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:40 2022] DELETE /identity/v3/users/99d9f5aba16547e7899b44dea2fdc2fb => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:40.954536 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e863f-de4a-4e3d-91a2-e0af1f4d3e55 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:40.955041 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e863f-de4a-4e3d-91a2-e0af1f4d3e55 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:40.955142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e863f-de4a-4e3d-91a2-e0af1f4d3e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:40.974660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bf0e863f-de4a-4e3d-91a2-e0af1f4d3e55 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:40.975899 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bf0e863f-de4a-4e3d-91a2-e0af1f4d3e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:41.044066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1358/2754] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:41.054733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:41.057305 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:41.118772 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23825da-656c-4f35-b4a9-eaf024c83b00 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:41.122856 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4abb1-dd88-4b56-bd50-751b7871f867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:41.123908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4abb1-dd88-4b56-bd50-751b7871f867 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:41.124555 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4abb1-dd88-4b56-bd50-751b7871f867 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:41.125049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4abb1-dd88-4b56-bd50-751b7871f867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:41.142632 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4abb1-dd88-4b56-bd50-751b7871f867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:41.145350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4abb1-dd88-4b56-bd50-751b7871f867 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:41.163191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1397/2755] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:41.740691 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e863f-de4a-4e3d-91a2-e0af1f4d3e55 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:41.741584 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bf0e863f-de4a-4e3d-91a2-e0af1f4d3e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:41.758897 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e863f-de4a-4e3d-91a2-e0af1f4d3e55 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:41.764214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:41.765333 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:41.765781 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:41.766220 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] PATH_INFO: `/v3/projects/cd0c7a136297477385f6ef8679652b03` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:41.769012 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0c7a136297477385f6ef8679652b03)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:41.771693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:41.914570 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0c7a136297477385f6ef8679652b03', 'request_id': 'req-5701f264-759c-49bf-8fc2-e9d5901b2b3c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:41.920820 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0c7a136297477385f6ef8679652b03', 'request_id': 'req-5701f264-759c-49bf-8fc2-e9d5901b2b3c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:41.992531 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0c7a136297477385f6ef8679652b03', 'request_id': 'req-5701f264-759c-49bf-8fc2-e9d5901b2b3c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:42.003791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] The token cache is being invalidate because project cd0c7a136297477385f6ef8679652b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:42.004286 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:42.004932 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:42.006506 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1359/2756] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:41 2022] DELETE /identity/v3/projects/cd0c7a136297477385f6ef8679652b03 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:42.010536 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4abb1-dd88-4b56-bd50-751b7871f867 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:42.020231 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4abb1-dd88-4b56-bd50-751b7871f867 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:42.081793 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:42.082733 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:42.083017 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:42.083293 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] PATH_INFO: `/v3/users/23fdab83445949f99a1341590cbdea4a` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:42.084494 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23fdab83445949f99a1341590cbdea4a)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:42.086430 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:42.309598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23fdab83445949f99a1341590cbdea4a'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:42.316997 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23fdab83445949f99a1341590cbdea4a'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:42.341652 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:42.342958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:42.357242 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701f264-759c-49bf-8fc2-e9d5901b2b3c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:42.362348 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:42.367296 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:42.367296 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:42.367296 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] PATH_INFO: `/v3/users/82f193153bf04ff8b39a9ecf3da423ce` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:42.367296 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f193153bf04ff8b39a9ecf3da423ce)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:42.368535 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:42.407438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23fdab83445949f99a1341590cbdea4a'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:42.407438 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23fdab83445949f99a1341590cbdea4a'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:42.418361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23fdab83445949f99a1341590cbdea4a'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:42.424912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1398/2757] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:42 2022] DELETE /identity/v3/users/23fdab83445949f99a1341590cbdea4a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:42.640264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f193153bf04ff8b39a9ecf3da423ce'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:42.647742 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f193153bf04ff8b39a9ecf3da423ce'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:42.648417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f193153bf04ff8b39a9ecf3da423ce'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:42.649032 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f193153bf04ff8b39a9ecf3da423ce'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:42.663329 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f193153bf04ff8b39a9ecf3da423ce'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:42.747098 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1360/2758] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:40:42 2022] DELETE /identity/v3/users/82f193153bf04ff8b39a9ecf3da423ce => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:42.885388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:42.887003 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:42.959012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0145d4-17fc-4699-8965-6d2bac8ba703 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.000585 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.002045 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:43.016478 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a21f7d-78d0-46e8-8e7d-527a9433f925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.017493 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a21f7d-78d0-46e8-8e7d-527a9433f925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.017772 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a21f7d-78d0-46e8-8e7d-527a9433f925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.018042 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a21f7d-78d0-46e8-8e7d-527a9433f925 admin admin] PATH_INFO: `/v3/projects/3459dd9fd04b4c299bd7bab4fa8e8583` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.019908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a21f7d-78d0-46e8-8e7d-527a9433f925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3459dd9fd04b4c299bd7bab4fa8e8583)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.021757 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a21f7d-78d0-46e8-8e7d-527a9433f925 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.072537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621c3b5-a91e-4877-a648-b7ffe1a5ccac admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.077031 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.077877 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.078157 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.078463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4 admin admin] PATH_INFO: `/v3/projects/bedb0fa11b034325ad09ea0ec7f8e288` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.079627 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bedb0fa11b034325ad09ea0ec7f8e288)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.082171 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.124370 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-90a21f7d-78d0-46e8-8e7d-527a9433f925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3459dd9fd04b4c299bd7bab4fa8e8583', 'request_id': 'req-90a21f7d-78d0-46e8-8e7d-527a9433f925'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:43.131106 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-90a21f7d-78d0-46e8-8e7d-527a9433f925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3459dd9fd04b4c299bd7bab4fa8e8583', 'request_id': 'req-90a21f7d-78d0-46e8-8e7d-527a9433f925'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:43.203948 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bedb0fa11b034325ad09ea0ec7f8e288', 'request_id': 'req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:43.210698 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bedb0fa11b034325ad09ea0ec7f8e288', 'request_id': 'req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:43.220868 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-90a21f7d-78d0-46e8-8e7d-527a9433f925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3459dd9fd04b4c299bd7bab4fa8e8583', 'request_id': 'req-90a21f7d-78d0-46e8-8e7d-527a9433f925'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:43.232479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-90a21f7d-78d0-46e8-8e7d-527a9433f925 admin admin] The token cache is being invalidate because project 3459dd9fd04b4c299bd7bab4fa8e8583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:43.232775 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-90a21f7d-78d0-46e8-8e7d-527a9433f925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:43.233416 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-90a21f7d-78d0-46e8-8e7d-527a9433f925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:43.235049 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1399/2759] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:42 2022] DELETE /identity/v3/projects/3459dd9fd04b4c299bd7bab4fa8e8583 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:43.239885 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e723a6-65bb-41ad-9c7e-dd9ebe1c1b12 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.240177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e723a6-65bb-41ad-9c7e-dd9ebe1c1b12 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.240462 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e723a6-65bb-41ad-9c7e-dd9ebe1c1b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.258783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-f0e723a6-65bb-41ad-9c7e-dd9ebe1c1b12 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:43.260055 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-f0e723a6-65bb-41ad-9c7e-dd9ebe1c1b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:43.296005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bedb0fa11b034325ad09ea0ec7f8e288', 'request_id': 'req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:43.307007 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4 admin admin] The token cache is being invalidate because project bedb0fa11b034325ad09ea0ec7f8e288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:40:43.307400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:43.308132 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4fc18b56-bb82-4d3f-8ee0-75f5c90836f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:40:43.309828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1361/2760] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:40:42 2022] DELETE /identity/v3/projects/bedb0fa11b034325ad09ea0ec7f8e288 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:43.315042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714b12-cf52-4780-98d3-f6024f667855 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.315330 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714b12-cf52-4780-98d3-f6024f667855 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.316175 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714b12-cf52-4780-98d3-f6024f667855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.319523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1400/2761] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:43.327492 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f02cf7-cd6a-433e-b84e-6ca80ba8280a None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.327788 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f02cf7-cd6a-433e-b84e-6ca80ba8280a None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.328127 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f02cf7-cd6a-433e-b84e-6ca80ba8280a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.336440 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e9714b12-cf52-4780-98d3-f6024f667855 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:43.337645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e9714b12-cf52-4780-98d3-f6024f667855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:43.345779 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1362/2762] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:43.347144 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a4f02cf7-cd6a-433e-b84e-6ca80ba8280a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:43.348421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a4f02cf7-cd6a-433e-b84e-6ca80ba8280a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:43.353517 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992adc99-60d0-474e-b8f4-4e96175c204a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.353947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992adc99-60d0-474e-b8f4-4e96175c204a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.354232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992adc99-60d0-474e-b8f4-4e96175c204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.356322 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1401/2763] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:43.360279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f02cf7-cd6a-433e-b84e-6ca80ba8280a None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.369953 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f02cf7-cd6a-433e-b84e-6ca80ba8280a None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.372693 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-992adc99-60d0-474e-b8f4-4e96175c204a None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:43.373867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-992adc99-60d0-474e-b8f4-4e96175c204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:43.374602 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6d87e-9b92-4722-8a4c-3b45a9ea9375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.375255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6d87e-9b92-4722-8a4c-3b45a9ea9375 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.375535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6d87e-9b92-4722-8a4c-3b45a9ea9375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.375810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6d87e-9b92-4722-8a4c-3b45a9ea9375 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.376531 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6d87e-9b92-4722-8a4c-3b45a9ea9375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:40:43.376837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6d87e-9b92-4722-8a4c-3b45a9ea9375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.379103 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6d87e-9b92-4722-8a4c-3b45a9ea9375 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.382847 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1363/2764] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:43.387034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992adc99-60d0-474e-b8f4-4e96175c204a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.394489 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1402/2765] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:40:43.395561 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6d87e-9b92-4722-8a4c-3b45a9ea9375 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.396324 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992adc99-60d0-474e-b8f4-4e96175c204a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.403479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bf3cb-fa44-47f4-9415-1d53b47a2367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.407804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf3cb-fa44-47f4-9415-1d53b47a2367 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.407804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf3cb-fa44-47f4-9415-1d53b47a2367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.407804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf3cb-fa44-47f4-9415-1d53b47a2367 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.407804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bf3cb-fa44-47f4-9415-1d53b47a2367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:40:43.407804 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bf3cb-fa44-47f4-9415-1d53b47a2367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.408806 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bf3cb-fa44-47f4-9415-1d53b47a2367 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.409843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6d87e-9b92-4722-8a4c-3b45a9ea9375 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.416769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cd681-9516-4b58-8c08-3885e53c53c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.417915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd681-9516-4b58-8c08-3885e53c53c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.418443 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd681-9516-4b58-8c08-3885e53c53c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.419388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd681-9516-4b58-8c08-3885e53c53c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.420351 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cd681-9516-4b58-8c08-3885e53c53c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.424579 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cd681-9516-4b58-8c08-3885e53c53c0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.432938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1364/2766] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:40:43.432938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bf3cb-fa44-47f4-9415-1d53b47a2367 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.432938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ea7bf3cb-fa44-47f4-9415-1d53b47a2367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:43.489394 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bf3cb-fa44-47f4-9415-1d53b47a2367 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.492921 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002f327-c7f4-4ecb-aacc-22c5036082bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.493554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002f327-c7f4-4ecb-aacc-22c5036082bb service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.493834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002f327-c7f4-4ecb-aacc-22c5036082bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.494107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002f327-c7f4-4ecb-aacc-22c5036082bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.495890 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4002f327-c7f4-4ecb-aacc-22c5036082bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:43.554112 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002f327-c7f4-4ecb-aacc-22c5036082bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.555573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002f327-c7f4-4ecb-aacc-22c5036082bb service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.564868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1365/2767] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:43.566228 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002f327-c7f4-4ecb-aacc-22c5036082bb service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.577195 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002f327-c7f4-4ecb-aacc-22c5036082bb service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.577815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1403/2768] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:43 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:40:43.583066 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cd681-9516-4b58-8c08-3885e53c53c0 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.637683 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9665ae-8b19-4db3-b1df-4f81d4720800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.638504 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9665ae-8b19-4db3-b1df-4f81d4720800 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.638856 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9665ae-8b19-4db3-b1df-4f81d4720800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.639200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9665ae-8b19-4db3-b1df-4f81d4720800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.639950 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9665ae-8b19-4db3-b1df-4f81d4720800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.641910 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9665ae-8b19-4db3-b1df-4f81d4720800 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.646794 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cd681-9516-4b58-8c08-3885e53c53c0 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.651625 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea6bc4-a3c0-41d7-91b3-55933d5c12d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.652378 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea6bc4-a3c0-41d7-91b3-55933d5c12d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.652735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea6bc4-a3c0-41d7-91b3-55933d5c12d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.653190 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea6bc4-a3c0-41d7-91b3-55933d5c12d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.653901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea6bc4-a3c0-41d7-91b3-55933d5c12d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.655899 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea6bc4-a3c0-41d7-91b3-55933d5c12d3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.725942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1366/2769] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:40:43 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:40:43.729993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9665ae-8b19-4db3-b1df-4f81d4720800 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.766807 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1404/2770] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:43 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:43.772919 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea6bc4-a3c0-41d7-91b3-55933d5c12d3 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.785054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea6bc4-a3c0-41d7-91b3-55933d5c12d3 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.796855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9665ae-8b19-4db3-b1df-4f81d4720800 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.802385 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5969e-269f-4c37-bb81-3de513fc8c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.803089 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5969e-269f-4c37-bb81-3de513fc8c04 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.803383 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5969e-269f-4c37-bb81-3de513fc8c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.803671 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5969e-269f-4c37-bb81-3de513fc8c04 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.804372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5969e-269f-4c37-bb81-3de513fc8c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.806340 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5969e-269f-4c37-bb81-3de513fc8c04 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.843915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0584d9f-7de1-4232-ad7e-d36eb573a51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.844592 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0584d9f-7de1-4232-ad7e-d36eb573a51c admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.844876 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0584d9f-7de1-4232-ad7e-d36eb573a51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.845149 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0584d9f-7de1-4232-ad7e-d36eb573a51c admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.845889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0584d9f-7de1-4232-ad7e-d36eb573a51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.848315 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0584d9f-7de1-4232-ad7e-d36eb573a51c admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.858831 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1405/2771] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:43.863265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0584d9f-7de1-4232-ad7e-d36eb573a51c admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.872945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0584d9f-7de1-4232-ad7e-d36eb573a51c admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.878215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea6582-53e7-4aec-9a26-edf2fac5e2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.878992 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea6582-53e7-4aec-9a26-edf2fac5e2da admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.879254 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea6582-53e7-4aec-9a26-edf2fac5e2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.879535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea6582-53e7-4aec-9a26-edf2fac5e2da admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.880262 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea6582-53e7-4aec-9a26-edf2fac5e2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.881857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea6582-53e7-4aec-9a26-edf2fac5e2da admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.885918 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1367/2772] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:40:43 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:40:43.892611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1406/2773] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:40:43.893853 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5969e-269f-4c37-bb81-3de513fc8c04 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.896872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea6582-53e7-4aec-9a26-edf2fac5e2da admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.906462 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5969e-269f-4c37-bb81-3de513fc8c04 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.906815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea6582-53e7-4aec-9a26-edf2fac5e2da admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.913337 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175eef1-016e-4f18-aef7-2f40d3219b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.913759 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a678089-6215-4638-ab3a-1979f166504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.914037 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175eef1-016e-4f18-aef7-2f40d3219b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.914346 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175eef1-016e-4f18-aef7-2f40d3219b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.914629 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175eef1-016e-4f18-aef7-2f40d3219b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.914867 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a678089-6215-4638-ab3a-1979f166504b admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.915177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a678089-6215-4638-ab3a-1979f166504b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.915387 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175eef1-016e-4f18-aef7-2f40d3219b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.915486 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a678089-6215-4638-ab3a-1979f166504b admin admin] PATH_INFO: `/v3/projects/2ddade68228a40148fd090b791d779e3/users/15e992d3253140f896435859fee98974/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.917025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175eef1-016e-4f18-aef7-2f40d3219b76 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.930572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1368/2774] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:40:43.931795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175eef1-016e-4f18-aef7-2f40d3219b76 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.932936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a678089-6215-4638-ab3a-1979f166504b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ddade68228a40148fd090b791d779e3, user_id=15e992d3253140f896435859fee98974, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.936303 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a678089-6215-4638-ab3a-1979f166504b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.944953 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175eef1-016e-4f18-aef7-2f40d3219b76 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.949634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ba28c-132e-46de-88c6-bee2796f7d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.950354 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ba28c-132e-46de-88c6-bee2796f7d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.950646 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ba28c-132e-46de-88c6-bee2796f7d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.950919 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ba28c-132e-46de-88c6-bee2796f7d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:43.951755 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ba28c-132e-46de-88c6-bee2796f7d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:43.953345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ba28c-132e-46de-88c6-bee2796f7d85 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:43.965175 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1369/2775] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:40:43.969308 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ba28c-132e-46de-88c6-bee2796f7d85 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:43.979067 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ba28c-132e-46de-88c6-bee2796f7d85 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:43.983816 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f430b-def0-4157-a380-79a87f2f8fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:43.984665 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f430b-def0-4157-a380-79a87f2f8fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:43.984949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f430b-def0-4157-a380-79a87f2f8fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:43.985227 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f430b-def0-4157-a380-79a87f2f8fcd admin admin] PATH_INFO: `/v3/projects/bd08af70bf244940868e298b55ccbd68/users/c61f1095ba534cc8a477fa1e88e9beaa/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:44.000040 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f430b-def0-4157-a380-79a87f2f8fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd08af70bf244940868e298b55ccbd68, user_id=c61f1095ba534cc8a477fa1e88e9beaa, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:44.002738 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f430b-def0-4157-a380-79a87f2f8fcd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:44.036412 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1407/2776] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:43 2022] PUT /identity/v3/projects/2ddade68228a40148fd090b791d779e3/users/15e992d3253140f896435859fee98974/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:44.046232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c47f54-565a-4a0d-9825-2dd2fe92bcbb None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:44.046616 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c47f54-565a-4a0d-9825-2dd2fe92bcbb None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:44.046891 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c47f54-565a-4a0d-9825-2dd2fe92bcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:44.073497 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-04c47f54-565a-4a0d-9825-2dd2fe92bcbb None None] MFA Rules not processed for user `15e992d3253140f896435859fee98974`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:44.074869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-04c47f54-565a-4a0d-9825-2dd2fe92bcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:44.137863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1370/2777] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:40:43 2022] PUT /identity/v3/projects/bd08af70bf244940868e298b55ccbd68/users/c61f1095ba534cc8a477fa1e88e9beaa/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:40:44.141786 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1408/2778] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:44.143535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046027e-5085-43fa-a2cd-b2da6d7ee7dc None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:44.144109 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046027e-5085-43fa-a2cd-b2da6d7ee7dc None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:44.145523 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046027e-5085-43fa-a2cd-b2da6d7ee7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:44.153685 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f430b-def0-4157-a380-79a87f2f8fcd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:44.155780 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d80f430b-def0-4157-a380-79a87f2f8fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:44.169448 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a046027e-5085-43fa-a2cd-b2da6d7ee7dc None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:44.170826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a046027e-5085-43fa-a2cd-b2da6d7ee7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:44.216911 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f430b-def0-4157-a380-79a87f2f8fcd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:44.220580 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335a932-d30a-450f-98bf-47150af3af30 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f973b13dd44e609110f9a967ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:44.221223 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335a932-d30a-450f-98bf-47150af3af30 service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:44.221511 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335a932-d30a-450f-98bf-47150af3af30 service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:44.221816 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335a932-d30a-450f-98bf-47150af3af30 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:44.238932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1409/2779] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:44.249184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046027e-5085-43fa-a2cd-b2da6d7ee7dc None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:44.250687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a046027e-5085-43fa-a2cd-b2da6d7ee7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:44.283390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335a932-d30a-450f-98bf-47150af3af30 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:44.285694 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335a932-d30a-450f-98bf-47150af3af30 service glance] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:44.295338 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1371/2780] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:40:44.313932 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046027e-5085-43fa-a2cd-b2da6d7ee7dc None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:44.321872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeefd06-bbe4-4c8b-85c4-2a23e2ebe8b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:44.322577 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeefd06-bbe4-4c8b-85c4-2a23e2ebe8b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:44.322988 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeefd06-bbe4-4c8b-85c4-2a23e2ebe8b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:44.323272 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeefd06-bbe4-4c8b-85c4-2a23e2ebe8b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:44.333390 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeefd06-bbe4-4c8b-85c4-2a23e2ebe8b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:44.335112 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeefd06-bbe4-4c8b-85c4-2a23e2ebe8b6 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:44.346043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1410/2781] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:50.226993 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335a932-d30a-450f-98bf-47150af3af30 service glance] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:50.236529 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335a932-d30a-450f-98bf-47150af3af30 service glance] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:50.242586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e7eb2-24e2-454e-bc91-04915ad1d74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:50.242586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e7eb2-24e2-454e-bc91-04915ad1d74e service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:50.242586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e7eb2-24e2-454e-bc91-04915ad1d74e service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:50.242586 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e7eb2-24e2-454e-bc91-04915ad1d74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:50.244645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-964e7eb2-24e2-454e-bc91-04915ad1d74e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:50.258551 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e7eb2-24e2-454e-bc91-04915ad1d74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:50.260210 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e7eb2-24e2-454e-bc91-04915ad1d74e service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:50.271393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1372/2782] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:51.117038 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730851be-af44-4232-9e18-cd5083207a07 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:51.117581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730851be-af44-4232-9e18-cd5083207a07 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:51.117581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730851be-af44-4232-9e18-cd5083207a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:51.148077 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-730851be-af44-4232-9e18-cd5083207a07 None None] MFA Rules not processed for user `c61f1095ba534cc8a477fa1e88e9beaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:51.149319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-730851be-af44-4232-9e18-cd5083207a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:51.221371 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1411/2783] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:51.235142 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e7eb2-24e2-454e-bc91-04915ad1d74e service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:51.236760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-964e7eb2-24e2-454e-bc91-04915ad1d74e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:51.317915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e7eb2-24e2-454e-bc91-04915ad1d74e service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:51.323551 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23015f51-772d-45b4-b089-f9f6eab7ff2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:51.324375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23015f51-772d-45b4-b089-f9f6eab7ff2d service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:51.324759 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23015f51-772d-45b4-b089-f9f6eab7ff2d service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:51.325044 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23015f51-772d-45b4-b089-f9f6eab7ff2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:51.334074 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23015f51-772d-45b4-b089-f9f6eab7ff2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:51.335842 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23015f51-772d-45b4-b089-f9f6eab7ff2d service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:51.344825 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1373/2784] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:55.986620 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab0357-3eaf-4aae-900c-bb21ffdaa875 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:55.987155 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab0357-3eaf-4aae-900c-bb21ffdaa875 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:55.987304 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab0357-3eaf-4aae-900c-bb21ffdaa875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:56.006916 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-16ab0357-3eaf-4aae-900c-bb21ffdaa875 None None] MFA Rules not processed for user `c61f1095ba534cc8a477fa1e88e9beaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:56.008169 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-16ab0357-3eaf-4aae-900c-bb21ffdaa875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:56.022533 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1412/2785] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:40:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:56.934798 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23015f51-772d-45b4-b089-f9f6eab7ff2d service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:56.936630 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-23015f51-772d-45b4-b089-f9f6eab7ff2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:57.008366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23015f51-772d-45b4-b089-f9f6eab7ff2d service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:57.013938 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe440a-8959-414f-82a0-6e49d0319105 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db978c3b147c4b259b623e8c64e7c13a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:57.014634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe440a-8959-414f-82a0-6e49d0319105 service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:57.014929 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe440a-8959-414f-82a0-6e49d0319105 service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:57.015328 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe440a-8959-414f-82a0-6e49d0319105 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:57.017184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2ebe440a-8959-414f-82a0-6e49d0319105 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:57.029620 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe440a-8959-414f-82a0-6e49d0319105 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:57.031286 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe440a-8959-414f-82a0-6e49d0319105 service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:57.041537 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1374/2786] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:40:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:41:00.497659 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab0357-3eaf-4aae-900c-bb21ffdaa875 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:00.499301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-16ab0357-3eaf-4aae-900c-bb21ffdaa875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:00.515052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab0357-3eaf-4aae-900c-bb21ffdaa875 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:00.520735 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:00.521703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:00.522075 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:00.522394 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] PATH_INFO: `/v3/users/50ab73740c294e54bf93aa6a8dc206bb` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:00.523716 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ab73740c294e54bf93aa6a8dc206bb)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:00.525699 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:00.783872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ab73740c294e54bf93aa6a8dc206bb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:00.792315 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ab73740c294e54bf93aa6a8dc206bb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:00.900857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ab73740c294e54bf93aa6a8dc206bb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:00.901749 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ab73740c294e54bf93aa6a8dc206bb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:00.915267 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ab73740c294e54bf93aa6a8dc206bb'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:00.921670 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1413/2787] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:41:00 2022] DELETE /identity/v3/users/50ab73740c294e54bf93aa6a8dc206bb => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:01.255657 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe440a-8959-414f-82a0-6e49d0319105 service placement] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:01.266699 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe440a-8959-414f-82a0-6e49d0319105 service placement] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:01.337715 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:01.338931 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:01.339207 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:01.339479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] PATH_INFO: `/v3/projects/b44f40cfaa094be5a9eb5c9b8ace76e6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:01.340661 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44f40cfaa094be5a9eb5c9b8ace76e6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:01.342604 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:01.486686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44f40cfaa094be5a9eb5c9b8ace76e6', 'request_id': 'req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:01.494529 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44f40cfaa094be5a9eb5c9b8ace76e6', 'request_id': 'req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:01.636224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44f40cfaa094be5a9eb5c9b8ace76e6', 'request_id': 'req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:01.647913 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] The token cache is being invalidate because project b44f40cfaa094be5a9eb5c9b8ace76e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:41:01.648204 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:01.648870 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:01.650436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1375/2788] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:41:01 2022] DELETE /identity/v3/projects/b44f40cfaa094be5a9eb5c9b8ace76e6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:01.654520 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:01.655916 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:01.669363 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d43d-9567-4542-956e-b21c6530e896 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:01.726982 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:01.727874 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:01.728162 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:01.728441 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] PATH_INFO: `/v3/users/dbd9eb4255764402a5306895dd1f2dde` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:01.729619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd9eb4255764402a5306895dd1f2dde)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:01.731558 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:01.966374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd9eb4255764402a5306895dd1f2dde'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:01.975158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd9eb4255764402a5306895dd1f2dde'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:02.058987 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd9eb4255764402a5306895dd1f2dde'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:02.059598 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd9eb4255764402a5306895dd1f2dde'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:02.072723 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd9eb4255764402a5306895dd1f2dde'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:02.078637 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1414/2789] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:41:01 2022] DELETE /identity/v3/users/dbd9eb4255764402a5306895dd1f2dde => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:02.348499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:02.350010 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:02.363325 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4477f71-4e0c-42eb-bd26-9026bb72c4b8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:02.423803 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdde129-e282-4be0-8d4f-d04642a0a005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:02.424833 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdde129-e282-4be0-8d4f-d04642a0a005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:02.424983 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdde129-e282-4be0-8d4f-d04642a0a005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:02.425257 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdde129-e282-4be0-8d4f-d04642a0a005 admin admin] PATH_INFO: `/v3/projects/fe64406f10a640fd8fb7413d3f431a11` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:02.426477 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdde129-e282-4be0-8d4f-d04642a0a005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe64406f10a640fd8fb7413d3f431a11)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:02.428373 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdde129-e282-4be0-8d4f-d04642a0a005 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:02.592969 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ffdde129-e282-4be0-8d4f-d04642a0a005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe64406f10a640fd8fb7413d3f431a11', 'request_id': 'req-ffdde129-e282-4be0-8d4f-d04642a0a005'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:02.599381 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ffdde129-e282-4be0-8d4f-d04642a0a005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe64406f10a640fd8fb7413d3f431a11', 'request_id': 'req-ffdde129-e282-4be0-8d4f-d04642a0a005'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:02.701029 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ffdde129-e282-4be0-8d4f-d04642a0a005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe64406f10a640fd8fb7413d3f431a11', 'request_id': 'req-ffdde129-e282-4be0-8d4f-d04642a0a005'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:02.712962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ffdde129-e282-4be0-8d4f-d04642a0a005 admin admin] The token cache is being invalidate because project fe64406f10a640fd8fb7413d3f431a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:41:02.713252 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ffdde129-e282-4be0-8d4f-d04642a0a005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:02.715915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ffdde129-e282-4be0-8d4f-d04642a0a005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:02.715915 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1376/2790] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:41:02 2022] DELETE /identity/v3/projects/fe64406f10a640fd8fb7413d3f431a11 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:18.010652 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:18.012086 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:18.025468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805ccaa-4023-4060-a4c4-f7e575efc3ec admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.078323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.079196 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.079474 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.079747 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] PATH_INFO: `/v3/users/15e992d3253140f896435859fee98974` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.081451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e992d3253140f896435859fee98974)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.083502 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:18.267410 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e992d3253140f896435859fee98974'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:18.274892 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e992d3253140f896435859fee98974'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:18.343842 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e992d3253140f896435859fee98974'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:18.344453 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e992d3253140f896435859fee98974'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:18.356479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e992d3253140f896435859fee98974'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:18.362522 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1415/2791] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:41:18 2022] DELETE /identity/v3/users/15e992d3253140f896435859fee98974 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:41:18.367135 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8413ba6-adb7-4bef-8a5b-98cdc4a8dde8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.367611 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8413ba6-adb7-4bef-8a5b-98cdc4a8dde8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.368770 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8413ba6-adb7-4bef-8a5b-98cdc4a8dde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.385688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f8413ba6-adb7-4bef-8a5b-98cdc4a8dde8 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:18.387042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f8413ba6-adb7-4bef-8a5b-98cdc4a8dde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:18.444816 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1377/2792] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:41:18.454512 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:18.456573 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:18.512970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ae320-8098-47e6-a6b0-88290ed09a53 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:18.516707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea784f21-fccb-48ff-9910-3703ee28ee78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:18.517362 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea784f21-fccb-48ff-9910-3703ee28ee78 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:18.517649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea784f21-fccb-48ff-9910-3703ee28ee78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:18.517930 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea784f21-fccb-48ff-9910-3703ee28ee78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:18.527782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea784f21-fccb-48ff-9910-3703ee28ee78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:18.529301 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea784f21-fccb-48ff-9910-3703ee28ee78 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:18.538943 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1416/2793] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:41:19.004676 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8413ba6-adb7-4bef-8a5b-98cdc4a8dde8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:41:19.006087 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f8413ba6-adb7-4bef-8a5b-98cdc4a8dde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:19.019889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8413ba6-adb7-4bef-8a5b-98cdc4a8dde8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:41:19.024577 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:41:19.025439 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:19.025721 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:19.025999 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703 admin admin] PATH_INFO: `/v3/projects/2ddade68228a40148fd090b791d779e3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:19.027226 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ddade68228a40148fd090b791d779e3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:41:19.029148 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:41:19.157309 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ddade68228a40148fd090b791d779e3', 'request_id': 'req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:19.163896 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ddade68228a40148fd090b791d779e3', 'request_id': 'req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:19.238115 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ddade68228a40148fd090b791d779e3', 'request_id': 'req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:19.248322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703 admin admin] The token cache is being invalidate because project 2ddade68228a40148fd090b791d779e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:41:19.248609 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:19.249248 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-67f83dc7-dfff-4cf7-b4d9-a6fdfd68e703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:41:19.250787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1378/2794] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:41:19 2022] DELETE /identity/v3/projects/2ddade68228a40148fd090b791d779e3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:41:43.467803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a2cbb-d1af-410a-a83a-b1357dc58153 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:41:43.468286 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a2cbb-d1af-410a-a83a-b1357dc58153 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:41:43.468381 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a2cbb-d1af-410a-a83a-b1357dc58153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:41:43.488232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-4b6a2cbb-d1af-410a-a83a-b1357dc58153 None None] MFA Rules not processed for user `b05dac3c70c44f59a1c333316ba072ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:41:43.489450 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4b6a2cbb-d1af-410a-a83a-b1357dc58153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:41:43.542834 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1417/2795] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:41:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:06.222606 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb60f3-3d21-47a1-b24a-01eb1543b63d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:06.226127 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb60f3-3d21-47a1-b24a-01eb1543b63d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:06.226127 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb60f3-3d21-47a1-b24a-01eb1543b63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:06.240992 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d9cb60f3-3d21-47a1-b24a-01eb1543b63d None None] MFA Rules not processed for user `c61f1095ba534cc8a477fa1e88e9beaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:06.242174 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d9cb60f3-3d21-47a1-b24a-01eb1543b63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:06.296086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1379/2796] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:42:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:54.927886 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a2cbb-d1af-410a-a83a-b1357dc58153 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:54.929269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-4b6a2cbb-d1af-410a-a83a-b1357dc58153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:54.983872 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a2cbb-d1af-410a-a83a-b1357dc58153 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:54.987505 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bbe53-9a89-4bf5-8aa8-d9ef26d60c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:54.988141 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bbe53-9a89-4bf5-8aa8-d9ef26d60c49 service cinder] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:54.988426 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bbe53-9a89-4bf5-8aa8-d9ef26d60c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:54.988701 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bbe53-9a89-4bf5-8aa8-d9ef26d60c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:54.990479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e49bbe53-9a89-4bf5-8aa8-d9ef26d60c49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:55.058913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bbe53-9a89-4bf5-8aa8-d9ef26d60c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:55.060271 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bbe53-9a89-4bf5-8aa8-d9ef26d60c49 service cinder] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:55.071628 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1418/2797] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:42:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:56.826092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb60f3-3d21-47a1-b24a-01eb1543b63d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:56.827599 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d9cb60f3-3d21-47a1-b24a-01eb1543b63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:56.890161 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb60f3-3d21-47a1-b24a-01eb1543b63d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:56.893743 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7db757-a53b-4890-80d5-671f107d3fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:56.894422 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7db757-a53b-4890-80d5-671f107d3fbc service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:56.894708 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7db757-a53b-4890-80d5-671f107d3fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:56.894988 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7db757-a53b-4890-80d5-671f107d3fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:56.896949 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aa7db757-a53b-4890-80d5-671f107d3fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:56.911806 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7db757-a53b-4890-80d5-671f107d3fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:56.913316 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7db757-a53b-4890-80d5-671f107d3fbc service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:56.925909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1380/2798] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:42:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:11.529595 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b717e2d-ac86-4d87-a688-f004621337e1 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:11.530109 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b717e2d-ac86-4d87-a688-f004621337e1 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:11.530245 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b717e2d-ac86-4d87-a688-f004621337e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:11.548064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-9b717e2d-ac86-4d87-a688-f004621337e1 None None] MFA Rules not processed for user `c61f1095ba534cc8a477fa1e88e9beaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:11.549178 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9b717e2d-ac86-4d87-a688-f004621337e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:11.556686 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1419/2799] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:43:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:15.339219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7db757-a53b-4890-80d5-671f107d3fbc service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:15.340727 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aa7db757-a53b-4890-80d5-671f107d3fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:15.352763 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7db757-a53b-4890-80d5-671f107d3fbc service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:15.356739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b027d0-96d2-4c10-9e31-4480b98cab86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:15.357354 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b027d0-96d2-4c10-9e31-4480b98cab86 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:15.357571 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b027d0-96d2-4c10-9e31-4480b98cab86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:15.357857 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b027d0-96d2-4c10-9e31-4480b98cab86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:15.359894 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a9b027d0-96d2-4c10-9e31-4480b98cab86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:15.372248 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b027d0-96d2-4c10-9e31-4480b98cab86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:15.373695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b027d0-96d2-4c10-9e31-4480b98cab86 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:15.382393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1381/2800] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:43:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:16.205273 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b717e2d-ac86-4d87-a688-f004621337e1 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:16.207158 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-9b717e2d-ac86-4d87-a688-f004621337e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:16.225566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b717e2d-ac86-4d87-a688-f004621337e1 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:16.233121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450f13b-4bc3-4cb6-a2f2-5b5a5351a583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:16.233934 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450f13b-4bc3-4cb6-a2f2-5b5a5351a583 service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:16.234332 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450f13b-4bc3-4cb6-a2f2-5b5a5351a583 service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:16.234746 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450f13b-4bc3-4cb6-a2f2-5b5a5351a583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:16.237312 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e450f13b-4bc3-4cb6-a2f2-5b5a5351a583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:16.251811 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450f13b-4bc3-4cb6-a2f2-5b5a5351a583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:16.253472 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450f13b-4bc3-4cb6-a2f2-5b5a5351a583 service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:16.266305 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1420/2801] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:43:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:40.800233 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fcb09-8b5b-40a6-954f-b76da768b606 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:40.800757 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fcb09-8b5b-40a6-954f-b76da768b606 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:40.800876 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fcb09-8b5b-40a6-954f-b76da768b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:40.819091 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b19fcb09-8b5b-40a6-954f-b76da768b606 None None] MFA Rules not processed for user `b05dac3c70c44f59a1c333316ba072ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:40.820268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b19fcb09-8b5b-40a6-954f-b76da768b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:40.827643 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1382/2802] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:41.135041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450f13b-4bc3-4cb6-a2f2-5b5a5351a583 service nova] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:41.144963 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450f13b-4bc3-4cb6-a2f2-5b5a5351a583 service nova] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:41.148829 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c5ddc-d33c-4863-8731-860c2fbb0872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:41.149471 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c5ddc-d33c-4863-8731-860c2fbb0872 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:41.149757 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c5ddc-d33c-4863-8731-860c2fbb0872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:41.150031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c5ddc-d33c-4863-8731-860c2fbb0872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:41.151857 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-e84c5ddc-d33c-4863-8731-860c2fbb0872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:41.161601 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c5ddc-d33c-4863-8731-860c2fbb0872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:41.163031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c5ddc-d33c-4863-8731-860c2fbb0872 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:41.171296 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1421/2803] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:43:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:45.158157 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fcb09-8b5b-40a6-954f-b76da768b606 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:45.167933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fcb09-8b5b-40a6-954f-b76da768b606 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:45.172349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e563b1e-0fb9-4bb4-903d-451f7b67b4b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:45.173071 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e563b1e-0fb9-4bb4-903d-451f7b67b4b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:45.173424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e563b1e-0fb9-4bb4-903d-451f7b67b4b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:45.173771 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e563b1e-0fb9-4bb4-903d-451f7b67b4b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:45.175673 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4e563b1e-0fb9-4bb4-903d-451f7b67b4b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:45.188240 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e563b1e-0fb9-4bb4-903d-451f7b67b4b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:45.190200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e563b1e-0fb9-4bb4-903d-451f7b67b4b8 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:45.200418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1383/2804] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:43:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:22.971543 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caae41-c936-4211-96af-b0020f931fab None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:22.972391 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caae41-c936-4211-96af-b0020f931fab None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:22.972570 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caae41-c936-4211-96af-b0020f931fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:22.990703 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-20caae41-c936-4211-96af-b0020f931fab None None] MFA Rules not processed for user `c61f1095ba534cc8a477fa1e88e9beaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:22.991884 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-20caae41-c936-4211-96af-b0020f931fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:22.998888 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1422/2805] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:44:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:23.299284 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e563b1e-0fb9-4bb4-903d-451f7b67b4b8 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:23.308464 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e563b1e-0fb9-4bb4-903d-451f7b67b4b8 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:23.313274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43098610-bf86-4bb9-885f-b407842d7129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:23.313909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43098610-bf86-4bb9-885f-b407842d7129 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:23.314192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43098610-bf86-4bb9-885f-b407842d7129 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:23.314763 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43098610-bf86-4bb9-885f-b407842d7129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:23.316514 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-43098610-bf86-4bb9-885f-b407842d7129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:23.326843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43098610-bf86-4bb9-885f-b407842d7129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:23.328259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43098610-bf86-4bb9-885f-b407842d7129 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:23.336149 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1384/2806] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:44:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:23.726566 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caae41-c936-4211-96af-b0020f931fab None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:23.728015 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-20caae41-c936-4211-96af-b0020f931fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:23.800457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caae41-c936-4211-96af-b0020f931fab None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:23.805760 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec025cb0-bb06-40e5-8cb5-c65f0ad43dc0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db978c3b147c4b259b623e8c64e7c13a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:23.806461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec025cb0-bb06-40e5-8cb5-c65f0ad43dc0 service placement] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:23.806755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec025cb0-bb06-40e5-8cb5-c65f0ad43dc0 service placement] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:23.807035 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec025cb0-bb06-40e5-8cb5-c65f0ad43dc0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:23.808844 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-ec025cb0-bb06-40e5-8cb5-c65f0ad43dc0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:23.821441 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec025cb0-bb06-40e5-8cb5-c65f0ad43dc0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:23.823159 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec025cb0-bb06-40e5-8cb5-c65f0ad43dc0 service placement] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:23.833190 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1423/2807] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:44:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:34.561854 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43098610-bf86-4bb9-885f-b407842d7129 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:34.564006 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-43098610-bf86-4bb9-885f-b407842d7129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:34.580509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43098610-bf86-4bb9-885f-b407842d7129 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:34.585959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a3d74-e92f-4fc4-996a-310f1ebcddf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:34.586604 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a3d74-e92f-4fc4-996a-310f1ebcddf8 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:34.590985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a3d74-e92f-4fc4-996a-310f1ebcddf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:34.590985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a3d74-e92f-4fc4-996a-310f1ebcddf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:34.590985 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2c6a3d74-e92f-4fc4-996a-310f1ebcddf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:34.600936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a3d74-e92f-4fc4-996a-310f1ebcddf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:34.602591 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a3d74-e92f-4fc4-996a-310f1ebcddf8 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:34.613222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1385/2808] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:44:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:39.051773 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec025cb0-bb06-40e5-8cb5-c65f0ad43dc0 service placement] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:39.095343 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec025cb0-bb06-40e5-8cb5-c65f0ad43dc0 service placement] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:39.101179 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6223b8d-6b4b-489e-bb8c-38ae9b9afe1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4ff6ba4e17477d8787eaf1955bd1da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:39.101832 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6223b8d-6b4b-489e-bb8c-38ae9b9afe1f service nova] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:39.102113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6223b8d-6b4b-489e-bb8c-38ae9b9afe1f service nova] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:39.102418 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6223b8d-6b4b-489e-bb8c-38ae9b9afe1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:39.104191 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b6223b8d-6b4b-489e-bb8c-38ae9b9afe1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:39.135339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6223b8d-6b4b-489e-bb8c-38ae9b9afe1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:39.136915 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6223b8d-6b4b-489e-bb8c-38ae9b9afe1f service nova] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:39.148118 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1424/2809] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:44:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:45:40.180669 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a3d74-e92f-4fc4-996a-310f1ebcddf8 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:40.182164 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2c6a3d74-e92f-4fc4-996a-310f1ebcddf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:40.309043 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a3d74-e92f-4fc4-996a-310f1ebcddf8 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:40.313610 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5359d-7fa0-4674-9a98-eb9a8e132c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:40.314528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5359d-7fa0-4674-9a98-eb9a8e132c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:40.314814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5359d-7fa0-4674-9a98-eb9a8e132c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:40.315108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5359d-7fa0-4674-9a98-eb9a8e132c43 admin admin] PATH_INFO: `/v3/users/c61f1095ba534cc8a477fa1e88e9beaa` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:40.316562 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5359d-7fa0-4674-9a98-eb9a8e132c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61f1095ba534cc8a477fa1e88e9beaa)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:40.319151 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5359d-7fa0-4674-9a98-eb9a8e132c43 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:40.514416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2de5359d-7fa0-4674-9a98-eb9a8e132c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61f1095ba534cc8a477fa1e88e9beaa'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:40.521962 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2de5359d-7fa0-4674-9a98-eb9a8e132c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61f1095ba534cc8a477fa1e88e9beaa'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:40.522674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2de5359d-7fa0-4674-9a98-eb9a8e132c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61f1095ba534cc8a477fa1e88e9beaa'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:40.523282 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2de5359d-7fa0-4674-9a98-eb9a8e132c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61f1095ba534cc8a477fa1e88e9beaa'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:40.534805 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2de5359d-7fa0-4674-9a98-eb9a8e132c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61f1095ba534cc8a477fa1e88e9beaa'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:40.625269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1386/2810] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:45:40 2022] DELETE /identity/v3/users/c61f1095ba534cc8a477fa1e88e9beaa => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:45:40.907931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6223b8d-6b4b-489e-bb8c-38ae9b9afe1f service nova] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:40.919064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6223b8d-6b4b-489e-bb8c-38ae9b9afe1f service nova] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:40.981101 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be015b54-61c8-4c35-b49f-d4d8f9e66007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:40.981978 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015b54-61c8-4c35-b49f-d4d8f9e66007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:40.982266 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015b54-61c8-4c35-b49f-d4d8f9e66007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:40.982581 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015b54-61c8-4c35-b49f-d4d8f9e66007 admin admin] PATH_INFO: `/v3/projects/bd08af70bf244940868e298b55ccbd68` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:40.983820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be015b54-61c8-4c35-b49f-d4d8f9e66007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd08af70bf244940868e298b55ccbd68)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:40.985920 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be015b54-61c8-4c35-b49f-d4d8f9e66007 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:41.100934 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-be015b54-61c8-4c35-b49f-d4d8f9e66007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd08af70bf244940868e298b55ccbd68', 'request_id': 'req-be015b54-61c8-4c35-b49f-d4d8f9e66007'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:41.107232 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-be015b54-61c8-4c35-b49f-d4d8f9e66007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd08af70bf244940868e298b55ccbd68', 'request_id': 'req-be015b54-61c8-4c35-b49f-d4d8f9e66007'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:41.196931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-be015b54-61c8-4c35-b49f-d4d8f9e66007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd08af70bf244940868e298b55ccbd68', 'request_id': 'req-be015b54-61c8-4c35-b49f-d4d8f9e66007'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:41.208964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-be015b54-61c8-4c35-b49f-d4d8f9e66007 admin admin] The token cache is being invalidate because project bd08af70bf244940868e298b55ccbd68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:45:41.209306 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-be015b54-61c8-4c35-b49f-d4d8f9e66007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:41.209975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-be015b54-61c8-4c35-b49f-d4d8f9e66007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:41.211539 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1425/2811] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:45:40 2022] DELETE /identity/v3/projects/bd08af70bf244940868e298b55ccbd68 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:45:41.216616 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082e5c1-ffc8-498f-8383-93fd04f014d5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:41.217103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082e5c1-ffc8-498f-8383-93fd04f014d5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:41.217202 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082e5c1-ffc8-498f-8383-93fd04f014d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:41.271554 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3082e5c1-ffc8-498f-8383-93fd04f014d5 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:41.272760 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3082e5c1-ffc8-498f-8383-93fd04f014d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:41.333987 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1387/2812] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:45:41.340693 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6fca-2ca6-4d84-bf85-c6fc4358f2f2 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:41.341050 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6fca-2ca6-4d84-bf85-c6fc4358f2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:41.341405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6fca-2ca6-4d84-bf85-c6fc4358f2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:41.366087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-162f6fca-2ca6-4d84-bf85-c6fc4358f2f2 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:41.367475 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-162f6fca-2ca6-4d84-bf85-c6fc4358f2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:41.375427 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1426/2813] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:45:41.382375 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082e5c1-ffc8-498f-8383-93fd04f014d5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:41.390942 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082e5c1-ffc8-498f-8383-93fd04f014d5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:41.405003 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80ccf2-8baf-4e48-9a8c-2c0088949c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:41.405787 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80ccf2-8baf-4e48-9a8c-2c0088949c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:41.405947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80ccf2-8baf-4e48-9a8c-2c0088949c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:41.406224 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80ccf2-8baf-4e48-9a8c-2c0088949c2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:41.407012 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80ccf2-8baf-4e48-9a8c-2c0088949c2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:45:41.407319 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80ccf2-8baf-4e48-9a8c-2c0088949c2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:41.408975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80ccf2-8baf-4e48-9a8c-2c0088949c2c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:41.422376 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1388/2814] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:45:41.426041 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f6fca-2ca6-4d84-bf85-c6fc4358f2f2 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:41.436165 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f6fca-2ca6-4d84-bf85-c6fc4358f2f2 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:41.441133 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2cc85-1906-4db2-a603-0b862f69d9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:41.441791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2cc85-1906-4db2-a603-0b862f69d9bf admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:41.442069 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2cc85-1906-4db2-a603-0b862f69d9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:41.442372 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2cc85-1906-4db2-a603-0b862f69d9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:41.443734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2cc85-1906-4db2-a603-0b862f69d9bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:41.445746 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2cc85-1906-4db2-a603-0b862f69d9bf admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:41.556385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1427/2815] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:45:41 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:45:41.557764 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80ccf2-8baf-4e48-9a8c-2c0088949c2c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:41.569079 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80ccf2-8baf-4e48-9a8c-2c0088949c2c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:41.625263 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80192702-11b9-4b91-9c9e-eb3dfa38d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:41.625866 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192702-11b9-4b91-9c9e-eb3dfa38d619 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:41.626152 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192702-11b9-4b91-9c9e-eb3dfa38d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:41.626480 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192702-11b9-4b91-9c9e-eb3dfa38d619 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:41.627169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80192702-11b9-4b91-9c9e-eb3dfa38d619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:41.629262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80192702-11b9-4b91-9c9e-eb3dfa38d619 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:41.724236 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1389/2816] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:45:41 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:45:41.728741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2cc85-1906-4db2-a603-0b862f69d9bf admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:41.741572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2cc85-1906-4db2-a603-0b862f69d9bf admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:41.746468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca547e6-8754-47f0-be55-e7e7d162a6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:41.747460 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca547e6-8754-47f0-be55-e7e7d162a6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:41.747917 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca547e6-8754-47f0-be55-e7e7d162a6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:41.748198 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca547e6-8754-47f0-be55-e7e7d162a6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:41.749322 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca547e6-8754-47f0-be55-e7e7d162a6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:41.751408 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca547e6-8754-47f0-be55-e7e7d162a6c2 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:41.766684 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1428/2817] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:45:41.776827 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80192702-11b9-4b91-9c9e-eb3dfa38d619 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:41.788855 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80192702-11b9-4b91-9c9e-eb3dfa38d619 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:41.794209 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e12267-6f93-4d90-9576-6b3f72d4e660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:41.795034 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e12267-6f93-4d90-9576-6b3f72d4e660 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:41.795413 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e12267-6f93-4d90-9576-6b3f72d4e660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:41.795762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e12267-6f93-4d90-9576-6b3f72d4e660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:41.796573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e12267-6f93-4d90-9576-6b3f72d4e660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:41.798237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e12267-6f93-4d90-9576-6b3f72d4e660 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:41.813205 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1390/2818] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:45:41.814461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca547e6-8754-47f0-be55-e7e7d162a6c2 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:41.825680 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca547e6-8754-47f0-be55-e7e7d162a6c2 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:41.832152 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970bba0-f25f-4ade-b6df-fa30641d71e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:41.833071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970bba0-f25f-4ade-b6df-fa30641d71e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:41.833905 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970bba0-f25f-4ade-b6df-fa30641d71e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:41.835468 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970bba0-f25f-4ade-b6df-fa30641d71e7 admin admin] PATH_INFO: `/v3/projects/1e36fee0a85a4fa1a24738b3f0ee4c56/users/934ba49caef749ccbc97ed7e4a6d7e05/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:41.850234 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970bba0-f25f-4ade-b6df-fa30641d71e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e36fee0a85a4fa1a24738b3f0ee4c56, user_id=934ba49caef749ccbc97ed7e4a6d7e05, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:41.853218 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970bba0-f25f-4ade-b6df-fa30641d71e7 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:42.048736 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1429/2819] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:45:41 2022] PUT /identity/v3/projects/1e36fee0a85a4fa1a24738b3f0ee4c56/users/934ba49caef749ccbc97ed7e4a6d7e05/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:45:42.059773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b927b-1914-49b6-a9b0-419219eb1558 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:42.075963 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b927b-1914-49b6-a9b0-419219eb1558 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:42.075963 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b927b-1914-49b6-a9b0-419219eb1558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:42.088192 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e53b927b-1914-49b6-a9b0-419219eb1558 None None] MFA Rules not processed for user `934ba49caef749ccbc97ed7e4a6d7e05`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:42.089393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e53b927b-1914-49b6-a9b0-419219eb1558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:42.153867 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1391/2820] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:45:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:45:42.158296 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970bba0-f25f-4ade-b6df-fa30641d71e7 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:42.218171 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970bba0-f25f-4ade-b6df-fa30641d71e7 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:42.222791 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee52a41-b6d3-4482-b717-c54b709974fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:42.223449 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee52a41-b6d3-4482-b717-c54b709974fc admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:42.223810 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee52a41-b6d3-4482-b717-c54b709974fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:42.224725 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee52a41-b6d3-4482-b717-c54b709974fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:42.225496 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee52a41-b6d3-4482-b717-c54b709974fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:42.227429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee52a41-b6d3-4482-b717-c54b709974fc admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:42.381437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1430/2821] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:45:42 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:45:42.385576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b927b-1914-49b6-a9b0-419219eb1558 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:42.396391 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b927b-1914-49b6-a9b0-419219eb1558 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:42.454418 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b300622-aa6c-495e-a04f-d13d73b326d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:42.455094 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300622-aa6c-495e-a04f-d13d73b326d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:42.455380 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300622-aa6c-495e-a04f-d13d73b326d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:42.455662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300622-aa6c-495e-a04f-d13d73b326d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:42.456393 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b300622-aa6c-495e-a04f-d13d73b326d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:42.458571 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b300622-aa6c-495e-a04f-d13d73b326d8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:42.545169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1392/2822] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:45:42 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:45:42.549319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee52a41-b6d3-4482-b717-c54b709974fc admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:42.561113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee52a41-b6d3-4482-b717-c54b709974fc admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:42.566054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbe651-f413-4dd4-8aa8-9639f7eac4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:42.568941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe651-f413-4dd4-8aa8-9639f7eac4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:42.568941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe651-f413-4dd4-8aa8-9639f7eac4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:42.568941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe651-f413-4dd4-8aa8-9639f7eac4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:42.568941 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbe651-f413-4dd4-8aa8-9639f7eac4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:42.570391 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbe651-f413-4dd4-8aa8-9639f7eac4f3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:42.581050 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1431/2823] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:45:42.585372 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b300622-aa6c-495e-a04f-d13d73b326d8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:42.595239 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b300622-aa6c-495e-a04f-d13d73b326d8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:42.600361 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e68a69-e1cc-414f-bcb3-edcb01e9bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:42.601288 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e68a69-e1cc-414f-bcb3-edcb01e9bf01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:42.601569 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e68a69-e1cc-414f-bcb3-edcb01e9bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:42.601843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e68a69-e1cc-414f-bcb3-edcb01e9bf01 admin admin] PATH_INFO: `/v3/projects/ff281b6a749a4669aca8f89646b59ce0/users/abb3d397f87d4cb5a368bed0110c5fb8/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:42.617710 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e68a69-e1cc-414f-bcb3-edcb01e9bf01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff281b6a749a4669aca8f89646b59ce0, user_id=abb3d397f87d4cb5a368bed0110c5fb8, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:42.620512 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e68a69-e1cc-414f-bcb3-edcb01e9bf01 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:42.717636 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1393/2824] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:45:42 2022] PUT /identity/v3/projects/ff281b6a749a4669aca8f89646b59ce0/users/abb3d397f87d4cb5a368bed0110c5fb8/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:45:42.722639 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbe651-f413-4dd4-8aa8-9639f7eac4f3 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:42.736718 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbe651-f413-4dd4-8aa8-9639f7eac4f3 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:42.793952 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7b282-2735-4ce2-8b0a-aada584b7c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:42.794672 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7b282-2735-4ce2-8b0a-aada584b7c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:42.794960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7b282-2735-4ce2-8b0a-aada584b7c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:42.795239 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7b282-2735-4ce2-8b0a-aada584b7c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:42.795965 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7b282-2735-4ce2-8b0a-aada584b7c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:42.797552 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7b282-2735-4ce2-8b0a-aada584b7c9f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:42.808071 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1432/2825] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:45:42.812158 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e68a69-e1cc-414f-bcb3-edcb01e9bf01 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:42.823144 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e68a69-e1cc-414f-bcb3-edcb01e9bf01 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:42.827837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c74a39-25ea-477c-8b1d-dc4b6a642b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:42.828725 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c74a39-25ea-477c-8b1d-dc4b6a642b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:42.829009 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c74a39-25ea-477c-8b1d-dc4b6a642b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:42.829291 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c74a39-25ea-477c-8b1d-dc4b6a642b3d admin admin] PATH_INFO: `/v3/projects/ff281b6a749a4669aca8f89646b59ce0/users/abb3d397f87d4cb5a368bed0110c5fb8/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:42.831282 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c74a39-25ea-477c-8b1d-dc4b6a642b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff281b6a749a4669aca8f89646b59ce0, user_id=abb3d397f87d4cb5a368bed0110c5fb8, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:42.834002 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c74a39-25ea-477c-8b1d-dc4b6a642b3d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:42.844397 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1394/2826] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:45:42 2022] PUT /identity/v3/projects/ff281b6a749a4669aca8f89646b59ce0/users/abb3d397f87d4cb5a368bed0110c5fb8/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:45:42.856687 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c70362-8c16-45cf-b305-04ec1a5bbcc7 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:42.856982 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c70362-8c16-45cf-b305-04ec1a5bbcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:42.857265 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c70362-8c16-45cf-b305-04ec1a5bbcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:42.884457 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-39c70362-8c16-45cf-b305-04ec1a5bbcc7 None None] MFA Rules not processed for user `abb3d397f87d4cb5a368bed0110c5fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:42.887403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-39c70362-8c16-45cf-b305-04ec1a5bbcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:42.955904 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1433/2827] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:45:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:45:42.967177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c74a39-25ea-477c-8b1d-dc4b6a642b3d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:42.968883 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-52c74a39-25ea-477c-8b1d-dc4b6a642b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:43.049653 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c74a39-25ea-477c-8b1d-dc4b6a642b3d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:43.053547 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92160714-ee34-4cbe-9e9e-b216b5ba129c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:43.054186 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92160714-ee34-4cbe-9e9e-b216b5ba129c service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:43.054509 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92160714-ee34-4cbe-9e9e-b216b5ba129c service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:43.054791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92160714-ee34-4cbe-9e9e-b216b5ba129c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:43.109674 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92160714-ee34-4cbe-9e9e-b216b5ba129c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:43.111146 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92160714-ee34-4cbe-9e9e-b216b5ba129c service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:43.119928 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1395/2828] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:45:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:45:46.337895 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c70362-8c16-45cf-b305-04ec1a5bbcc7 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:46.339381 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-39c70362-8c16-45cf-b305-04ec1a5bbcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:46.417418 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c70362-8c16-45cf-b305-04ec1a5bbcc7 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:46.421113 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400b8eb-2c88-4476-8584-14902ff94a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:46.421757 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400b8eb-2c88-4476-8584-14902ff94a19 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:46.422043 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400b8eb-2c88-4476-8584-14902ff94a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:46.422347 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400b8eb-2c88-4476-8584-14902ff94a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:46.424201 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7400b8eb-2c88-4476-8584-14902ff94a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:46.485548 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400b8eb-2c88-4476-8584-14902ff94a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:46.487052 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400b8eb-2c88-4476-8584-14902ff94a19 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:46.497331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1434/2829] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:45:49.484893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92160714-ee34-4cbe-9e9e-b216b5ba129c service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:49.486374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-92160714-ee34-4cbe-9e9e-b216b5ba129c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:49.498482 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92160714-ee34-4cbe-9e9e-b216b5ba129c service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:49.502232 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbf34d-d000-4d88-b7aa-561911f7c206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:49.502943 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbf34d-d000-4d88-b7aa-561911f7c206 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:49.503227 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbf34d-d000-4d88-b7aa-561911f7c206 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:49.503510 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbf34d-d000-4d88-b7aa-561911f7c206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:49.513841 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbf34d-d000-4d88-b7aa-561911f7c206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:49.515445 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbf34d-d000-4d88-b7aa-561911f7c206 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:49.527317 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1396/2830] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:45:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:45:54.421889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400b8eb-2c88-4476-8584-14902ff94a19 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:54.423331 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-7400b8eb-2c88-4476-8584-14902ff94a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:54.437014 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400b8eb-2c88-4476-8584-14902ff94a19 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:54.442237 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:54.443220 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:54.443570 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:54.443912 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] PATH_INFO: `/v3/users/b05dac3c70c44f59a1c333316ba072ac` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:54.446021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05dac3c70c44f59a1c333316ba072ac)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:54.448184 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:54.712064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05dac3c70c44f59a1c333316ba072ac'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:54.718429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05dac3c70c44f59a1c333316ba072ac'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:54.859282 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05dac3c70c44f59a1c333316ba072ac'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:54.859913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05dac3c70c44f59a1c333316ba072ac'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:54.872429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05dac3c70c44f59a1c333316ba072ac'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:54.878500 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1435/2831] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:45:54 2022] DELETE /identity/v3/users/b05dac3c70c44f59a1c333316ba072ac => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:45:55.277088 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbf34d-d000-4d88-b7aa-561911f7c206 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:55.279652 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbf34d-d000-4d88-b7aa-561911f7c206 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:55.335903 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:55.337535 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:55.337815 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:55.338089 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] PATH_INFO: `/v3/projects/b97c929f22d641ed8726135a088f8313` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:55.339492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97c929f22d641ed8726135a088f8313)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:55.341417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:55.511407 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97c929f22d641ed8726135a088f8313', 'request_id': 'req-bf99ba92-5e37-42da-b158-6d6b64eeec65'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:55.517544 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97c929f22d641ed8726135a088f8313', 'request_id': 'req-bf99ba92-5e37-42da-b158-6d6b64eeec65'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:55.596137 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97c929f22d641ed8726135a088f8313', 'request_id': 'req-bf99ba92-5e37-42da-b158-6d6b64eeec65'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:55.606677 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] The token cache is being invalidate because project b97c929f22d641ed8726135a088f8313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:45:55.606959 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:55.607574 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:55.609119 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1397/2832] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:45:55 2022] DELETE /identity/v3/projects/b97c929f22d641ed8726135a088f8313 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:45:55.613121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:55.614700 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:55.628497 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c053b-b6dc-4cd8-a5c1-65e98bfb561b admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:55.683728 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:55.684608 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:55.684889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:55.685166 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] PATH_INFO: `/v3/users/2cbfef7f4f5c42c3991db7e456a91bb1` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:55.686494 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cbfef7f4f5c42c3991db7e456a91bb1)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:55.688406 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:55.960269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cbfef7f4f5c42c3991db7e456a91bb1'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:55.967369 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cbfef7f4f5c42c3991db7e456a91bb1'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:56.071121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cbfef7f4f5c42c3991db7e456a91bb1'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:56.071529 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cbfef7f4f5c42c3991db7e456a91bb1'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:56.083535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cbfef7f4f5c42c3991db7e456a91bb1'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:56.089628 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1436/2833] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:45:55 2022] DELETE /identity/v3/users/2cbfef7f4f5c42c3991db7e456a91bb1 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:45:56.375828 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:56.377351 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:56.390826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99ba92-5e37-42da-b158-6d6b64eeec65 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:56.448912 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:56.449775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:56.450054 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:56.450366 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] PATH_INFO: `/v3/projects/188fa01c56c1487a9d106e95aacdef32` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:56.451539 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=188fa01c56c1487a9d106e95aacdef32)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:56.453427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:56.574416 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188fa01c56c1487a9d106e95aacdef32', 'request_id': 'req-68042d90-f570-45fd-88ca-fc2d05838a19'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:56.580355 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188fa01c56c1487a9d106e95aacdef32', 'request_id': 'req-68042d90-f570-45fd-88ca-fc2d05838a19'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:56.658604 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188fa01c56c1487a9d106e95aacdef32', 'request_id': 'req-68042d90-f570-45fd-88ca-fc2d05838a19'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:56.669444 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] The token cache is being invalidate because project 188fa01c56c1487a9d106e95aacdef32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:45:56.669761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:56.670412 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:56.671954 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1398/2834] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:45:56 2022] DELETE /identity/v3/projects/188fa01c56c1487a9d106e95aacdef32 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:45:59.574908 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:59.576341 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:59.662589 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ba166-7346-43ba-a18a-761d10692b3f admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:59.720102 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcab0ee-93c4-4820-b18a-a2f35522e1e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db978c3b147c4b259b623e8c64e7c13a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:59.720707 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab0ee-93c4-4820-b18a-a2f35522e1e9 service placement] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:59.720994 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab0ee-93c4-4820-b18a-a2f35522e1e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:59.721272 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab0ee-93c4-4820-b18a-a2f35522e1e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:59.723092 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-fbcab0ee-93c4-4820-b18a-a2f35522e1e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:59.734960 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcab0ee-93c4-4820-b18a-a2f35522e1e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:59.736540 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcab0ee-93c4-4820-b18a-a2f35522e1e9 service placement] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:59.747225 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1437/2835] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:45:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:17.661304 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:17.662761 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:17.724717 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68042d90-f570-45fd-88ca-fc2d05838a19 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:17.729264 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:17.730184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:17.730494 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:17.730773 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] PATH_INFO: `/v3/users/934ba49caef749ccbc97ed7e4a6d7e05` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:17.731952 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=934ba49caef749ccbc97ed7e4a6d7e05)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:17.734402 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:17.940084 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934ba49caef749ccbc97ed7e4a6d7e05'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:17.947237 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934ba49caef749ccbc97ed7e4a6d7e05'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:17.947958 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934ba49caef749ccbc97ed7e4a6d7e05'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:17.948564 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934ba49caef749ccbc97ed7e4a6d7e05'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:17.960269 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934ba49caef749ccbc97ed7e4a6d7e05'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:18.053474 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1399/2836] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:46:17 2022] DELETE /identity/v3/users/934ba49caef749ccbc97ed7e4a6d7e05 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:18.058188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d9d7-fc1e-47f6-8574-481e5758e752 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:18.058713 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d9d7-fc1e-47f6-8574-481e5758e752 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:18.058828 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d9d7-fc1e-47f6-8574-481e5758e752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:18.076257 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-6d78d9d7-fc1e-47f6-8574-481e5758e752 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:18.077504 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6d78d9d7-fc1e-47f6-8574-481e5758e752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:18.134295 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1438/2837] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:18.144279 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:18.148253 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:18.203436 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2573b-459e-424c-9e1a-8281ffa2eb61 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:18.207241 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb5bad-aed2-4913-b60d-31d971ed3ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:18.207893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb5bad-aed2-4913-b60d-31d971ed3ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:18.208178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb5bad-aed2-4913-b60d-31d971ed3ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:18.208459 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb5bad-aed2-4913-b60d-31d971ed3ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:18.217460 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb5bad-aed2-4913-b60d-31d971ed3ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:18.223370 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb5bad-aed2-4913-b60d-31d971ed3ec4 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:18.228863 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1400/2838] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:46:18.620973 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78d9d7-fc1e-47f6-8574-481e5758e752 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:18.622437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-6d78d9d7-fc1e-47f6-8574-481e5758e752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:18.636107 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78d9d7-fc1e-47f6-8574-481e5758e752 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:18.641528 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:18.642921 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:18.643317 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:18.643719 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] PATH_INFO: `/v3/projects/1e36fee0a85a4fa1a24738b3f0ee4c56` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:18.645405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e36fee0a85a4fa1a24738b3f0ee4c56)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:18.647441 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:18.788515 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e36fee0a85a4fa1a24738b3f0ee4c56', 'request_id': 'req-cb170873-3867-4875-aa0d-43abbfc2388e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:18.795535 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e36fee0a85a4fa1a24738b3f0ee4c56', 'request_id': 'req-cb170873-3867-4875-aa0d-43abbfc2388e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:18.876989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e36fee0a85a4fa1a24738b3f0ee4c56', 'request_id': 'req-cb170873-3867-4875-aa0d-43abbfc2388e'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:18.889576 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] The token cache is being invalidate because project 1e36fee0a85a4fa1a24738b3f0ee4c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:46:18.890064 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:18.891803 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:18.893813 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1439/2839] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:46:18 2022] DELETE /identity/v3/projects/1e36fee0a85a4fa1a24738b3f0ee4c56 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:18.908396 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb5bad-aed2-4913-b60d-31d971ed3ec4 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:18.918457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb5bad-aed2-4913-b60d-31d971ed3ec4 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:18.976528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8a9a5-f271-4efb-b399-14ff161b000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:18.977400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8a9a5-f271-4efb-b399-14ff161b000b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:18.977679 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8a9a5-f271-4efb-b399-14ff161b000b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:18.977952 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8a9a5-f271-4efb-b399-14ff161b000b admin admin] PATH_INFO: `/v3/users/abb3d397f87d4cb5a368bed0110c5fb8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:18.980230 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8a9a5-f271-4efb-b399-14ff161b000b admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb3d397f87d4cb5a368bed0110c5fb8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:18.982976 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8a9a5-f271-4efb-b399-14ff161b000b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:19.192739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-22e8a9a5-f271-4efb-b399-14ff161b000b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb3d397f87d4cb5a368bed0110c5fb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:19.199414 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-22e8a9a5-f271-4efb-b399-14ff161b000b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb3d397f87d4cb5a368bed0110c5fb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:19.200103 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-22e8a9a5-f271-4efb-b399-14ff161b000b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb3d397f87d4cb5a368bed0110c5fb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:19.200712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-22e8a9a5-f271-4efb-b399-14ff161b000b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb3d397f87d4cb5a368bed0110c5fb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:19.211980 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-22e8a9a5-f271-4efb-b399-14ff161b000b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb3d397f87d4cb5a368bed0110c5fb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:19.327045 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1401/2840] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:46:18 2022] DELETE /identity/v3/users/abb3d397f87d4cb5a368bed0110c5fb8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:46:19.832261 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:19.833696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:19.848705 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170873-3867-4875-aa0d-43abbfc2388e admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:19.903525 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce53f5-43d0-49f2-b6c5-0765e88add81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:19.904388 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce53f5-43d0-49f2-b6c5-0765e88add81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:19.904666 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce53f5-43d0-49f2-b6c5-0765e88add81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:19.905056 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce53f5-43d0-49f2-b6c5-0765e88add81 admin admin] PATH_INFO: `/v3/projects/ff281b6a749a4669aca8f89646b59ce0` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:19.906255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce53f5-43d0-49f2-b6c5-0765e88add81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff281b6a749a4669aca8f89646b59ce0)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:19.908955 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce53f5-43d0-49f2-b6c5-0765e88add81 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:20.046418 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-61ce53f5-43d0-49f2-b6c5-0765e88add81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff281b6a749a4669aca8f89646b59ce0', 'request_id': 'req-61ce53f5-43d0-49f2-b6c5-0765e88add81'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:20.052653 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-61ce53f5-43d0-49f2-b6c5-0765e88add81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff281b6a749a4669aca8f89646b59ce0', 'request_id': 'req-61ce53f5-43d0-49f2-b6c5-0765e88add81'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:20.127446 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-61ce53f5-43d0-49f2-b6c5-0765e88add81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff281b6a749a4669aca8f89646b59ce0', 'request_id': 'req-61ce53f5-43d0-49f2-b6c5-0765e88add81'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:20.138010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-61ce53f5-43d0-49f2-b6c5-0765e88add81 admin admin] The token cache is being invalidate because project ff281b6a749a4669aca8f89646b59ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80060) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:46:20.138316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-61ce53f5-43d0-49f2-b6c5-0765e88add81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:20.138936 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-61ce53f5-43d0-49f2-b6c5-0765e88add81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:20.140461 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1440/2841] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:46:19 2022] DELETE /identity/v3/projects/ff281b6a749a4669aca8f89646b59ce0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:20.146130 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd4c01-f217-4fad-8110-f6df075688a8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:20.146731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd4c01-f217-4fad-8110-f6df075688a8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:20.146731 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd4c01-f217-4fad-8110-f6df075688a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:20.164989 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1fcd4c01-f217-4fad-8110-f6df075688a8 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:20.166188 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1fcd4c01-f217-4fad-8110-f6df075688a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:20.225219 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1402/2842] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:20.234312 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a36998-fef7-4448-a4ba-fd684b5b1244 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:20.234927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a36998-fef7-4448-a4ba-fd684b5b1244 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:20.235221 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a36998-fef7-4448-a4ba-fd684b5b1244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:20.253403 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-25a36998-fef7-4448-a4ba-fd684b5b1244 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:20.254621 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-25a36998-fef7-4448-a4ba-fd684b5b1244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:20.262227 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1441/2843] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:20.266503 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd4c01-f217-4fad-8110-f6df075688a8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:20.276492 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd4c01-f217-4fad-8110-f6df075688a8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:20.281399 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc99197-59cc-4358-9845-ca112f3b17b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:20.282056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc99197-59cc-4358-9845-ca112f3b17b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:20.282368 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc99197-59cc-4358-9845-ca112f3b17b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:20.282642 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc99197-59cc-4358-9845-ca112f3b17b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:20.283358 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc99197-59cc-4358-9845-ca112f3b17b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:46:20.283666 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc99197-59cc-4358-9845-ca112f3b17b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:20.285299 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc99197-59cc-4358-9845-ca112f3b17b2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:20.296521 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1403/2844] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:46:20.300672 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a36998-fef7-4448-a4ba-fd684b5b1244 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:20.309870 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a36998-fef7-4448-a4ba-fd684b5b1244 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:20.315214 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aab81-f7f8-403b-b1ff-9594a755d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:20.315864 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aab81-f7f8-403b-b1ff-9594a755d411 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:20.316397 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aab81-f7f8-403b-b1ff-9594a755d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:20.316673 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aab81-f7f8-403b-b1ff-9594a755d411 admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:20.317398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579aab81-f7f8-403b-b1ff-9594a755d411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:20.319326 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579aab81-f7f8-403b-b1ff-9594a755d411 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:20.409244 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1442/2845] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:46:20 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:46:20.413193 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc99197-59cc-4358-9845-ca112f3b17b2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:20.425080 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc99197-59cc-4358-9845-ca112f3b17b2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:20.481956 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7241df-86bf-4394-b660-d882920ea115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:20.482662 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7241df-86bf-4394-b660-d882920ea115 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:20.482941 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7241df-86bf-4394-b660-d882920ea115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:20.483221 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7241df-86bf-4394-b660-d882920ea115 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:20.483914 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7241df-86bf-4394-b660-d882920ea115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:20.485865 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7241df-86bf-4394-b660-d882920ea115 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:20.601273 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1404/2846] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:46:20 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:46:20.605404 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aab81-f7f8-403b-b1ff-9594a755d411 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:20.616349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aab81-f7f8-403b-b1ff-9594a755d411 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:20.620949 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a8f78-57b5-435a-921f-956f56e65162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:20.621611 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a8f78-57b5-435a-921f-956f56e65162 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:20.621898 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a8f78-57b5-435a-921f-956f56e65162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:20.622177 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a8f78-57b5-435a-921f-956f56e65162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:20.623021 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a8f78-57b5-435a-921f-956f56e65162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:20.624619 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a8f78-57b5-435a-921f-956f56e65162 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:20.636019 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1443/2847] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:20.640167 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7241df-86bf-4394-b660-d882920ea115 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:20.651023 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7241df-86bf-4394-b660-d882920ea115 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:20.656281 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0732a1-5222-4672-8d2c-7c5c6a286005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:20.657073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0732a1-5222-4672-8d2c-7c5c6a286005 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:20.657359 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0732a1-5222-4672-8d2c-7c5c6a286005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:20.657759 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0732a1-5222-4672-8d2c-7c5c6a286005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:20.658784 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0732a1-5222-4672-8d2c-7c5c6a286005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:20.660454 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0732a1-5222-4672-8d2c-7c5c6a286005 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:20.670706 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1405/2848] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:20.687336 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a8f78-57b5-435a-921f-956f56e65162 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:20.698837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a8f78-57b5-435a-921f-956f56e65162 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:20.703434 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9ceb5-4fde-40d5-94db-3664631570e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:20.704305 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9ceb5-4fde-40d5-94db-3664631570e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:20.704576 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9ceb5-4fde-40d5-94db-3664631570e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:20.704848 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9ceb5-4fde-40d5-94db-3664631570e5 admin admin] PATH_INFO: `/v3/projects/3273aa44c22e432ea8b6e18fe230563a/users/c9a37b1e969d447dbed38e5d76584960/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:20.719279 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9ceb5-4fde-40d5-94db-3664631570e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3273aa44c22e432ea8b6e18fe230563a, user_id=c9a37b1e969d447dbed38e5d76584960, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:20.721999 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9ceb5-4fde-40d5-94db-3664631570e5 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:20.870451 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1444/2849] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:46:20 2022] PUT /identity/v3/projects/3273aa44c22e432ea8b6e18fe230563a/users/c9a37b1e969d447dbed38e5d76584960/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:20.881885 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282c36-277b-4743-9867-cdf1813e7938 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:20.882183 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282c36-277b-4743-9867-cdf1813e7938 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:20.882494 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282c36-277b-4743-9867-cdf1813e7938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:20.909696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-73282c36-277b-4743-9867-cdf1813e7938 None None] MFA Rules not processed for user `c9a37b1e969d447dbed38e5d76584960`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:20.911096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-73282c36-277b-4743-9867-cdf1813e7938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:20.978533 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1406/2850] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:46:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:20.983087 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9ceb5-4fde-40d5-94db-3664631570e5 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:21.041860 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9ceb5-4fde-40d5-94db-3664631570e5 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:21.046513 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c17a0f-c8d5-4de3-a56b-839d82d4b43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:21.047783 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17a0f-c8d5-4de3-a56b-839d82d4b43b admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:21.049045 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17a0f-c8d5-4de3-a56b-839d82d4b43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:21.049329 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17a0f-c8d5-4de3-a56b-839d82d4b43b admin admin] PATH_INFO: `/v3/projects` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:21.050212 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c17a0f-c8d5-4de3-a56b-839d82d4b43b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:21.052139 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c17a0f-c8d5-4de3-a56b-839d82d4b43b admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:21.175889 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1445/2851] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:46:20 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:46:21.179945 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73282c36-277b-4743-9867-cdf1813e7938 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:21.190498 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73282c36-277b-4743-9867-cdf1813e7938 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:21.245860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967c57b-91c7-454b-8485-f0f0cf6612de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:21.246553 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c57b-91c7-454b-8485-f0f0cf6612de admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:21.246839 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c57b-91c7-454b-8485-f0f0cf6612de admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:21.247120 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c57b-91c7-454b-8485-f0f0cf6612de admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:21.247797 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967c57b-91c7-454b-8485-f0f0cf6612de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:21.249739 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967c57b-91c7-454b-8485-f0f0cf6612de admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:21.389900 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1407/2852] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:46:21 2022] POST /identity/v3/users => generated 300 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:46:21.394385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c17a0f-c8d5-4de3-a56b-839d82d4b43b admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:21.404278 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c17a0f-c8d5-4de3-a56b-839d82d4b43b admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:21.409837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87809a0b-248e-4ed2-8ffa-d973db6f108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:21.410529 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809a0b-248e-4ed2-8ffa-d973db6f108a admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:21.410815 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809a0b-248e-4ed2-8ffa-d973db6f108a admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:21.411095 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809a0b-248e-4ed2-8ffa-d973db6f108a admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:21.411826 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87809a0b-248e-4ed2-8ffa-d973db6f108a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:21.413415 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87809a0b-248e-4ed2-8ffa-d973db6f108a admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:21.425004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1446/2853] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:21.429206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967c57b-91c7-454b-8485-f0f0cf6612de admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:21.438969 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967c57b-91c7-454b-8485-f0f0cf6612de admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:21.443751 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2810d0-94cd-4b4a-9e0d-d7caea5e8f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:21.444612 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2810d0-94cd-4b4a-9e0d-d7caea5e8f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:21.444893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2810d0-94cd-4b4a-9e0d-d7caea5e8f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:21.445169 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2810d0-94cd-4b4a-9e0d-d7caea5e8f8d admin admin] PATH_INFO: `/v3/projects/f9b3c28b52cc472d8babd66c8a5165f7/users/f3d4f388051a41128209e6a0c8933d14/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:21.460182 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2810d0-94cd-4b4a-9e0d-d7caea5e8f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b3c28b52cc472d8babd66c8a5165f7, user_id=f3d4f388051a41128209e6a0c8933d14, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:21.462909 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2810d0-94cd-4b4a-9e0d-d7caea5e8f8d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:21.596520 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1408/2854] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:46:21 2022] PUT /identity/v3/projects/f9b3c28b52cc472d8babd66c8a5165f7/users/f3d4f388051a41128209e6a0c8933d14/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:21.600568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87809a0b-248e-4ed2-8ffa-d973db6f108a admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:21.610569 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87809a0b-248e-4ed2-8ffa-d973db6f108a admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:21.663415 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203be5f-2d90-41ec-a5dd-b3da1895e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:21.664073 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203be5f-2d90-41ec-a5dd-b3da1895e2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:21.664353 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203be5f-2d90-41ec-a5dd-b3da1895e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:21.664628 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203be5f-2d90-41ec-a5dd-b3da1895e2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:21.665337 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203be5f-2d90-41ec-a5dd-b3da1895e2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:21.666962 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203be5f-2d90-41ec-a5dd-b3da1895e2c1 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:21.676421 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1447/2855] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:21.680843 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2810d0-94cd-4b4a-9e0d-d7caea5e8f8d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:21.692121 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2810d0-94cd-4b4a-9e0d-d7caea5e8f8d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:21.696631 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8425bc6-a0ab-4d5f-bd0b-c027203d2863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:21.697497 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8425bc6-a0ab-4d5f-bd0b-c027203d2863 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:21.697780 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8425bc6-a0ab-4d5f-bd0b-c027203d2863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:21.698056 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8425bc6-a0ab-4d5f-bd0b-c027203d2863 admin admin] PATH_INFO: `/v3/projects/f9b3c28b52cc472d8babd66c8a5165f7/users/f3d4f388051a41128209e6a0c8933d14/roles/a4cde3da8b864cf69a7a4680732971bf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:21.700018 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8425bc6-a0ab-4d5f-bd0b-c027203d2863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b3c28b52cc472d8babd66c8a5165f7, user_id=f3d4f388051a41128209e6a0c8933d14, role_id=a4cde3da8b864cf69a7a4680732971bf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:21.702670 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8425bc6-a0ab-4d5f-bd0b-c027203d2863 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:21.713425 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1409/2856] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:46:21 2022] PUT /identity/v3/projects/f9b3c28b52cc472d8babd66c8a5165f7/users/f3d4f388051a41128209e6a0c8933d14/roles/a4cde3da8b864cf69a7a4680732971bf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:21.728760 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c613bc-f65d-4564-9016-5c7328007e6c None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:21.729054 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c613bc-f65d-4564-9016-5c7328007e6c None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:21.729333 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c613bc-f65d-4564-9016-5c7328007e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:21.755684 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-c1c613bc-f65d-4564-9016-5c7328007e6c None None] MFA Rules not processed for user `f3d4f388051a41128209e6a0c8933d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:21.756894 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-c1c613bc-f65d-4564-9016-5c7328007e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:21.822319 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1448/2857] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:46:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:21.834020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8425bc6-a0ab-4d5f-bd0b-c027203d2863 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:21.835849 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d8425bc6-a0ab-4d5f-bd0b-c027203d2863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:21.892178 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8425bc6-a0ab-4d5f-bd0b-c027203d2863 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:21.895860 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb1489-a7fe-4a9d-8ff8-8ada1d9685c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:21.896497 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb1489-a7fe-4a9d-8ff8-8ada1d9685c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:21.896793 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb1489-a7fe-4a9d-8ff8-8ada1d9685c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:21.897086 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb1489-a7fe-4a9d-8ff8-8ada1d9685c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:21.905971 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb1489-a7fe-4a9d-8ff8-8ada1d9685c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:21.907508 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb1489-a7fe-4a9d-8ff8-8ada1d9685c0 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:21.916841 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1410/2858] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:46:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:23.132065 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c613bc-f65d-4564-9016-5c7328007e6c None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:23.192705 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c613bc-f65d-4564-9016-5c7328007e6c None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:23.197269 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:23.198169 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:23.198479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:23.198755 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] PATH_INFO: `/v3/users/c9a37b1e969d447dbed38e5d76584960` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:23.200010 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a37b1e969d447dbed38e5d76584960)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:23.201913 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:23.450088 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a37b1e969d447dbed38e5d76584960'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:23.461672 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a37b1e969d447dbed38e5d76584960'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:23.538749 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a37b1e969d447dbed38e5d76584960'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:23.539405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a37b1e969d447dbed38e5d76584960'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:23.551964 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a37b1e969d447dbed38e5d76584960'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:23.557967 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1449/2859] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:46:23 2022] DELETE /identity/v3/users/c9a37b1e969d447dbed38e5d76584960 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:23.562762 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc81bc-53ba-488e-92b8-915c0348c3eb None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:23.563637 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc81bc-53ba-488e-92b8-915c0348c3eb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:23.563940 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc81bc-53ba-488e-92b8-915c0348c3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:23.582807 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b2bc81bc-53ba-488e-92b8-915c0348c3eb None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:23.584096 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b2bc81bc-53ba-488e-92b8-915c0348c3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:23.641933 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1411/2860] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:46:23.652033 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:23.653437 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:23.710215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e43d4f-36d4-43d2-8220-f18b94c74e90 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:23.713797 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a55e28-1105-4e29-86ea-87e8cd480a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:23.714624 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a55e28-1105-4e29-86ea-87e8cd480a48 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:23.717094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a55e28-1105-4e29-86ea-87e8cd480a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:23.717094 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a55e28-1105-4e29-86ea-87e8cd480a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:23.724837 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a55e28-1105-4e29-86ea-87e8cd480a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:23.726339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a55e28-1105-4e29-86ea-87e8cd480a48 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:23.735971 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1450/2861] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:24.157457 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc81bc-53ba-488e-92b8-915c0348c3eb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:24.159106 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b2bc81bc-53ba-488e-92b8-915c0348c3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:24.172868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc81bc-53ba-488e-92b8-915c0348c3eb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:24.180539 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:24.181780 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:24.181970 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:24.182234 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] PATH_INFO: `/v3/projects/3273aa44c22e432ea8b6e18fe230563a` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:24.183972 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3273aa44c22e432ea8b6e18fe230563a)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:24.185925 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:24.304015 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3273aa44c22e432ea8b6e18fe230563a', 'request_id': 'req-981fabf5-a3f2-436a-b780-58b193278a36'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:24.309936 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3273aa44c22e432ea8b6e18fe230563a', 'request_id': 'req-981fabf5-a3f2-436a-b780-58b193278a36'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:24.412975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3273aa44c22e432ea8b6e18fe230563a', 'request_id': 'req-981fabf5-a3f2-436a-b780-58b193278a36'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:24.424139 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] The token cache is being invalidate because project 3273aa44c22e432ea8b6e18fe230563a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:46:24.424435 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:24.425104 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:24.426758 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1412/2862] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:46:24 2022] DELETE /identity/v3/projects/3273aa44c22e432ea8b6e18fe230563a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:24.431085 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a55e28-1105-4e29-86ea-87e8cd480a48 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:24.441562 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a55e28-1105-4e29-86ea-87e8cd480a48 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:24.498606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285cb26-d1ed-4e38-9dd1-9656f6c87bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:24.499473 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285cb26-d1ed-4e38-9dd1-9656f6c87bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:24.499759 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285cb26-d1ed-4e38-9dd1-9656f6c87bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:24.500036 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285cb26-d1ed-4e38-9dd1-9656f6c87bd0 admin admin] PATH_INFO: `/v3/users/f3d4f388051a41128209e6a0c8933d14` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:24.502037 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285cb26-d1ed-4e38-9dd1-9656f6c87bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d4f388051a41128209e6a0c8933d14)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:24.503970 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285cb26-d1ed-4e38-9dd1-9656f6c87bd0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:24.701213 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d285cb26-d1ed-4e38-9dd1-9656f6c87bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d4f388051a41128209e6a0c8933d14'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:24.708541 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d285cb26-d1ed-4e38-9dd1-9656f6c87bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d4f388051a41128209e6a0c8933d14'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:24.807167 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d285cb26-d1ed-4e38-9dd1-9656f6c87bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d4f388051a41128209e6a0c8933d14'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:24.807779 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d285cb26-d1ed-4e38-9dd1-9656f6c87bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d4f388051a41128209e6a0c8933d14'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:24.820963 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-d285cb26-d1ed-4e38-9dd1-9656f6c87bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d4f388051a41128209e6a0c8933d14'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:24.826802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1451/2863] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:46:24 2022] DELETE /identity/v3/users/f3d4f388051a41128209e6a0c8933d14 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:25.255045 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:25.256603 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:25.270073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fabf5-a3f2-436a-b780-58b193278a36 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:25.325573 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:25.326463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:25.326747 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:25.327021 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222 admin admin] PATH_INFO: `/v3/projects/f9b3c28b52cc472d8babd66c8a5165f7` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:25.328184 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b3c28b52cc472d8babd66c8a5165f7)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:25.330268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:25.418858 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b3c28b52cc472d8babd66c8a5165f7', 'request_id': 'req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:25.426262 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b3c28b52cc472d8babd66c8a5165f7', 'request_id': 'req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:25.504074 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b3c28b52cc472d8babd66c8a5165f7', 'request_id': 'req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:25.514578 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222 admin admin] The token cache is being invalidate because project f9b3c28b52cc472d8babd66c8a5165f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:46:25.514868 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:25.515791 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-ef442f7a-ea73-43cb-ae99-bb82bd2d9222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:25.517073 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1413/2864] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:46:25 2022] DELETE /identity/v3/projects/f9b3c28b52cc472d8babd66c8a5165f7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:46:25.522012 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f157437-7731-48a8-9339-78dc0247b7f2 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:25.522526 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f157437-7731-48a8-9339-78dc0247b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:25.522627 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f157437-7731-48a8-9339-78dc0247b7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:25.541187 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-8f157437-7731-48a8-9339-78dc0247b7f2 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:25.542405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-8f157437-7731-48a8-9339-78dc0247b7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:25.600998 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1452/2865] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:25.608907 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7062c-1662-476c-8865-5056153e7623 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:25.609194 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7062c-1662-476c-8865-5056153e7623 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:25.609490 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7062c-1662-476c-8865-5056153e7623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:25.629409 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1db7062c-1662-476c-8865-5056153e7623 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:25.630634 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1db7062c-1662-476c-8865-5056153e7623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:25.638527 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1414/2866] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:46:25.643018 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f157437-7731-48a8-9339-78dc0247b7f2 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:25.652802 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f157437-7731-48a8-9339-78dc0247b7f2 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:25.658001 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba359c-b754-426f-8d79-f28cf5c973a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:25.658688 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba359c-b754-426f-8d79-f28cf5c973a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:25.658975 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba359c-b754-426f-8d79-f28cf5c973a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:25.659249 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba359c-b754-426f-8d79-f28cf5c973a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:25.659976 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba359c-b754-426f-8d79-f28cf5c973a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:46:25.660300 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba359c-b754-426f-8d79-f28cf5c973a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:25.661869 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba359c-b754-426f-8d79-f28cf5c973a3 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:25.673652 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1453/2867] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:46:25.677837 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7062c-1662-476c-8865-5056153e7623 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:25.686824 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7062c-1662-476c-8865-5056153e7623 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:25.692185 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48fc30-c565-4092-90b2-40b59dbb5ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:25.692826 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48fc30-c565-4092-90b2-40b59dbb5ece admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:25.693108 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48fc30-c565-4092-90b2-40b59dbb5ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:25.693422 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48fc30-c565-4092-90b2-40b59dbb5ece admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:25.694122 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48fc30-c565-4092-90b2-40b59dbb5ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:25.696055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48fc30-c565-4092-90b2-40b59dbb5ece admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:25.769947 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1415/2868] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:46:25 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:46:25.774174 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba359c-b754-426f-8d79-f28cf5c973a3 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:25.784669 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba359c-b754-426f-8d79-f28cf5c973a3 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:25.841769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859bc81-e7c5-4a58-997e-0aafb3938d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:25.842469 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859bc81-e7c5-4a58-997e-0aafb3938d1f admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:25.842753 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859bc81-e7c5-4a58-997e-0aafb3938d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:25.843030 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859bc81-e7c5-4a58-997e-0aafb3938d1f admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:25.843709 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859bc81-e7c5-4a58-997e-0aafb3938d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:25.846349 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859bc81-e7c5-4a58-997e-0aafb3938d1f admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:25.920945 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1454/2869] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:46:25 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:46:25.925107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48fc30-c565-4092-90b2-40b59dbb5ece admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:25.935203 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48fc30-c565-4092-90b2-40b59dbb5ece admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:25.939765 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1fbfd-e989-4c5c-ace8-3d7066550b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:25.940696 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1fbfd-e989-4c5c-ace8-3d7066550b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:25.940975 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1fbfd-e989-4c5c-ace8-3d7066550b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:25.941499 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1fbfd-e989-4c5c-ace8-3d7066550b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:25.942206 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1fbfd-e989-4c5c-ace8-3d7066550b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:25.943838 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1fbfd-e989-4c5c-ace8-3d7066550b4c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:25.954746 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1416/2870] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:25.958901 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859bc81-e7c5-4a58-997e-0aafb3938d1f admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:25.968696 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859bc81-e7c5-4a58-997e-0aafb3938d1f admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:25.974251 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbba38a-5e52-41df-a6e6-d465653511d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:25.974933 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbba38a-5e52-41df-a6e6-d465653511d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:25.975215 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbba38a-5e52-41df-a6e6-d465653511d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:25.975487 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbba38a-5e52-41df-a6e6-d465653511d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:25.976203 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbba38a-5e52-41df-a6e6-d465653511d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:25.977769 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbba38a-5e52-41df-a6e6-d465653511d5 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:25.987927 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1455/2871] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:25.991892 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1fbfd-e989-4c5c-ace8-3d7066550b4c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:26.001650 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1fbfd-e989-4c5c-ace8-3d7066550b4c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:26.006458 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e155f-c5b1-4308-9d8f-1c3a50606cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:26.007349 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e155f-c5b1-4308-9d8f-1c3a50606cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.007628 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e155f-c5b1-4308-9d8f-1c3a50606cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.008424 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e155f-c5b1-4308-9d8f-1c3a50606cd2 admin admin] PATH_INFO: `/v3/projects/32f01c67920942ac8a2ebf5f9f529bc9/users/54ba87a1dde4405da8c352114ad483ab/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.023767 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e155f-c5b1-4308-9d8f-1c3a50606cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f01c67920942ac8a2ebf5f9f529bc9, user_id=54ba87a1dde4405da8c352114ad483ab, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:26.026403 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e155f-c5b1-4308-9d8f-1c3a50606cd2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:26.127718 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1417/2872] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:46:25 2022] PUT /identity/v3/projects/32f01c67920942ac8a2ebf5f9f529bc9/users/54ba87a1dde4405da8c352114ad483ab/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:26.147559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b65408-e799-4f31-bf61-150389fb225b None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.147851 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b65408-e799-4f31-bf61-150389fb225b None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.148132 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b65408-e799-4f31-bf61-150389fb225b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.173653 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-a0b65408-e799-4f31-bf61-150389fb225b None None] MFA Rules not processed for user `54ba87a1dde4405da8c352114ad483ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:26.174873 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a0b65408-e799-4f31-bf61-150389fb225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:26.235886 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1456/2873] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:46:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:26.246391 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e155f-c5b1-4308-9d8f-1c3a50606cd2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:26.248066 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-373e155f-c5b1-4308-9d8f-1c3a50606cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:26.303441 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e155f-c5b1-4308-9d8f-1c3a50606cd2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:26.307246 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2bb2f-f1fa-470b-9545-5070de618120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe051e3e2084f89a95a95aa4fd857df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:26.307893 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2bb2f-f1fa-470b-9545-5070de618120 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.308201 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2bb2f-f1fa-470b-9545-5070de618120 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.308479 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2bb2f-f1fa-470b-9545-5070de618120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.318025 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2bb2f-f1fa-470b-9545-5070de618120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:26.319470 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2bb2f-f1fa-470b-9545-5070de618120 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:26.327988 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1418/2874] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:46:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:30.634602 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b65408-e799-4f31-bf61-150389fb225b None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:30.694429 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b65408-e799-4f31-bf61-150389fb225b None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:30.699104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:30.699976 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:30.700287 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:30.700563 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] PATH_INFO: `/v3/users/54ba87a1dde4405da8c352114ad483ab` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:30.701766 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ba87a1dde4405da8c352114ad483ab)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:30.703729 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:30.936216 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ba87a1dde4405da8c352114ad483ab'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:30.943782 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ba87a1dde4405da8c352114ad483ab'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:31.098547 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ba87a1dde4405da8c352114ad483ab'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:31.099182 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ba87a1dde4405da8c352114ad483ab'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:31.111568 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ba87a1dde4405da8c352114ad483ab'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:31.117657 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1457/2875] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:46:30 2022] DELETE /identity/v3/users/54ba87a1dde4405da8c352114ad483ab => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:31.122411 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488af2-9e90-43d5-a98d-d3b00e78b5b4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:31.122895 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488af2-9e90-43d5-a98d-d3b00e78b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:31.123005 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488af2-9e90-43d5-a98d-d3b00e78b5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:31.140177 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-af488af2-9e90-43d5-a98d-d3b00e78b5b4 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:31.143050 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-af488af2-9e90-43d5-a98d-d3b00e78b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:31.201214 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1419/2876] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:31.211479 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:31.212879 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:31.268289 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503264ee-4cbe-4f20-8bbd-5ba18cd2e7a0 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:31.271931 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db85aeb-40c9-4af6-b22a-224dada7febb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:31.272572 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db85aeb-40c9-4af6-b22a-224dada7febb service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:31.272855 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db85aeb-40c9-4af6-b22a-224dada7febb service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:31.273130 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db85aeb-40c9-4af6-b22a-224dada7febb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:31.281929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db85aeb-40c9-4af6-b22a-224dada7febb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:31.284188 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db85aeb-40c9-4af6-b22a-224dada7febb service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:31.293398 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1458/2877] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:31.768390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af488af2-9e90-43d5-a98d-d3b00e78b5b4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:31.768390 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-af488af2-9e90-43d5-a98d-d3b00e78b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:31.777322 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af488af2-9e90-43d5-a98d-d3b00e78b5b4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:31.782579 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:31.783576 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:31.783810 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:31.784092 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1 admin admin] PATH_INFO: `/v3/projects/32f01c67920942ac8a2ebf5f9f529bc9` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:31.785312 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f01c67920942ac8a2ebf5f9f529bc9)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:31.787282 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:31.966530 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f01c67920942ac8a2ebf5f9f529bc9', 'request_id': 'req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:31.972660 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f01c67920942ac8a2ebf5f9f529bc9', 'request_id': 'req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:32.150042 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f01c67920942ac8a2ebf5f9f529bc9', 'request_id': 'req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:32.161712 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1 admin admin] The token cache is being invalidate because project 32f01c67920942ac8a2ebf5f9f529bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:46:32.162001 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:32.162637 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8f0f7c4a-ea5b-4e2c-b539-772d13ea24d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:32.164200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1420/2878] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:46:31 2022] DELETE /identity/v3/projects/32f01c67920942ac8a2ebf5f9f529bc9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:32.169820 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d2728-0a1d-465d-bd09-8aaf87ce0f0d None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:32.170308 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d2728-0a1d-465d-bd09-8aaf87ce0f0d None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:32.170422 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d2728-0a1d-465d-bd09-8aaf87ce0f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:32.188524 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-2d2d2728-0a1d-465d-bd09-8aaf87ce0f0d None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:32.200564 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2d2d2728-0a1d-465d-bd09-8aaf87ce0f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:32.246681 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1459/2879] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:32.255528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ad8ac-d593-4ed2-a270-a4f283e3043f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:32.269268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ad8ac-d593-4ed2-a270-a4f283e3043f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:32.269268 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ad8ac-d593-4ed2-a270-a4f283e3043f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:32.273889 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4f0ad8ac-d593-4ed2-a270-a4f283e3043f None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:32.275123 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4f0ad8ac-d593-4ed2-a270-a4f283e3043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:32.283090 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1421/2880] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:32.287835 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d2728-0a1d-465d-bd09-8aaf87ce0f0d None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:32.297532 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d2728-0a1d-465d-bd09-8aaf87ce0f0d None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:32.302995 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b87f1a-a6e7-4d46-92b5-33d00c43d919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:32.303649 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87f1a-a6e7-4d46-92b5-33d00c43d919 admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:32.303952 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87f1a-a6e7-4d46-92b5-33d00c43d919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:32.304276 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87f1a-a6e7-4d46-92b5-33d00c43d919 admin admin] PATH_INFO: `/v3/domains` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:32.305004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b87f1a-a6e7-4d46-92b5-33d00c43d919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:46:32.305317 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b87f1a-a6e7-4d46-92b5-33d00c43d919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:32.306948 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b87f1a-a6e7-4d46-92b5-33d00c43d919 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:32.319031 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1460/2881] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 5 15:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:46:32.323259 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ad8ac-d593-4ed2-a270-a4f283e3043f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:32.332874 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ad8ac-d593-4ed2-a270-a4f283e3043f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:32.337463 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6c5da-f3d9-4907-8a05-276f73b331c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:32.338107 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6c5da-f3d9-4907-8a05-276f73b331c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:32.338417 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6c5da-f3d9-4907-8a05-276f73b331c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:32.338697 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6c5da-f3d9-4907-8a05-276f73b331c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:32.339388 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6c5da-f3d9-4907-8a05-276f73b331c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:32.341278 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6c5da-f3d9-4907-8a05-276f73b331c2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:32.540789 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1422/2882] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 5 15:46:32 2022] POST /identity/v3/projects => generated 369 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:46:32.544868 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b87f1a-a6e7-4d46-92b5-33d00c43d919 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:32.556199 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b87f1a-a6e7-4d46-92b5-33d00c43d919 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:32.613151 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9e86b-3dcb-49ee-882c-cd10580c9f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:32.613819 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9e86b-3dcb-49ee-882c-cd10580c9f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:32.614104 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9e86b-3dcb-49ee-882c-cd10580c9f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:32.614417 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9e86b-3dcb-49ee-882c-cd10580c9f51 admin admin] PATH_INFO: `/v3/users` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:32.615105 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9e86b-3dcb-49ee-882c-cd10580c9f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:32.617004 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9e86b-3dcb-49ee-882c-cd10580c9f51 admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:32.755405 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1461/2883] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 5 15:46:32 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:46:32.759645 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6c5da-f3d9-4907-8a05-276f73b331c2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:32.770686 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6c5da-f3d9-4907-8a05-276f73b331c2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:32.775702 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cccb8f-9ba2-48f5-8c56-3cec7638c948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:32.776374 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cccb8f-9ba2-48f5-8c56-3cec7638c948 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:32.776695 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cccb8f-9ba2-48f5-8c56-3cec7638c948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:32.777020 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cccb8f-9ba2-48f5-8c56-3cec7638c948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:32.777775 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cccb8f-9ba2-48f5-8c56-3cec7638c948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:32.779427 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cccb8f-9ba2-48f5-8c56-3cec7638c948 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:32.790688 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1423/2884] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:32.794736 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9e86b-3dcb-49ee-882c-cd10580c9f51 admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:32.804914 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9e86b-3dcb-49ee-882c-cd10580c9f51 admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:32.809383 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242c46f-1d79-49bf-9760-e28e3ed371df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:32.810040 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242c46f-1d79-49bf-9760-e28e3ed371df admin admin] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:32.810359 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242c46f-1d79-49bf-9760-e28e3ed371df admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:32.810636 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242c46f-1d79-49bf-9760-e28e3ed371df admin admin] PATH_INFO: `/v3/roles` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:32.811356 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242c46f-1d79-49bf-9760-e28e3ed371df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:32.812929 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242c46f-1d79-49bf-9760-e28e3ed371df admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:32.823618 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1462/2885] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 5 15:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:32.828778 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cccb8f-9ba2-48f5-8c56-3cec7638c948 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:32.839563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cccb8f-9ba2-48f5-8c56-3cec7638c948 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:32.844233 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea911ea-2df8-430f-b6cb-96517e893b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:32.845104 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea911ea-2df8-430f-b6cb-96517e893b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:32.845400 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea911ea-2df8-430f-b6cb-96517e893b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:32.845681 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea911ea-2df8-430f-b6cb-96517e893b3b admin admin] PATH_INFO: `/v3/projects/7f1a09129e594c459419d640db09e76f/users/5aab7467f2554725aa23f21a456dd2a9/roles/e2401a0c8c204431b0eff57c19186866` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:32.860055 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea911ea-2df8-430f-b6cb-96517e893b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1a09129e594c459419d640db09e76f, user_id=5aab7467f2554725aa23f21a456dd2a9, role_id=e2401a0c8c204431b0eff57c19186866)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:32.862821 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea911ea-2df8-430f-b6cb-96517e893b3b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:32.962371 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1424/2886] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 5 15:46:32 2022] PUT /identity/v3/projects/7f1a09129e594c459419d640db09e76f/users/5aab7467f2554725aa23f21a456dd2a9/roles/e2401a0c8c204431b0eff57c19186866 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:32.977882 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629e61f-b295-4944-b13f-6ab747d89881 None None] REQUEST_METHOD: `POST` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:32.978180 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629e61f-b295-4944-b13f-6ab747d89881 None None] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:32.978545 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629e61f-b295-4944-b13f-6ab747d89881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.005316 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.auth.core [None req-b629e61f-b295-4944-b13f-6ab747d89881 None None] MFA Rules not processed for user `5aab7467f2554725aa23f21a456dd2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:33.006586 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-b629e61f-b295-4944-b13f-6ab747d89881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:33.069796 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1463/2887] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:46:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:33.082528 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea911ea-2df8-430f-b6cb-96517e893b3b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:33.084200 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1ea911ea-2df8-430f-b6cb-96517e893b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:33.159642 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea911ea-2df8-430f-b6cb-96517e893b3b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:33.163352 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16db41-5f4e-46cd-92ec-072149787412 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f973b13dd44e609110f9a967ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:33.163992 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16db41-5f4e-46cd-92ec-072149787412 service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.164274 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16db41-5f4e-46cd-92ec-072149787412 service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.164550 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16db41-5f4e-46cd-92ec-072149787412 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.173222 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16db41-5f4e-46cd-92ec-072149787412 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:33.179452 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16db41-5f4e-46cd-92ec-072149787412 service glance] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:33.183831 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1425/2888] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:46:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:02.017361 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629e61f-b295-4944-b13f-6ab747d89881 None None] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:02.077385 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629e61f-b295-4944-b13f-6ab747d89881 None None] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:02.082726 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:02.083597 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:02.083918 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:02.084192 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] PATH_INFO: `/v3/users/5aab7467f2554725aa23f21a456dd2a9` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:02.085374 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aab7467f2554725aa23f21a456dd2a9)` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:02.087323 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:02.260080 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aab7467f2554725aa23f21a456dd2a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:02.266741 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aab7467f2554725aa23f21a456dd2a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:02.344606 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aab7467f2554725aa23f21a456dd2a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:02.345242 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aab7467f2554725aa23f21a456dd2a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:02.362008 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.notifications [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aab7467f2554725aa23f21a456dd2a9'} {{(pid=80060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:02.369339 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1464/2889] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 5 15:47:02 2022] DELETE /identity/v3/users/5aab7467f2554725aa23f21a456dd2a9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:47:02.375850 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648271ec-2508-44b4-bdff-3b08a921f7d1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:02.376345 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648271ec-2508-44b4-bdff-3b08a921f7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:02.376795 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648271ec-2508-44b4-bdff-3b08a921f7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:02.399814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-648271ec-2508-44b4-bdff-3b08a921f7d1 None None] MFA Rules not processed for user `faf5764aa68b4dd0a7861a70d6db3d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:47:02.401834 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-648271ec-2508-44b4-bdff-3b08a921f7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:02.468974 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1426/2890] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 5 15:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:47:02.478227 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:02.479734 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:02.540350 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2ce6e-8253-4c0a-b099-a8c94339edee admin admin] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:02.543902 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff268f-209a-4650-8565-191242363b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5efb606fb1b422182ab91576088c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:02.544559 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff268f-209a-4650-8565-191242363b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:02.544843 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff268f-209a-4650-8565-191242363b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:02.545121 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff268f-209a-4650-8565-191242363b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:02.554737 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff268f-209a-4650-8565-191242363b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:02.556176 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff268f-209a-4650-8565-191242363b89 service neutron] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:02.565725 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1465/2891] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:03.037471 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648271ec-2508-44b4-bdff-3b08a921f7d1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:03.038981 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-648271ec-2508-44b4-bdff-3b08a921f7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:03.052642 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648271ec-2508-44b4-bdff-3b08a921f7d1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:03.057588 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b29d3a-64c6-4e92-b735-46846b20c0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf5764aa68b4dd0a7861a70d6db3d3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02855100ad2c4964b2978e96832f8664', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:03.058488 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b29d3a-64c6-4e92-b735-46846b20c0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:03.058770 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b29d3a-64c6-4e92-b735-46846b20c0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:03.059640 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b29d3a-64c6-4e92-b735-46846b20c0f4 admin admin] PATH_INFO: `/v3/projects/7f1a09129e594c459419d640db09e76f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:03.060572 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b29d3a-64c6-4e92-b735-46846b20c0f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1a09129e594c459419d640db09e76f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:03.062563 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b29d3a-64c6-4e92-b735-46846b20c0f4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:03.247607 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-86b29d3a-64c6-4e92-b735-46846b20c0f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1a09129e594c459419d640db09e76f', 'request_id': 'req-86b29d3a-64c6-4e92-b735-46846b20c0f4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:03.253782 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-86b29d3a-64c6-4e92-b735-46846b20c0f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1a09129e594c459419d640db09e76f', 'request_id': 'req-86b29d3a-64c6-4e92-b735-46846b20c0f4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:03.367472 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-86b29d3a-64c6-4e92-b735-46846b20c0f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1a09129e594c459419d640db09e76f', 'request_id': 'req-86b29d3a-64c6-4e92-b735-46846b20c0f4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:03.379814 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-86b29d3a-64c6-4e92-b735-46846b20c0f4 admin admin] The token cache is being invalidate because project 7f1a09129e594c459419d640db09e76f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:47:03.380768 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-86b29d3a-64c6-4e92-b735-46846b20c0f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:03.381360 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-86b29d3a-64c6-4e92-b735-46846b20c0f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:03.383117 dv-cinder-840678-1-iscsi devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1427/2892] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 5 15:47:03 2022] DELETE /identity/v3/projects/7f1a09129e594c459419d640db09e76f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:51:02.829989 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff268f-209a-4650-8565-191242363b89 service neutron] Authenticating user token {{(pid=80060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:51:02.831417 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-a5ff268f-209a-4650-8565-191242363b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:51:02.897292 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff268f-209a-4650-8565-191242363b89 service neutron] Validating token access rules against request {{(pid=80060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:51:02.953588 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c778cc8-2eef-4472-8ef2-49b9908d12d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db978c3b147c4b259b623e8c64e7c13a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '587280a3c4c54bffb4d769e406af3689', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:51:02.954470 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c778cc8-2eef-4472-8ef2-49b9908d12d8 service placement] REQUEST_METHOD: `GET` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:02.954777 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c778cc8-2eef-4472-8ef2-49b9908d12d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:02.955048 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c778cc8-2eef-4472-8ef2-49b9908d12d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:02.956848 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.fernet_utils [None req-2c778cc8-2eef-4472-8ef2-49b9908d12d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:51:02.968255 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c778cc8-2eef-4472-8ef2-49b9908d12d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:51:02.970456 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c778cc8-2eef-4472-8ef2-49b9908d12d8 service placement] RBAC: Authorization granted {{(pid=80060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:51:02.980399 dv-cinder-840678-1-iscsi devstack@keystone.service[80060]: [pid: 80060|app: 0|req: 1466/2893] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 5 15:51:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)